[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:08:28.458758 25395 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.204.254:36299
I20260709 13:08:28.460399 25395 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:08:28.461493 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:28.479825 25401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:28.479898 25402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:28.479858 25404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:28.480731 25395 server_base.cc:1061] running on GCE node
I20260709 13:08:29.744972 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:29.745313 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:29.745548 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602509745516 us; error 0 us; skew 500 ppm
I20260709 13:08:29.746490 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:29.753669 25395 webserver.cc:533] Webserver started at http://127.24.204.254:38827/ using document root <none> and password file <none>
I20260709 13:08:29.754631 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:29.754896 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:29.755391 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:29.761473 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/master-0-root/instance:
uuid: "da50a70270dd46c7872edd07590154fa"
format_stamp: "Formatted at 2026-07-09 13:08:29 on dist-test-slave-qv7r"
I20260709 13:08:29.770397 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:29.775983 25410 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:29.777441 25395 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:08:29.777966 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/master-0-root
uuid: "da50a70270dd46c7872edd07590154fa"
format_stamp: "Formatted at 2026-07-09 13:08:29 on dist-test-slave-qv7r"
I20260709 13:08:29.778355 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:29.832003 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:29.833671 25395 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:08:29.834172 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:29.911381 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.254:36299
I20260709 13:08:29.911479 25461 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.254:36299 every 8 connection(s)
I20260709 13:08:29.919889 25462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:29.944257 25462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa: Bootstrap starting.
I20260709 13:08:29.950803 25462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.952939 25462 log.cc:826] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa: Log is configured to *not* fsync() on all Append() calls
I20260709 13:08:29.958338 25462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa: No bootstrap required, opened a new log
I20260709 13:08:29.981477 25462 raft_consensus.cc:359] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da50a70270dd46c7872edd07590154fa" member_type: VOTER }
I20260709 13:08:29.982191 25462 raft_consensus.cc:385] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.982515 25462 raft_consensus.cc:740] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da50a70270dd46c7872edd07590154fa, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.983536 25462 consensus_queue.cc:260] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da50a70270dd46c7872edd07590154fa" member_type: VOTER }
I20260709 13:08:29.984135 25462 raft_consensus.cc:399] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:29.984462 25462 raft_consensus.cc:493] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:29.984866 25462 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.989733 25462 raft_consensus.cc:515] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da50a70270dd46c7872edd07590154fa" member_type: VOTER }
I20260709 13:08:29.990633 25462 leader_election.cc:304] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da50a70270dd46c7872edd07590154fa; no voters: 
I20260709 13:08:29.992594 25462 leader_election.cc:290] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:29.993052 25465 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.995819 25465 raft_consensus.cc:697] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 1 LEADER]: Becoming Leader. State: Replica: da50a70270dd46c7872edd07590154fa, State: Running, Role: LEADER
I20260709 13:08:29.996692 25465 consensus_queue.cc:237] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da50a70270dd46c7872edd07590154fa" member_type: VOTER }
I20260709 13:08:29.997435 25462 sys_catalog.cc:565] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:30.009758 25467 sys_catalog.cc:455] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader da50a70270dd46c7872edd07590154fa. Latest consensus state: current_term: 1 leader_uuid: "da50a70270dd46c7872edd07590154fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da50a70270dd46c7872edd07590154fa" member_type: VOTER } }
I20260709 13:08:30.010761 25467 sys_catalog.cc:458] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:30.013803 25466 sys_catalog.cc:455] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da50a70270dd46c7872edd07590154fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da50a70270dd46c7872edd07590154fa" member_type: VOTER } }
I20260709 13:08:30.014552 25466 sys_catalog.cc:458] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:30.016137 25474 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:30.028908 25474 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:30.031237 25395 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:30.047297 25474 catalog_manager.cc:1383] Generated new cluster ID: 71a1f0c29baf4c31a2b2cc32ad8dcdcb
I20260709 13:08:30.047603 25474 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:30.072254 25474 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:30.074355 25474 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:30.104385 25474 catalog_manager.cc:6070] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa: Generated new TSK 0
I20260709 13:08:30.105474 25474 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:30.163606 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:30.172356 25484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:30.173846 25485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:30.180485 25395 server_base.cc:1061] running on GCE node
W20260709 13:08:30.180722 25487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:30.182215 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:30.182628 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:30.182852 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602510182813 us; error 0 us; skew 500 ppm
I20260709 13:08:30.183570 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:30.188431 25395 webserver.cc:533] Webserver started at http://127.24.204.193:34363/ using document root <none> and password file <none>
I20260709 13:08:30.189020 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:30.189229 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:30.189553 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:30.190805 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-0-root/instance:
uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
format_stamp: "Formatted at 2026-07-09 13:08:30 on dist-test-slave-qv7r"
I20260709 13:08:30.196959 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.007s
I20260709 13:08:30.202356 25492 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:30.203295 25395 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:30.203619 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-0-root
uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
format_stamp: "Formatted at 2026-07-09 13:08:30 on dist-test-slave-qv7r"
I20260709 13:08:30.203929 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:30.247951 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:30.249897 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:30.253033 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:30.258033 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:30.258365 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:30.258638 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:30.258826 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:30.370863 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.193:33585
I20260709 13:08:30.370939 25554 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.193:33585 every 8 connection(s)
I20260709 13:08:30.378479 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:30.388866 25559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:30.391094 25560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:30.396777 25562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:30.398512 25395 server_base.cc:1061] running on GCE node
I20260709 13:08:30.399885 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:30.400307 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:30.400548 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602510400524 us; error 0 us; skew 500 ppm
I20260709 13:08:30.401402 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:30.404618 25555 heartbeater.cc:344] Connected to a master server at 127.24.204.254:36299
I20260709 13:08:30.405309 25555 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:30.406920 25555 heartbeater.cc:507] Master 127.24.204.254:36299 requested a full tablet report, sending...
I20260709 13:08:30.409224 25395 webserver.cc:533] Webserver started at http://127.24.204.194:39075/ using document root <none> and password file <none>
I20260709 13:08:30.409807 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:30.410048 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:30.410362 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:30.411295 25427 ts_manager.cc:194] Registered new tserver with Master: 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585)
I20260709 13:08:30.411513 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-1-root/instance:
uuid: "b0c6581491d341e09aea4bb7528025c5"
format_stamp: "Formatted at 2026-07-09 13:08:30 on dist-test-slave-qv7r"
I20260709 13:08:30.414772 25427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46844
I20260709 13:08:30.417979 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:08:30.423249 25567 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:30.424139 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:08:30.424482 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-1-root
uuid: "b0c6581491d341e09aea4bb7528025c5"
format_stamp: "Formatted at 2026-07-09 13:08:30 on dist-test-slave-qv7r"
I20260709 13:08:30.424853 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:30.451756 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:30.453485 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:30.456653 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:30.459535 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:30.459823 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:30.460099 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:30.460302 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:30.548720 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.194:41957
I20260709 13:08:30.548828 25629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.194:41957 every 8 connection(s)
I20260709 13:08:30.555858 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:30.566219 25634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:30.569213 25630 heartbeater.cc:344] Connected to a master server at 127.24.204.254:36299
W20260709 13:08:30.569177 25633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:30.569787 25630 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:30.570811 25630 heartbeater.cc:507] Master 127.24.204.254:36299 requested a full tablet report, sending...
W20260709 13:08:30.572275 25636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:30.573264 25427 ts_manager.cc:194] Registered new tserver with Master: b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:30.573668 25395 server_base.cc:1061] running on GCE node
I20260709 13:08:30.574944 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:08:30.574957 25427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46856
W20260709 13:08:30.575304 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:30.575524 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602510575507 us; error 0 us; skew 500 ppm
I20260709 13:08:30.576268 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:30.579291 25395 webserver.cc:533] Webserver started at http://127.24.204.195:44857/ using document root <none> and password file <none>
I20260709 13:08:30.579967 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:30.580199 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:30.580520 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:30.581915 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-2-root/instance:
uuid: "4495e708d9054d6ca2691297176c5bd7"
format_stamp: "Formatted at 2026-07-09 13:08:30 on dist-test-slave-qv7r"
I20260709 13:08:30.587759 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:08:30.592234 25641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:30.593180 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:08:30.593549 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-2-root
uuid: "4495e708d9054d6ca2691297176c5bd7"
format_stamp: "Formatted at 2026-07-09 13:08:30 on dist-test-slave-qv7r"
I20260709 13:08:30.593935 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602508284650-25395-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:30.624598 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:30.626312 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:30.628026 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:30.630923 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:30.631219 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:30.631516 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:30.631705 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:30.732410 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.195:43835
I20260709 13:08:30.732486 25703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.195:43835 every 8 connection(s)
I20260709 13:08:30.758355 25704 heartbeater.cc:344] Connected to a master server at 127.24.204.254:36299
I20260709 13:08:30.758816 25704 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:30.759688 25704 heartbeater.cc:507] Master 127.24.204.254:36299 requested a full tablet report, sending...
I20260709 13:08:30.762388 25427 ts_manager.cc:194] Registered new tserver with Master: 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:30.762734 25395 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.023958756s
I20260709 13:08:30.763851 25427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46858
I20260709 13:08:30.839021 25427 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46862:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:30.844659 25427 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:30.955612 25594 tablet_service.cc:1511] Processing CreateTablet for tablet 09cea5bbd30a461a9b4f7188780a0850 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:30.955807 25595 tablet_service.cc:1511] Processing CreateTablet for tablet b9f352f1a60a40a0a09acfc8422b9736 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:30.957412 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cea5bbd30a461a9b4f7188780a0850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:30.958113 25595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f352f1a60a40a0a09acfc8422b9736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:30.971810 25593 tablet_service.cc:1511] Processing CreateTablet for tablet b36befdfc5fb49719a7da9da167ee404 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:30.973430 25593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36befdfc5fb49719a7da9da167ee404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:30.983625 25591 tablet_service.cc:1511] Processing CreateTablet for tablet 52433a05833644b9960a9e1b5bf8a286 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:30.982731 25590 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb596975e484608a46c0fe9b20bb5fe (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:30.985931 25591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52433a05833644b9960a9e1b5bf8a286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:30.983707 25592 tablet_service.cc:1511] Processing CreateTablet for tablet f147bb3c4d3e4c499012718b59ec3863 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:30.988598 25592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f147bb3c4d3e4c499012718b59ec3863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:30.990770 25590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb596975e484608a46c0fe9b20bb5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.007252 25667 tablet_service.cc:1511] Processing CreateTablet for tablet b36befdfc5fb49719a7da9da167ee404 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:31.012591 25666 tablet_service.cc:1511] Processing CreateTablet for tablet f147bb3c4d3e4c499012718b59ec3863 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:31.013458 25668 tablet_service.cc:1511] Processing CreateTablet for tablet 09cea5bbd30a461a9b4f7188780a0850 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:31.015342 25589 tablet_service.cc:1511] Processing CreateTablet for tablet 10caecec8c054b18a4a2bf178b001a54 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:31.007318 25669 tablet_service.cc:1511] Processing CreateTablet for tablet b9f352f1a60a40a0a09acfc8422b9736 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:31.022867 25665 tablet_service.cc:1511] Processing CreateTablet for tablet 52433a05833644b9960a9e1b5bf8a286 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:31.015332 25664 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb596975e484608a46c0fe9b20bb5fe (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260709 13:08:31.029897 25475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:31.027819 25663 tablet_service.cc:1511] Processing CreateTablet for tablet 10caecec8c054b18a4a2bf178b001a54 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:31.028218 25667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36befdfc5fb49719a7da9da167ee404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.036661 25594 tablet_service.cc:1511] Processing CreateTablet for tablet 79d40dbd48594f80985fa77016912dbd (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:31.040356 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d40dbd48594f80985fa77016912dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.045660 25662 tablet_service.cc:1511] Processing CreateTablet for tablet 79d40dbd48594f80985fa77016912dbd (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:31.049077 25662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d40dbd48594f80985fa77016912dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.054255 25588 tablet_service.cc:1511] Processing CreateTablet for tablet 674e65cc442345b7923817b336a936a2 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:31.063987 25519 tablet_service.cc:1511] Processing CreateTablet for tablet 09cea5bbd30a461a9b4f7188780a0850 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:31.069723 25588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674e65cc442345b7923817b336a936a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.071020 25514 tablet_service.cc:1511] Processing CreateTablet for tablet 10caecec8c054b18a4a2bf178b001a54 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:31.069077 25520 tablet_service.cc:1511] Processing CreateTablet for tablet b9f352f1a60a40a0a09acfc8422b9736 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:31.081418 25519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cea5bbd30a461a9b4f7188780a0850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.084023 25518 tablet_service.cc:1511] Processing CreateTablet for tablet b36befdfc5fb49719a7da9da167ee404 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:31.086896 25513 tablet_service.cc:1511] Processing CreateTablet for tablet 79d40dbd48594f80985fa77016912dbd (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:31.087632 25518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36befdfc5fb49719a7da9da167ee404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.077962 25515 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb596975e484608a46c0fe9b20bb5fe (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:31.083318 25517 tablet_service.cc:1511] Processing CreateTablet for tablet f147bb3c4d3e4c499012718b59ec3863 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:31.093981 25517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f147bb3c4d3e4c499012718b59ec3863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.080366 25516 tablet_service.cc:1511] Processing CreateTablet for tablet 52433a05833644b9960a9e1b5bf8a286 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:31.093181 25661 tablet_service.cc:1511] Processing CreateTablet for tablet 674e65cc442345b7923817b336a936a2 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:31.085383 25512 tablet_service.cc:1511] Processing CreateTablet for tablet 674e65cc442345b7923817b336a936a2 (DEFAULT_TABLE table=test-workload [id=e2829d1913f74a80aac74e1a6edc28dd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:31.096210 25513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d40dbd48594f80985fa77016912dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.098503 25516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52433a05833644b9960a9e1b5bf8a286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.098766 25589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10caecec8c054b18a4a2bf178b001a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.103253 25668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09cea5bbd30a461a9b4f7188780a0850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.102542 25514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10caecec8c054b18a4a2bf178b001a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.113731 25669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f352f1a60a40a0a09acfc8422b9736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.130160 25512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674e65cc442345b7923817b336a936a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.131610 25666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f147bb3c4d3e4c499012718b59ec3863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.133533 25515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb596975e484608a46c0fe9b20bb5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.133725 25663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10caecec8c054b18a4a2bf178b001a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.143008 25665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52433a05833644b9960a9e1b5bf8a286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.143110 25722 tablet_bootstrap.cc:492] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5: Bootstrap starting.
I20260709 13:08:31.151844 25520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f352f1a60a40a0a09acfc8422b9736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.153640 25661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674e65cc442345b7923817b336a936a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.167410 25664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb596975e484608a46c0fe9b20bb5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:31.194795 25722 tablet_bootstrap.cc:654] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.350656 25724 tablet_bootstrap.cc:492] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7: Bootstrap starting.
I20260709 13:08:31.367106 25722 tablet_bootstrap.cc:492] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5: No bootstrap required, opened a new log
I20260709 13:08:31.371527 25722 ts_tablet_manager.cc:1403] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5: Time spent bootstrapping tablet: real 0.239s	user 0.072s	sys 0.049s
I20260709 13:08:31.376334 25722 raft_consensus.cc:359] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.384702 25722 raft_consensus.cc:385] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.385406 25722 raft_consensus.cc:740] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.388506 25725 tablet_bootstrap.cc:492] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4: Bootstrap starting.
I20260709 13:08:31.386756 25722 consensus_queue.cc:260] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.393647 25724 tablet_bootstrap.cc:654] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.405063 25630 heartbeater.cc:499] Master 127.24.204.254:36299 was elected leader, sending a full tablet report...
I20260709 13:08:31.405161 25722 ts_tablet_manager.cc:1434] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.008s
I20260709 13:08:31.407466 25722 tablet_bootstrap.cc:492] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5: Bootstrap starting.
I20260709 13:08:31.408339 25724 tablet_bootstrap.cc:492] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7: No bootstrap required, opened a new log
I20260709 13:08:31.408788 25724 ts_tablet_manager.cc:1403] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.003s
I20260709 13:08:31.412539 25725 tablet_bootstrap.cc:654] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.415854 25722 tablet_bootstrap.cc:654] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.419353 25555 heartbeater.cc:499] Master 127.24.204.254:36299 was elected leader, sending a full tablet report...
I20260709 13:08:31.425400 25725 tablet_bootstrap.cc:492] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4: No bootstrap required, opened a new log
I20260709 13:08:31.425978 25725 ts_tablet_manager.cc:1403] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.013s
I20260709 13:08:31.427639 25724 raft_consensus.cc:359] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.428483 25724 raft_consensus.cc:385] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.428817 25724 raft_consensus.cc:740] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.429080 25722 tablet_bootstrap.cc:492] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5: No bootstrap required, opened a new log
I20260709 13:08:31.429615 25722 ts_tablet_manager.cc:1403] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:08:31.429247 25725 raft_consensus.cc:359] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.430043 25725 raft_consensus.cc:385] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.429636 25724 consensus_queue.cc:260] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.430414 25725 raft_consensus.cc:740] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.432792 25722 raft_consensus.cc:359] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.434370 25722 raft_consensus.cc:385] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.434736 25722 raft_consensus.cc:740] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.435464 25722 consensus_queue.cc:260] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.437318 25722 ts_tablet_manager.cc:1434] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:08:31.438120 25722 tablet_bootstrap.cc:492] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5: Bootstrap starting.
I20260709 13:08:31.438472 25725 consensus_queue.cc:260] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.443090 25724 ts_tablet_manager.cc:1434] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:08:31.443054 25704 heartbeater.cc:499] Master 127.24.204.254:36299 was elected leader, sending a full tablet report...
I20260709 13:08:31.445294 25724 tablet_bootstrap.cc:492] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7: Bootstrap starting.
I20260709 13:08:31.447762 25722 tablet_bootstrap.cc:654] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.448932 25725 ts_tablet_manager.cc:1434] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:08:31.452222 25725 tablet_bootstrap.cc:492] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4: Bootstrap starting.
I20260709 13:08:31.460935 25722 tablet_bootstrap.cc:492] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5: No bootstrap required, opened a new log
I20260709 13:08:31.461483 25722 ts_tablet_manager.cc:1403] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.008s
I20260709 13:08:31.464627 25722 raft_consensus.cc:359] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.465469 25722 raft_consensus.cc:385] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.465809 25722 raft_consensus.cc:740] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.466614 25722 consensus_queue.cc:260] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.468978 25722 ts_tablet_manager.cc:1434] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:31.471314 25724 tablet_bootstrap.cc:654] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.476262 25722 tablet_bootstrap.cc:492] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5: Bootstrap starting.
I20260709 13:08:31.479161 25725 tablet_bootstrap.cc:654] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.483290 25722 tablet_bootstrap.cc:654] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:31.492158 25705 tablet.cc:2406] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:31.496240 25724 tablet_bootstrap.cc:492] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7: No bootstrap required, opened a new log
I20260709 13:08:31.497036 25724 ts_tablet_manager.cc:1403] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.010s
I20260709 13:08:31.500278 25725 tablet_bootstrap.cc:492] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4: No bootstrap required, opened a new log
I20260709 13:08:31.500859 25725 ts_tablet_manager.cc:1403] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.008s
I20260709 13:08:31.501368 25722 tablet_bootstrap.cc:492] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5: No bootstrap required, opened a new log
I20260709 13:08:31.501857 25722 ts_tablet_manager.cc:1403] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.012s
I20260709 13:08:31.503877 25724 raft_consensus.cc:359] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.504621 25724 raft_consensus.cc:385] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.504472 25725 raft_consensus.cc:359] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.505076 25724 raft_consensus.cc:740] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.505075 25722 raft_consensus.cc:359] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.505503 25725 raft_consensus.cc:385] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.505939 25722 raft_consensus.cc:385] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.506059 25725 raft_consensus.cc:740] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.506412 25722 raft_consensus.cc:740] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.506294 25724 consensus_queue.cc:260] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.507154 25725 consensus_queue.cc:260] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.507184 25722 consensus_queue.cc:260] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.509878 25722 ts_tablet_manager.cc:1434] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:31.510085 25725 ts_tablet_manager.cc:1434] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:08:31.510907 25722 tablet_bootstrap.cc:492] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5: Bootstrap starting.
I20260709 13:08:31.511042 25725 tablet_bootstrap.cc:492] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4: Bootstrap starting.
I20260709 13:08:31.516211 25730 raft_consensus.cc:493] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.516764 25730 raft_consensus.cc:515] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.518246 25725 tablet_bootstrap.cc:654] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.520331 25730 leader_election.cc:290] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:31.524364 25722 tablet_bootstrap.cc:654] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.526782 25731 raft_consensus.cc:493] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.527371 25731 raft_consensus.cc:515] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.531824 25731 leader_election.cc:290] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.536753 25724 ts_tablet_manager.cc:1434] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.004s
I20260709 13:08:31.536847 25722 tablet_bootstrap.cc:492] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5: No bootstrap required, opened a new log
I20260709 13:08:31.537617 25722 ts_tablet_manager.cc:1403] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.002s
I20260709 13:08:31.537878 25724 tablet_bootstrap.cc:492] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7: Bootstrap starting.
I20260709 13:08:31.543799 25722 raft_consensus.cc:359] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.544663 25722 raft_consensus.cc:385] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.545007 25722 raft_consensus.cc:740] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.545848 25722 consensus_queue.cc:260] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.552749 25724 tablet_bootstrap.cc:654] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.558607 25722 ts_tablet_manager.cc:1434] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:08:31.559021 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5" is_pre_election: true
I20260709 13:08:31.560616 25605 raft_consensus.cc:2468] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 0.
I20260709 13:08:31.566004 25722 tablet_bootstrap.cc:492] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5: Bootstrap starting.
I20260709 13:08:31.571784 25645 leader_election.cc:304] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:31.574019 25730 raft_consensus.cc:2804] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.574563 25730 raft_consensus.cc:493] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.575158 25730 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.577097 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
W20260709 13:08:31.580117 25642 leader_election.cc:343] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.580525 25725 tablet_bootstrap.cc:492] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4: No bootstrap required, opened a new log
I20260709 13:08:31.581000 25725 ts_tablet_manager.cc:1403] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.006s
I20260709 13:08:31.585332 25722 tablet_bootstrap.cc:654] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.584939 25725 raft_consensus.cc:359] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.595191 25726 raft_consensus.cc:493] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.595395 25725 raft_consensus.cc:385] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.595799 25726 raft_consensus.cc:515] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.596150 25725 raft_consensus.cc:740] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.599470 25726 leader_election.cc:290] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.603243 25725 consensus_queue.cc:260] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.606223 25726 raft_consensus.cc:493] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.606868 25726 raft_consensus.cc:515] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.609553 25726 leader_election.cc:290] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.614996 25725 ts_tablet_manager.cc:1434] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.004s
I20260709 13:08:31.623030 25724 tablet_bootstrap.cc:492] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7: No bootstrap required, opened a new log
I20260709 13:08:31.624787 25724 ts_tablet_manager.cc:1403] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.011s
I20260709 13:08:31.628234 25724 raft_consensus.cc:359] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.629010 25724 raft_consensus.cc:385] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.629304 25724 raft_consensus.cc:740] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.630426 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5" is_pre_election: true
I20260709 13:08:31.630980 25722 tablet_bootstrap.cc:492] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5: No bootstrap required, opened a new log
I20260709 13:08:31.622869 25730 raft_consensus.cc:515] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.630396 25724 consensus_queue.cc:260] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.632140 25722 ts_tablet_manager.cc:1403] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.019s
W20260709 13:08:31.633912 25496 leader_election.cc:343] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.635768 25725 tablet_bootstrap.cc:492] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4: Bootstrap starting.
I20260709 13:08:31.641494 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:31.646791 25730 leader_election.cc:290] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:31.639844 25722 raft_consensus.cc:359] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.649065 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:31.651260 25605 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:31.651376 25642 leader_election.cc:343] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.652565 25725 tablet_bootstrap.cc:654] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.655834 25722 raft_consensus.cc:385] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.656599 25722 raft_consensus.cc:740] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.658818 25722 consensus_queue.cc:260] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.661366 25722 ts_tablet_manager.cc:1434] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5: Time spent starting tablet: real 0.027s	user 0.001s	sys 0.005s
I20260709 13:08:31.666505 25722 tablet_bootstrap.cc:492] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5: Bootstrap starting.
I20260709 13:08:31.673859 25724 ts_tablet_manager.cc:1434] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.012s
I20260709 13:08:31.676017 25724 tablet_bootstrap.cc:492] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7: Bootstrap starting.
I20260709 13:08:31.691581 25722 tablet_bootstrap.cc:654] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.703009 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:31.704104 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
I20260709 13:08:31.705642 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
I20260709 13:08:31.707429 25725 tablet_bootstrap.cc:492] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4: No bootstrap required, opened a new log
I20260709 13:08:31.707914 25725 ts_tablet_manager.cc:1403] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.014s
W20260709 13:08:31.709033 25568 leader_election.cc:343] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:31.709223 25496 leader_election.cc:343] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.710084 25496 leader_election.cc:304] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5
W20260709 13:08:31.710029 25568 leader_election.cc:343] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.711599 25731 raft_consensus.cc:2749] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.703389 25605 raft_consensus.cc:2468] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 1.
I20260709 13:08:31.714564 25645 leader_election.cc:304] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:31.718659 25750 raft_consensus.cc:2804] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.720993 25750 raft_consensus.cc:697] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Becoming Leader. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:31.715057 25725 raft_consensus.cc:359] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.725023 25726 raft_consensus.cc:493] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.725354 25725 raft_consensus.cc:385] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.726002 25725 raft_consensus.cc:740] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.725906 25726 raft_consensus.cc:515] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.727653 25725 consensus_queue.cc:260] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.722615 25750 consensus_queue.cc:237] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.729715 25724 tablet_bootstrap.cc:654] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.735499 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:31.734416 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:31.737039 25726 leader_election.cc:290] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.739105 25725 ts_tablet_manager.cc:1434] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.005s
I20260709 13:08:31.741421 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10caecec8c054b18a4a2bf178b001a54" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:31.741863 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10caecec8c054b18a4a2bf178b001a54" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
I20260709 13:08:31.745409 25529 raft_consensus.cc:2468] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 0.
I20260709 13:08:31.747203 25568 leader_election.cc:304] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:31.747458 25725 tablet_bootstrap.cc:492] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4: Bootstrap starting.
I20260709 13:08:31.745754 25679 raft_consensus.cc:2468] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 0.
I20260709 13:08:31.748303 25726 raft_consensus.cc:2804] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.748752 25726 raft_consensus.cc:493] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.749086 25726 raft_consensus.cc:3060] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.754171 25731 raft_consensus.cc:493] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.757655 25731 raft_consensus.cc:515] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.761803 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d40dbd48594f80985fa77016912dbd" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5" is_pre_election: true
W20260709 13:08:31.763562 25571 leader_election.cc:343] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:31.766696 25496 leader_election.cc:343] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.769213 25571 leader_election.cc:304] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:31.749644 25678 raft_consensus.cc:2468] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 0.
I20260709 13:08:31.773929 25722 tablet_bootstrap.cc:492] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5: No bootstrap required, opened a new log
I20260709 13:08:31.774585 25722 ts_tablet_manager.cc:1403] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5: Time spent bootstrapping tablet: real 0.108s	user 0.025s	sys 0.040s
I20260709 13:08:31.776574 25571 leader_election.cc:304] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:31.776574 25753 raft_consensus.cc:2804] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.777447 25753 raft_consensus.cc:493] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.777397 25726 raft_consensus.cc:515] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.778110 25753 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.779772 25726 leader_election.cc:290] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.780318 25726 raft_consensus.cc:2804] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.780843 25726 raft_consensus.cc:493] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.780754 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10caecec8c054b18a4a2bf178b001a54" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:31.781836 25726 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.782033 25529 raft_consensus.cc:3060] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.790081 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d40dbd48594f80985fa77016912dbd" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:31.786911 25731 leader_election.cc:290] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
W20260709 13:08:31.794225 25496 leader_election.cc:343] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.794745 25496 leader_election.cc:304] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:31.798454 25725 tablet_bootstrap.cc:654] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.792253 25753 raft_consensus.cc:515] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.796394 25731 raft_consensus.cc:2749] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.809823 25529 raft_consensus.cc:2468] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 1.
I20260709 13:08:31.802945 25722 raft_consensus.cc:359] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.815944 25568 leader_election.cc:304] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:31.815974 25722 raft_consensus.cc:385] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.817472 25722 raft_consensus.cc:740] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.820248 25726 raft_consensus.cc:515] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.818233 25722 consensus_queue.cc:260] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
W20260709 13:08:31.824489 25571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:43835, user_credentials={real_user=slave}} blocked reactor thread for 47991us
I20260709 13:08:31.830868 25731 raft_consensus.cc:493] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.831444 25731 raft_consensus.cc:515] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.833158 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:31.833813 25530 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.830179 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10caecec8c054b18a4a2bf178b001a54" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:31.838312 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:31.829690 25754 raft_consensus.cc:2804] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.833686 25731 leader_election.cc:290] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.843098 25753 leader_election.cc:290] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.844561 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5" is_pre_election: true
I20260709 13:08:31.846287 25605 raft_consensus.cc:2393] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82bc0106fc9140d5a7cebd0e74679ad4 in current term 1: Already voted for candidate b0c6581491d341e09aea4bb7528025c5 in this term.
I20260709 13:08:31.848335 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:31.849010 25678 raft_consensus.cc:2468] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 0.
I20260709 13:08:31.850476 25726 leader_election.cc:290] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.851161 25725 tablet_bootstrap.cc:492] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4: No bootstrap required, opened a new log
I20260709 13:08:31.851679 25725 ts_tablet_manager.cc:1403] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.005s
I20260709 13:08:31.854022 25496 leader_election.cc:304] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4; no voters: b0c6581491d341e09aea4bb7528025c5
W20260709 13:08:31.850344 25568 leader_election.cc:343] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.858887 25725 raft_consensus.cc:359] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
W20260709 13:08:31.850080 25571 leader_election.cc:343] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.862711 25725 raft_consensus.cc:385] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.866696 25754 raft_consensus.cc:697] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:31.848352 25425 catalog_manager.cc:5697] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "4495e708d9054d6ca2691297176c5bd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.869446 25754 consensus_queue.cc:237] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.870748 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:31.871448 25678 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.872786 25530 raft_consensus.cc:2468] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 1.
I20260709 13:08:31.873929 25731 raft_consensus.cc:2764] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:08:31.874758 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:31.875404 25679 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.867177 25725 raft_consensus.cc:740] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.878135 25568 leader_election.cc:304] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:31.879405 25725 consensus_queue.cc:260] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.881852 25722 ts_tablet_manager.cc:1434] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5: Time spent starting tablet: real 0.107s	user 0.011s	sys 0.022s
I20260709 13:08:31.883311 25722 tablet_bootstrap.cc:492] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5: Bootstrap starting.
I20260709 13:08:31.884402 25678 raft_consensus.cc:2468] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 1.
I20260709 13:08:31.884797 25679 raft_consensus.cc:2468] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 1.
I20260709 13:08:31.902565 25722 tablet_bootstrap.cc:654] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.917484 25571 leader_election.cc:304] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:31.885154 25724 tablet_bootstrap.cc:492] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7: No bootstrap required, opened a new log
I20260709 13:08:31.918334 25726 raft_consensus.cc:493] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.886049 25759 raft_consensus.cc:2804] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.919171 25758 raft_consensus.cc:2804] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.920433 25759 raft_consensus.cc:697] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:31.921418 25759 consensus_queue.cc:237] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.921662 25726 raft_consensus.cc:515] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.925923 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
W20260709 13:08:31.928537 25568 leader_election.cc:343] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.928517 25758 raft_consensus.cc:697] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:31.929639 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
W20260709 13:08:31.930954 25571 leader_election.cc:343] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.931399 25571 leader_election.cc:304] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0c6581491d341e09aea4bb7528025c5; no voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:31.932282 25763 raft_consensus.cc:2749] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.933280 25763 raft_consensus.cc:493] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.933934 25763 raft_consensus.cc:515] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.936930 25763 leader_election.cc:290] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.938149 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674e65cc442345b7923817b336a936a2" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:31.939297 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674e65cc442345b7923817b336a936a2" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
W20260709 13:08:31.940655 25571 leader_election.cc:343] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:31.941699 25568 leader_election.cc:343] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.942090 25568 leader_election.cc:304] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0c6581491d341e09aea4bb7528025c5; no voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:31.940896 25426 catalog_manager.cc:5697] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.942830 25763 raft_consensus.cc:2749] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.930126 25758 consensus_queue.cc:237] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.925312 25726 leader_election.cc:290] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.949890 25724 ts_tablet_manager.cc:1403] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7: Time spent bootstrapping tablet: real 0.274s	user 0.008s	sys 0.024s
I20260709 13:08:31.954588 25725 ts_tablet_manager.cc:1434] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.001s
I20260709 13:08:31.956238 25725 tablet_bootstrap.cc:492] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4: Bootstrap starting.
I20260709 13:08:31.959528 25724 raft_consensus.cc:359] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.960671 25724 raft_consensus.cc:385] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.961117 25724 raft_consensus.cc:740] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.963950 25731 raft_consensus.cc:493] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.964610 25731 raft_consensus.cc:515] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.965438 25725 tablet_bootstrap.cc:654] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.968593 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5" is_pre_election: true
I20260709 13:08:31.968225 25722 tablet_bootstrap.cc:492] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5: No bootstrap required, opened a new log
I20260709 13:08:31.969630 25605 raft_consensus.cc:2393] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82bc0106fc9140d5a7cebd0e74679ad4 in current term 1: Already voted for candidate 4495e708d9054d6ca2691297176c5bd7 in this term.
I20260709 13:08:31.972293 25731 leader_election.cc:290] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:31.969630 25722 ts_tablet_manager.cc:1403] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.053s
I20260709 13:08:31.972988 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:31.974810 25496 leader_election.cc:304] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:31.975613 25731 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.962348 25724 consensus_queue.cc:260] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.979799 25724 ts_tablet_manager.cc:1434] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:08:31.980898 25724 tablet_bootstrap.cc:492] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7: Bootstrap starting.
I20260709 13:08:31.983323 25731 raft_consensus.cc:2749] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.984418 25722 raft_consensus.cc:359] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.985193 25722 raft_consensus.cc:385] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.985491 25722 raft_consensus.cc:740] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.986418 25722 consensus_queue.cc:260] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:31.989001 25722 ts_tablet_manager.cc:1434] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:08:31.990108 25722 tablet_bootstrap.cc:492] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5: Bootstrap starting.
I20260709 13:08:31.997411 25722 tablet_bootstrap.cc:654] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.000896 25724 tablet_bootstrap.cc:654] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.001840 25725 tablet_bootstrap.cc:492] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4: No bootstrap required, opened a new log
I20260709 13:08:32.002411 25725 ts_tablet_manager.cc:1403] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.012s
I20260709 13:08:32.007481 25758 raft_consensus.cc:493] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.008010 25758 raft_consensus.cc:515] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.012127 25758 leader_election.cc:290] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:32.015802 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:32.017908 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
I20260709 13:08:32.018553 25530 raft_consensus.cc:2468] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 0.
W20260709 13:08:32.020833 25571 leader_election.cc:343] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.022552 25568 leader_election.cc:304] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 4495e708d9054d6ca2691297176c5bd7
I20260709 13:08:32.009276 25725 raft_consensus.cc:359] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.023392 25758 raft_consensus.cc:2804] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.023756 25758 raft_consensus.cc:493] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.024456 25758 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.024017 25725 raft_consensus.cc:385] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.027258 25725 raft_consensus.cc:740] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.028653 25722 tablet_bootstrap.cc:492] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5: No bootstrap required, opened a new log
I20260709 13:08:32.032610 25722 ts_tablet_manager.cc:1403] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.012s
W20260709 13:08:32.032758 25475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:32.033391 25725 consensus_queue.cc:260] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.034662 25724 tablet_bootstrap.cc:492] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7: No bootstrap required, opened a new log
I20260709 13:08:32.035544 25724 ts_tablet_manager.cc:1403] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.004s
I20260709 13:08:32.032035 25758 raft_consensus.cc:515] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.040226 25758 leader_election.cc:290] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:32.040308 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:32.037457 25725 ts_tablet_manager.cc:1434] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:08:32.040933 25530 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.041092 25722 raft_consensus.cc:359] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.041802 25722 raft_consensus.cc:385] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.041812 25725 tablet_bootstrap.cc:492] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4: Bootstrap starting.
I20260709 13:08:32.040568 25724 raft_consensus.cc:359] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.046089 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:32.036089 25425 catalog_manager.cc:5697] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.042316 25722 raft_consensus.cc:740] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.047931 25530 raft_consensus.cc:2468] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 1.
W20260709 13:08:32.048879 25571 leader_election.cc:343] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.048543 25425 catalog_manager.cc:5697] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.049439 25568 leader_election.cc:304] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 4495e708d9054d6ca2691297176c5bd7
I20260709 13:08:32.049670 25722 consensus_queue.cc:260] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.046933 25724 raft_consensus.cc:385] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.051183 25724 raft_consensus.cc:740] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.052668 25722 ts_tablet_manager.cc:1434] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:08:32.053049 25758 raft_consensus.cc:2804] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.053352 25724 consensus_queue.cc:260] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.053850 25758 raft_consensus.cc:697] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:32.054832 25758 consensus_queue.cc:237] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.070722 25725 tablet_bootstrap.cc:654] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.056057 25724 ts_tablet_manager.cc:1434] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.005s
I20260709 13:08:32.086158 25724 tablet_bootstrap.cc:492] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7: Bootstrap starting.
I20260709 13:08:32.106746 25425 catalog_manager.cc:5697] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.109094 25724 tablet_bootstrap.cc:654] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.122395 25725 tablet_bootstrap.cc:492] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4: No bootstrap required, opened a new log
I20260709 13:08:32.122830 25724 tablet_bootstrap.cc:492] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7: No bootstrap required, opened a new log
I20260709 13:08:32.123023 25725 ts_tablet_manager.cc:1403] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.021s
I20260709 13:08:32.123328 25724 ts_tablet_manager.cc:1403] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.013s
I20260709 13:08:32.125604 25725 raft_consensus.cc:359] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.126235 25725 raft_consensus.cc:385] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.126693 25725 raft_consensus.cc:740] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.126204 25724 raft_consensus.cc:359] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.127225 25724 raft_consensus.cc:385] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.127566 25724 raft_consensus.cc:740] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.127549 25725 consensus_queue.cc:260] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.130223 25725 ts_tablet_manager.cc:1434] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:32.128496 25724 consensus_queue.cc:260] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.133298 25724 ts_tablet_manager.cc:1434] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:32.131089 25725 tablet_bootstrap.cc:492] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4: Bootstrap starting.
I20260709 13:08:32.134279 25724 tablet_bootstrap.cc:492] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7: Bootstrap starting.
I20260709 13:08:32.143366 25725 tablet_bootstrap.cc:654] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.147935 25724 tablet_bootstrap.cc:654] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.148731 25725 tablet_bootstrap.cc:492] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4: No bootstrap required, opened a new log
I20260709 13:08:32.149264 25725 ts_tablet_manager.cc:1403] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 13:08:32.151471 25725 raft_consensus.cc:359] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.152092 25725 raft_consensus.cc:385] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.152330 25725 raft_consensus.cc:740] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.152973 25725 consensus_queue.cc:260] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.154695 25725 ts_tablet_manager.cc:1434] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:08:32.155766 25725 tablet_bootstrap.cc:492] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4: Bootstrap starting.
I20260709 13:08:32.153437 25724 tablet_bootstrap.cc:492] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7: No bootstrap required, opened a new log
I20260709 13:08:32.157075 25724 ts_tablet_manager.cc:1403] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 13:08:32.159953 25724 raft_consensus.cc:359] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.160631 25724 raft_consensus.cc:385] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.160921 25724 raft_consensus.cc:740] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.161417 25725 tablet_bootstrap.cc:654] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.161638 25724 consensus_queue.cc:260] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.162783 25730 raft_consensus.cc:493] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.163214 25730 raft_consensus.cc:515] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.164180 25724 ts_tablet_manager.cc:1434] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:08:32.165093 25724 tablet_bootstrap.cc:492] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7: Bootstrap starting.
I20260709 13:08:32.165213 25730 leader_election.cc:290] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:32.166342 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d40dbd48594f80985fa77016912dbd" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
I20260709 13:08:32.166955 25530 raft_consensus.cc:2468] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 0.
I20260709 13:08:32.167529 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d40dbd48594f80985fa77016912dbd" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5" is_pre_election: true
I20260709 13:08:32.168105 25605 raft_consensus.cc:2468] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 0.
I20260709 13:08:32.168504 25642 leader_election.cc:304] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 
I20260709 13:08:32.169533 25730 raft_consensus.cc:2804] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.170024 25730 raft_consensus.cc:493] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.170377 25730 raft_consensus.cc:3060] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.176317 25724 tablet_bootstrap.cc:654] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.177068 25730 raft_consensus.cc:515] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.180274 25730 leader_election.cc:290] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:32.180490 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d40dbd48594f80985fa77016912dbd" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:32.181103 25605 raft_consensus.cc:3060] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.182396 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d40dbd48594f80985fa77016912dbd" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:32.183172 25530 raft_consensus.cc:3060] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.188314 25725 tablet_bootstrap.cc:492] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4: No bootstrap required, opened a new log
I20260709 13:08:32.188771 25725 ts_tablet_manager.cc:1403] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.003s
I20260709 13:08:32.189289 25605 raft_consensus.cc:2468] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 1.
I20260709 13:08:32.190578 25645 leader_election.cc:304] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:32.191856 25730 raft_consensus.cc:2804] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.192335 25730 raft_consensus.cc:697] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Becoming Leader. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:32.193136 25730 consensus_queue.cc:237] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.194546 25530 raft_consensus.cc:2468] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 1.
I20260709 13:08:32.198801 25725 raft_consensus.cc:359] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.199497 25725 raft_consensus.cc:385] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.199765 25725 raft_consensus.cc:740] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.200409 25725 consensus_queue.cc:260] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.202507 25725 ts_tablet_manager.cc:1434] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:08:32.205439 25724 tablet_bootstrap.cc:492] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7: No bootstrap required, opened a new log
I20260709 13:08:32.205924 25724 ts_tablet_manager.cc:1403] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.003s
I20260709 13:08:32.208377 25724 raft_consensus.cc:359] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.209017 25724 raft_consensus.cc:385] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.209270 25724 raft_consensus.cc:740] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.209867 25758 raft_consensus.cc:493] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.210307 25758 raft_consensus.cc:515] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.210530 25425 catalog_manager.cc:5697] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "4495e708d9054d6ca2691297176c5bd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.212350 25758 leader_election.cc:290] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:32.215219 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:32.215865 25678 raft_consensus.cc:2468] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 0.
I20260709 13:08:32.216812 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
I20260709 13:08:32.217049 25571 leader_election.cc:304] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:32.217419 25530 raft_consensus.cc:2468] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 0.
I20260709 13:08:32.219022 25758 raft_consensus.cc:2804] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.219527 25758 raft_consensus.cc:493] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.219987 25758 raft_consensus.cc:3060] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.221812 25724 consensus_queue.cc:260] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.223888 25724 ts_tablet_manager.cc:1434] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:08:32.224787 25724 tablet_bootstrap.cc:492] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7: Bootstrap starting.
I20260709 13:08:32.227499 25758 raft_consensus.cc:515] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.230317 25724 tablet_bootstrap.cc:654] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.230360 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:32.231052 25530 raft_consensus.cc:3060] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.233398 25730 raft_consensus.cc:493] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.234077 25730 raft_consensus.cc:515] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.236819 25730 leader_election.cc:290] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:32.238336 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674e65cc442345b7923817b336a936a2" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5" is_pre_election: true
I20260709 13:08:32.238961 25605 raft_consensus.cc:2468] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 0.
I20260709 13:08:32.239933 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674e65cc442345b7923817b336a936a2" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
I20260709 13:08:32.240130 25645 leader_election.cc:304] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:32.240551 25529 raft_consensus.cc:2468] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 0.
I20260709 13:08:32.242163 25730 raft_consensus.cc:2804] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.242755 25730 raft_consensus.cc:493] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.243692 25730 raft_consensus.cc:3060] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.243727 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:32.242205 25530 raft_consensus.cc:2468] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 1.
I20260709 13:08:32.244575 25678 raft_consensus.cc:3060] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.245491 25568 leader_election.cc:304] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:32.246498 25758 leader_election.cc:290] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 1 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:32.247001 25758 raft_consensus.cc:2804] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.248160 25758 raft_consensus.cc:697] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:32.248945 25758 consensus_queue.cc:237] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.253213 25678 raft_consensus.cc:2468] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 1.
I20260709 13:08:32.256096 25724 tablet_bootstrap.cc:492] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7: No bootstrap required, opened a new log
I20260709 13:08:32.256551 25724 ts_tablet_manager.cc:1403] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.009s
I20260709 13:08:32.258946 25730 raft_consensus.cc:515] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.259212 25724 raft_consensus.cc:359] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.259913 25724 raft_consensus.cc:385] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.260223 25724 raft_consensus.cc:740] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.262157 25730 leader_election.cc:290] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:32.262091 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674e65cc442345b7923817b336a936a2" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:32.262356 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674e65cc442345b7923817b336a936a2" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:32.262758 25530 raft_consensus.cc:3060] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.262952 25605 raft_consensus.cc:3060] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.266125 25724 consensus_queue.cc:260] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.270671 25724 ts_tablet_manager.cc:1434] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:08:32.271342 25605 raft_consensus.cc:2468] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 1.
I20260709 13:08:32.272475 25645 leader_election.cc:304] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:32.273237 25730 raft_consensus.cc:2804] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.273754 25730 raft_consensus.cc:697] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Becoming Leader. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:32.274608 25730 consensus_queue.cc:237] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.276182 25427 catalog_manager.cc:5697] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.273772 25530 raft_consensus.cc:2468] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 1.
I20260709 13:08:32.286883 25425 catalog_manager.cc:5697] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "4495e708d9054d6ca2691297176c5bd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.291494 25678 raft_consensus.cc:3060] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.299156 25758 consensus_queue.cc:1048] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:32.303673 25750 consensus_queue.cc:1048] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.307341 25750 raft_consensus.cc:493] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.307751 25750 raft_consensus.cc:515] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.310050 25750 leader_election.cc:290] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:32.311971 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5" is_pre_election: true
I20260709 13:08:32.312608 25605 raft_consensus.cc:2468] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 0.
I20260709 13:08:32.313911 25645 leader_election.cc:304] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:32.314725 25730 raft_consensus.cc:2804] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.315083 25730 raft_consensus.cc:493] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.315842 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
I20260709 13:08:32.316473 25530 raft_consensus.cc:2468] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 0.
I20260709 13:08:32.318434 25730 raft_consensus.cc:3060] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.330078 25754 consensus_queue.cc:1048] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:32.331463 25730 raft_consensus.cc:515] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.334354 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:32.334959 25529 raft_consensus.cc:3060] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.342401 25529 raft_consensus.cc:2468] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 1.
I20260709 13:08:32.343026 25731 raft_consensus.cc:493] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.343670 25642 leader_election.cc:304] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 
I20260709 13:08:32.343674 25731 raft_consensus.cc:515] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.347458 25731 leader_election.cc:290] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:32.356443 25750 raft_consensus.cc:2804] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.357048 25750 raft_consensus.cc:697] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Becoming Leader. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:32.357978 25750 consensus_queue.cc:237] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.360236 25730 leader_election.cc:290] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:32.360185 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:32.360931 25605 raft_consensus.cc:3060] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.370265 25605 raft_consensus.cc:2468] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 1.
I20260709 13:08:32.377028 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4495e708d9054d6ca2691297176c5bd7" is_pre_election: true
I20260709 13:08:32.377928 25679 raft_consensus.cc:2393] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82bc0106fc9140d5a7cebd0e74679ad4 in current term 1: Already voted for candidate b0c6581491d341e09aea4bb7528025c5 in this term.
I20260709 13:08:32.377801 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5" is_pre_election: true
I20260709 13:08:32.386216 25496 leader_election.cc:304] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:32.390100 25791 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.394452 25426 catalog_manager.cc:5697] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "4495e708d9054d6ca2691297176c5bd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.400738 25791 raft_consensus.cc:2749] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:32.402844 25730 consensus_queue.cc:1048] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.433200 25758 consensus_queue.cc:1048] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.434124 25730 raft_consensus.cc:493] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.434638 25730 raft_consensus.cc:515] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.437824 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0c6581491d341e09aea4bb7528025c5" is_pre_election: true
I20260709 13:08:32.438052 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" is_pre_election: true
I20260709 13:08:32.439103 25529 raft_consensus.cc:2393] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4495e708d9054d6ca2691297176c5bd7 in current term 1: Already voted for candidate b0c6581491d341e09aea4bb7528025c5 in this term.
I20260709 13:08:32.439469 25730 leader_election.cc:290] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:32.441002 25642 leader_election.cc:304] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7; no voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:32.442158 25730 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.453715 25754 consensus_queue.cc:1048] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:32.466445 25730 raft_consensus.cc:2749] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:32.502033 25754 consensus_queue.cc:1048] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.514353 25759 consensus_queue.cc:1048] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.590601 25605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
mode: GRACEFUL
new_leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:40502
I20260709 13:08:32.591409 25605 raft_consensus.cc:606] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Received request to transfer leadership to TS 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:32.608057 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850"
dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
mode: GRACEFUL
new_leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:58280
I20260709 13:08:32.608799 25678 raft_consensus.cc:606] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Received request to transfer leadership to TS 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:32.614735 25605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
mode: GRACEFUL
new_leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:40502
I20260709 13:08:32.615383 25605 raft_consensus.cc:606] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Received request to transfer leadership to TS 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:32.617794 25759 consensus_queue.cc:1048] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.621326 25605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
mode: GRACEFUL
new_leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:40502
I20260709 13:08:32.622046 25605 raft_consensus.cc:606] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Received request to transfer leadership to TS 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:32.632802 25754 consensus_queue.cc:1048] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:32.648022 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe"
dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
mode: GRACEFUL
new_leader_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:58280
I20260709 13:08:32.648669 25678 raft_consensus.cc:606] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Received request to transfer leadership to TS b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:32.654040 25730 consensus_queue.cc:1048] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:32.661887 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d40dbd48594f80985fa77016912dbd"
dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
mode: GRACEFUL
new_leader_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:58280
I20260709 13:08:32.662540 25678 raft_consensus.cc:606] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Received request to transfer leadership to TS b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:32.670112 25750 consensus_queue.cc:1048] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.677728 25758 consensus_queue.cc:1048] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:32.685092 25758 consensus_queue.cc:1048] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.703408 25730 raft_consensus.cc:993] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7: : Instructing follower b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:32.703871 25730 raft_consensus.cc:1081] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Signalling peer b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:32.705900 25754 raft_consensus.cc:993] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5: : Instructing follower 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:32.706472 25754 raft_consensus.cc:1081] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Signalling peer 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:32.705753 25605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79d40dbd48594f80985fa77016912dbd"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:40484
I20260709 13:08:32.707582 25605 raft_consensus.cc:493] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:32.707960 25605 raft_consensus.cc:3060] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.711921 25529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:08:32.712576 25529 raft_consensus.cc:493] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:32.712965 25529 raft_consensus.cc:3060] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.717037 25605 raft_consensus.cc:515] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.719254 25605 leader_election.cc:290] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 2 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:32.720335 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d40dbd48594f80985fa77016912dbd" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:32.720625 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d40dbd48594f80985fa77016912dbd" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:32.720928 25530 raft_consensus.cc:3060] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.721146 25678 raft_consensus.cc:3055] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.721468 25678 raft_consensus.cc:740] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:32.722237 25529 raft_consensus.cc:515] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.722329 25678 consensus_queue.cc:260] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.723886 25678 raft_consensus.cc:3060] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.725145 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:32.725749 25605 raft_consensus.cc:3055] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.726085 25605 raft_consensus.cc:740] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:32.726990 25605 consensus_queue.cc:260] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.728048 25605 raft_consensus.cc:3060] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.734422 25530 raft_consensus.cc:2468] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 2.
I20260709 13:08:32.735857 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:32.738615 25679 raft_consensus.cc:3060] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.736340 25529 leader_election.cc:290] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 2 election: Requested vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:32.736830 25678 raft_consensus.cc:2468] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 2.
I20260709 13:08:32.743108 25571 leader_election.cc:304] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:32.744474 25759 raft_consensus.cc:2804] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.745313 25679 raft_consensus.cc:2468] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 2.
I20260709 13:08:32.745280 25759 raft_consensus.cc:697] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 2 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:32.747005 25496 leader_election.cc:304] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 
I20260709 13:08:32.737993 25605 raft_consensus.cc:2468] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 2.
I20260709 13:08:32.748769 25791 raft_consensus.cc:2804] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.749810 25791 raft_consensus.cc:697] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Becoming Leader. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:32.751044 25791 consensus_queue.cc:237] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.750947 25759 consensus_queue.cc:237] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.760869 25426 catalog_manager.cc:5697] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 reported cstate change: term changed from 1 to 2, leader changed from b0c6581491d341e09aea4bb7528025c5 (127.24.204.194) to 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.762980 25750 consensus_queue.cc:1048] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.768487 25425 catalog_manager.cc:5697] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 1 to 2, leader changed from 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195) to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.784068 25792 consensus_queue.cc:1048] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:32.830775 25792 consensus_queue.cc:1048] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.839305 25730 raft_consensus.cc:993] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7: : Instructing follower b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:32.839828 25750 raft_consensus.cc:1081] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Signalling peer b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:32.843050 25604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:40484
I20260709 13:08:32.847067 25604 raft_consensus.cc:493] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:32.847422 25604 raft_consensus.cc:3060] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.849347 25792 consensus_queue.cc:1048] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.861845 25604 raft_consensus.cc:515] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.865994 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:32.867348 25530 raft_consensus.cc:3060] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.868355 25604 leader_election.cc:290] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 2 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:32.870680 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:32.871908 25678 raft_consensus.cc:3055] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.872591 25678 raft_consensus.cc:740] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:32.873656 25678 consensus_queue.cc:260] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.875005 25678 raft_consensus.cc:3060] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.878445 25530 raft_consensus.cc:2468] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 2.
I20260709 13:08:32.882514 25568 leader_election.cc:304] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:32.883852 25759 raft_consensus.cc:2804] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.884443 25759 raft_consensus.cc:697] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 2 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:32.885610 25678 raft_consensus.cc:2468] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 2.
I20260709 13:08:32.885460 25759 consensus_queue.cc:237] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.893514 25425 catalog_manager.cc:5697] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 1 to 2, leader changed from 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195) to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.966377 25730 raft_consensus.cc:993] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7: : Instructing follower 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:32.966879 25730 raft_consensus.cc:1081] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Signalling peer 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:32.968806 25530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:50598
I20260709 13:08:32.969333 25530 raft_consensus.cc:493] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:32.969727 25530 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.974848 25530 raft_consensus.cc:515] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.976701 25530 leader_election.cc:290] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 2 election: Requested vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:32.977788 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:32.978011 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:32.978547 25604 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.978646 25678 raft_consensus.cc:3055] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.979053 25678 raft_consensus.cc:740] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:32.979876 25678 consensus_queue.cc:260] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.981236 25678 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.983824 25604 raft_consensus.cc:2468] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 2.
I20260709 13:08:32.985039 25496 leader_election.cc:304] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:32.985846 25791 raft_consensus.cc:2804] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.986317 25791 raft_consensus.cc:697] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Becoming Leader. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:32.987090 25791 consensus_queue.cc:237] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:32.988416 25678 raft_consensus.cc:2468] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 2.
I20260709 13:08:32.996320 25425 catalog_manager.cc:5697] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 reported cstate change: term changed from 1 to 2, leader changed from 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195) to 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:33.003058 25754 raft_consensus.cc:993] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5: : Instructing follower 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:33.003522 25754 raft_consensus.cc:1081] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Signalling peer 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:33.005280 25530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:08:33.005808 25530 raft_consensus.cc:493] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:33.006233 25530 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.010835 25530 raft_consensus.cc:515] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:33.012666 25530 leader_election.cc:290] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 2 election: Requested vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:33.013761 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:33.013955 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:33.014354 25604 raft_consensus.cc:3055] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.014602 25678 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.014734 25604 raft_consensus.cc:740] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:33.015702 25604 consensus_queue.cc:260] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:33.016690 25604 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.021176 25604 raft_consensus.cc:2468] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 2.
I20260709 13:08:33.022202 25678 raft_consensus.cc:2468] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 2.
I20260709 13:08:33.022238 25496 leader_election.cc:304] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:33.023257 25791 raft_consensus.cc:2804] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:33.023758 25791 raft_consensus.cc:697] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Becoming Leader. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:33.024535 25791 consensus_queue.cc:237] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:33.031876 25425 catalog_manager.cc:5697] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 reported cstate change: term changed from 1 to 2, leader changed from b0c6581491d341e09aea4bb7528025c5 (127.24.204.194) to 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:33.072948 25759 raft_consensus.cc:993] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5: : Instructing follower 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:33.073468 25759 raft_consensus.cc:1081] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Signalling peer 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:33.075223 25530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:08:33.075824 25530 raft_consensus.cc:493] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:33.076217 25530 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.080792 25530 raft_consensus.cc:515] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:33.082418 25530 leader_election.cc:290] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 2 election: Requested vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:33.083351 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:33.083719 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:33.083974 25604 raft_consensus.cc:3055] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.084318 25604 raft_consensus.cc:740] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:33.084350 25678 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.085080 25604 consensus_queue.cc:260] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:33.086019 25604 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.090572 25604 raft_consensus.cc:2468] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 2.
I20260709 13:08:33.091571 25496 leader_election.cc:304] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:33.091595 25678 raft_consensus.cc:2468] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 2.
I20260709 13:08:33.092420 25791 raft_consensus.cc:2804] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:33.092931 25791 raft_consensus.cc:697] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Becoming Leader. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:33.093766 25791 consensus_queue.cc:237] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:33.101858 25425 catalog_manager.cc:5697] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 reported cstate change: term changed from 1 to 2, leader changed from b0c6581491d341e09aea4bb7528025c5 (127.24.204.194) to 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:33.134661 25604 raft_consensus.cc:1275] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.135998 25791 consensus_queue.cc:1048] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.146620 25678 raft_consensus.cc:1275] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.148489 25813 consensus_queue.cc:1048] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.257740 25530 raft_consensus.cc:1275] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.259274 25759 consensus_queue.cc:1048] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.268713 25678 raft_consensus.cc:1275] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.270496 25726 consensus_queue.cc:1048] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.282630 25678 raft_consensus.cc:1275] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.284718 25726 consensus_queue.cc:1048] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.294494 25530 raft_consensus.cc:1275] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.295912 25754 consensus_queue.cc:1048] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.435741 25678 raft_consensus.cc:1275] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.437036 25813 consensus_queue.cc:1048] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.444620 25604 raft_consensus.cc:1275] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.446504 25813 consensus_queue.cc:1048] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.487253 25678 raft_consensus.cc:1275] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.488905 25813 consensus_queue.cc:1048] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.498083 25604 raft_consensus.cc:1275] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.499770 25731 consensus_queue.cc:1048] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.564278 25604 raft_consensus.cc:1275] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.565580 25731 consensus_queue.cc:1048] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.575604 25678 raft_consensus.cc:1275] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.577304 25818 consensus_queue.cc:1048] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:35.702152 25395 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:08:35.703040 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:35.727023 25529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
mode: GRACEFUL
new_leader_uuid: "4495e708d9054d6ca2691297176c5bd7"
 from {username='slave'} at 127.0.0.1:50612
I20260709 13:08:35.727707 25529 raft_consensus.cc:606] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Received request to transfer leadership to TS 4495e708d9054d6ca2691297176c5bd7
I20260709 13:08:35.740294 25605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
mode: GRACEFUL
new_leader_uuid: "4495e708d9054d6ca2691297176c5bd7"
 from {username='slave'} at 127.0.0.1:40506
I20260709 13:08:35.741016 25605 raft_consensus.cc:606] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Received request to transfer leadership to TS 4495e708d9054d6ca2691297176c5bd7
I20260709 13:08:35.742238 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:35.742837 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:35.855921 25818 raft_consensus.cc:993] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4: : Instructing follower 4495e708d9054d6ca2691297176c5bd7 to start an election
I20260709 13:08:35.856374 25825 raft_consensus.cc:1081] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Signalling peer 4495e708d9054d6ca2691297176c5bd7 to start an election
I20260709 13:08:35.858031 25678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850"
dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
 from {username='slave'} at 127.0.0.1:58270
I20260709 13:08:35.858604 25678 raft_consensus.cc:493] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:35.858922 25678 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.863636 25678 raft_consensus.cc:515] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:35.865151 25678 leader_election.cc:290] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 3 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:35.866251 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:35.866462 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:35.866832 25529 raft_consensus.cc:3055] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:35.867046 25605 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.867228 25529 raft_consensus.cc:740] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:35.868039 25529 consensus_queue.cc:260] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:35.869045 25529 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.872548 25605 raft_consensus.cc:2468] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 3.
I20260709 13:08:35.873853 25645 leader_election.cc:304] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:35.874328 25529 raft_consensus.cc:2468] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 3.
I20260709 13:08:35.874614 25792 raft_consensus.cc:2804] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:35.876112 25792 raft_consensus.cc:697] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 3 LEADER]: Becoming Leader. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:35.876969 25792 consensus_queue.cc:237] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:35.886051 25426 catalog_manager.cc:5697] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 reported cstate change: term changed from 2 to 3, leader changed from 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193) to 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "4495e708d9054d6ca2691297176c5bd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:36.060164 25832 raft_consensus.cc:993] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5: : Instructing follower 4495e708d9054d6ca2691297176c5bd7 to start an election
I20260709 13:08:36.060599 25754 raft_consensus.cc:1081] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Signalling peer 4495e708d9054d6ca2691297176c5bd7 to start an election
I20260709 13:08:36.062393 25678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286"
dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
 from {username='slave'} at 127.0.0.1:58276
I20260709 13:08:36.062913 25678 raft_consensus.cc:493] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.063254 25678 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.068497 25678 raft_consensus.cc:515] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:36.069991 25678 leader_election.cc:290] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:36.071030 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:36.070988 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:36.071856 25605 raft_consensus.cc:3055] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.071995 25529 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.072216 25605 raft_consensus.cc:740] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:36.073081 25605 consensus_queue.cc:260] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:36.074259 25605 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.077431 25529 raft_consensus.cc:2468] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 2.
I20260709 13:08:36.078611 25642 leader_election.cc:304] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 
I20260709 13:08:36.079365 25792 raft_consensus.cc:2804] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.079835 25792 raft_consensus.cc:697] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:36.080631 25792 consensus_queue.cc:237] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:36.081593 25605 raft_consensus.cc:2468] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 2.
I20260709 13:08:36.088127 25426 catalog_manager.cc:5697] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 reported cstate change: term changed from 1 to 2, leader changed from b0c6581491d341e09aea4bb7528025c5 (127.24.204.194) to 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "4495e708d9054d6ca2691297176c5bd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:36.290369 25605 raft_consensus.cc:1275] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Refusing update from remote peer 4495e708d9054d6ca2691297176c5bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:36.291667 25792 consensus_queue.cc:1048] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.302021 25529 raft_consensus.cc:1275] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Refusing update from remote peer 4495e708d9054d6ca2691297176c5bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:36.303813 25836 consensus_queue.cc:1048] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:36.557078 25605 raft_consensus.cc:1275] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Refusing update from remote peer 4495e708d9054d6ca2691297176c5bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.558530 25836 consensus_queue.cc:1048] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.569032 25529 raft_consensus.cc:1275] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Refusing update from remote peer 4495e708d9054d6ca2691297176c5bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.570631 25836 consensus_queue.cc:1048] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.743655 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:36.765339 25529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
mode: GRACEFUL
new_leader_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:50620
I20260709 13:08:36.766086 25529 raft_consensus.cc:606] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Received request to transfer leadership to TS b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:36.771694 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850"
dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
mode: GRACEFUL
new_leader_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:58280
I20260709 13:08:36.772138 25678 raft_consensus.cc:606] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 3 LEADER]: Received request to transfer leadership to TS b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:36.777846 25529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
mode: GRACEFUL
new_leader_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:50620
I20260709 13:08:36.778683 25529 raft_consensus.cc:606] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Received request to transfer leadership to TS b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:36.784991 25529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
mode: GRACEFUL
new_leader_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:50620
I20260709 13:08:36.785729 25529 raft_consensus.cc:606] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Received request to transfer leadership to TS b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:36.790684 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286"
dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
mode: GRACEFUL
new_leader_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:58280
I20260709 13:08:36.791160 25678 raft_consensus.cc:606] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 2 LEADER]: Received request to transfer leadership to TS b0c6581491d341e09aea4bb7528025c5
I20260709 13:08:36.829586 25825 raft_consensus.cc:993] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4: : Instructing follower b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:36.830049 25845 raft_consensus.cc:1081] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Signalling peer b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:36.831476 25605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:40498
I20260709 13:08:36.831965 25605 raft_consensus.cc:493] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.832228 25605 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.836838 25605 raft_consensus.cc:515] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:36.838416 25605 leader_election.cc:290] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 3 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:36.839494 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:36.839934 25678 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.840453 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:36.840981 25529 raft_consensus.cc:3055] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:36.841284 25529 raft_consensus.cc:740] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:36.841987 25529 consensus_queue.cc:260] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:36.842963 25529 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.844323 25678 raft_consensus.cc:2468] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 3.
I20260709 13:08:36.844950 25679 raft_consensus.cc:1240] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Rejecting Update request from peer 82bc0106fc9140d5a7cebd0e74679ad4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:36.845468 25571 leader_election.cc:304] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:36.846405 25841 raft_consensus.cc:2804] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.847743 25841 raft_consensus.cc:697] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:36.848629 25841 consensus_queue.cc:237] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:36.849957 25529 raft_consensus.cc:2468] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 3.
I20260709 13:08:36.857012 25425 catalog_manager.cc:5697] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 2 to 3, leader changed from 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193) to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.962311 25826 raft_consensus.cc:993] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7: : Instructing follower b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:36.962728 25826 raft_consensus.cc:1081] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 2 LEADER]: Signalling peer b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:36.964174 25605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:40484
I20260709 13:08:36.964685 25605 raft_consensus.cc:493] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.964915 25605 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.968753 25605 raft_consensus.cc:515] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:36.970147 25605 leader_election.cc:290] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 3 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:36.971020 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:36.971297 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:36.971540 25529 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.971875 25679 raft_consensus.cc:3055] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:36.972165 25679 raft_consensus.cc:740] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:36.972911 25679 consensus_queue.cc:260] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:36.973852 25679 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.976095 25529 raft_consensus.cc:2468] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 3.
I20260709 13:08:36.977123 25568 leader_election.cc:304] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:36.977826 25841 raft_consensus.cc:2804] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.978217 25841 raft_consensus.cc:697] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:36.978405 25679 raft_consensus.cc:2468] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 3.
I20260709 13:08:36.978955 25841 consensus_queue.cc:237] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:36.984932 25425 catalog_manager.cc:5697] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 2 to 3, leader changed from 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195) to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.127528 25825 raft_consensus.cc:993] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4: : Instructing follower b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:37.127996 25825 raft_consensus.cc:1081] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Signalling peer b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:37.129485 25605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:40498
I20260709 13:08:37.130067 25605 raft_consensus.cc:493] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.130302 25605 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.134691 25605 raft_consensus.cc:515] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:37.136569 25605 leader_election.cc:290] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 3 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:37.137250 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:37.137624 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:37.137893 25529 raft_consensus.cc:3055] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:37.138159 25679 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.138242 25529 raft_consensus.cc:740] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:37.139467 25836 raft_consensus.cc:993] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7: : Instructing follower b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:37.139086 25529 consensus_queue.cc:260] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:37.139910 25826 raft_consensus.cc:1081] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 3 LEADER]: Signalling peer b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:37.140303 25529 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.141355 25605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:40484
I20260709 13:08:37.141927 25605 raft_consensus.cc:493] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.142277 25605 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.145069 25679 raft_consensus.cc:2468] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 3.
I20260709 13:08:37.146324 25571 leader_election.cc:304] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:37.147185 25841 raft_consensus.cc:2804] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:37.147171 25605 raft_consensus.cc:515] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:37.147157 25529 raft_consensus.cc:2468] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 3.
I20260709 13:08:37.148075 25841 raft_consensus.cc:697] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:37.148871 25841 consensus_queue.cc:237] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:37.149782 25605 leader_election.cc:290] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 4 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:37.150511 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:37.151279 25530 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.152779 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09cea5bbd30a461a9b4f7188780a0850" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:37.153601 25679 raft_consensus.cc:3055] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:37.154033 25679 raft_consensus.cc:740] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:37.155488 25679 consensus_queue.cc:260] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:37.157063 25530 raft_consensus.cc:2468] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 4.
I20260709 13:08:37.157352 25679 raft_consensus.cc:3060] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.158321 25568 leader_election.cc:304] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82bc0106fc9140d5a7cebd0e74679ad4, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:37.159390 25841 raft_consensus.cc:2804] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:37.159931 25841 raft_consensus.cc:697] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 4 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:37.162477 25425 catalog_manager.cc:5697] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 2 to 3, leader changed from 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193) to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.160825 25841 consensus_queue.cc:237] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:37.164436 25679 raft_consensus.cc:2468] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 4.
I20260709 13:08:37.175464 25425 catalog_manager.cc:5697] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 3 to 4, leader changed from 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195) to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 4 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.276582 25845 raft_consensus.cc:993] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4: : Instructing follower b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:37.277187 25825 raft_consensus.cc:1081] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Signalling peer b0c6581491d341e09aea4bb7528025c5 to start an election
I20260709 13:08:37.278656 25605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
 from {username='slave'} at 127.0.0.1:40498
I20260709 13:08:37.279058 25605 raft_consensus.cc:493] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.279279 25605 raft_consensus.cc:3060] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.283133 25605 raft_consensus.cc:515] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:37.284564 25605 leader_election.cc:290] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 3 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:37.285584 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:37.285692 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f147bb3c4d3e4c499012718b59ec3863" candidate_uuid: "b0c6581491d341e09aea4bb7528025c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:37.286299 25530 raft_consensus.cc:3055] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:37.286387 25679 raft_consensus.cc:3060] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.286729 25530 raft_consensus.cc:740] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:37.287536 25530 consensus_queue.cc:260] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:37.288750 25530 raft_consensus.cc:3060] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.293779 25679 raft_consensus.cc:2468] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 3.
I20260709 13:08:37.295239 25530 raft_consensus.cc:2468] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0c6581491d341e09aea4bb7528025c5 in term 3.
I20260709 13:08:37.295149 25571 leader_election.cc:304] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, b0c6581491d341e09aea4bb7528025c5; no voters: 
I20260709 13:08:37.296643 25841 raft_consensus.cc:2804] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:37.297151 25841 raft_consensus.cc:697] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Becoming Leader. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:37.297976 25841 consensus_queue.cc:237] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:37.304894 25425 catalog_manager.cc:5697] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 reported cstate change: term changed from 2 to 3, leader changed from 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193) to b0c6581491d341e09aea4bb7528025c5 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "b0c6581491d341e09aea4bb7528025c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.360610 25679 raft_consensus.cc:1275] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:37.361843 25841 consensus_queue.cc:1048] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.372519 25530 raft_consensus.cc:1275] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:37.374204 25754 consensus_queue.cc:1048] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.552983 25679 raft_consensus.cc:1275] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:37.554376 25754 consensus_queue.cc:1048] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.563429 25529 raft_consensus.cc:1275] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:37.564841 25857 consensus_queue.cc:1048] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.578411 25529 raft_consensus.cc:1275] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:37.579607 25857 consensus_queue.cc:1048] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:37.588452 25679 raft_consensus.cc:1275] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:37.591027 25857 consensus_queue.cc:1048] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:37.701375 25530 raft_consensus.cc:1275] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:37.702868 25859 consensus_queue.cc:1048] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.712303 25679 raft_consensus.cc:1275] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:37.713919 25841 consensus_queue.cc:1048] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.823422 25679 raft_consensus.cc:1275] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:37.824887 25841 consensus_queue.cc:1048] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.835614 25530 raft_consensus.cc:1275] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Refusing update from remote peer b0c6581491d341e09aea4bb7528025c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:37.837905 25841 consensus_queue.cc:1048] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:39.804952 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:39.816883 25605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10caecec8c054b18a4a2bf178b001a54"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
mode: GRACEFUL
new_leader_uuid: "4495e708d9054d6ca2691297176c5bd7"
 from {username='slave'} at 127.0.0.1:40506
I20260709 13:08:39.818009 25605 raft_consensus.cc:606] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Received request to transfer leadership to TS 4495e708d9054d6ca2691297176c5bd7
I20260709 13:08:39.821074 25605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
mode: GRACEFUL
new_leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:40506
I20260709 13:08:39.821473 25605 raft_consensus.cc:606] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Received request to transfer leadership to TS 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:39.824314 25605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
mode: GRACEFUL
new_leader_uuid: "4495e708d9054d6ca2691297176c5bd7"
 from {username='slave'} at 127.0.0.1:40506
I20260709 13:08:39.824775 25605 raft_consensus.cc:606] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 2 LEADER]: Received request to transfer leadership to TS 4495e708d9054d6ca2691297176c5bd7
I20260709 13:08:39.827675 25605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
mode: GRACEFUL
new_leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:40506
I20260709 13:08:39.828159 25605 raft_consensus.cc:606] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Received request to transfer leadership to TS 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:39.831135 25605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736"
dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
mode: GRACEFUL
new_leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:40506
I20260709 13:08:39.831528 25605 raft_consensus.cc:606] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Received request to transfer leadership to TS 82bc0106fc9140d5a7cebd0e74679ad4
I20260709 13:08:39.832545 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:39.833091 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:39.864003 25859 raft_consensus.cc:993] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5: : Instructing follower 4495e708d9054d6ca2691297176c5bd7 to start an election
I20260709 13:08:39.864480 25859 raft_consensus.cc:1081] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 2 LEADER]: Signalling peer 4495e708d9054d6ca2691297176c5bd7 to start an election
I20260709 13:08:39.866077 25679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe"
dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
 from {username='slave'} at 127.0.0.1:58276
I20260709 13:08:39.866603 25679 raft_consensus.cc:493] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:39.866942 25679 raft_consensus.cc:3060] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.872442 25679 raft_consensus.cc:515] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:39.874672 25679 leader_election.cc:290] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 3 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:39.875788 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:39.875666 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb596975e484608a46c0fe9b20bb5fe" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:39.876569 25530 raft_consensus.cc:3060] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.876621 25605 raft_consensus.cc:3055] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:39.876984 25605 raft_consensus.cc:740] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:39.877903 25605 consensus_queue.cc:260] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:39.879546 25605 raft_consensus.cc:3060] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.884361 25530 raft_consensus.cc:2468] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 3.
I20260709 13:08:39.885991 25642 leader_election.cc:304] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 
I20260709 13:08:39.886624 25605 raft_consensus.cc:2468] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 3.
I20260709 13:08:39.886876 25826 raft_consensus.cc:2804] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:39.888109 25826 raft_consensus.cc:697] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 3 LEADER]: Becoming Leader. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:39.889046 25826 consensus_queue.cc:237] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:39.896534 25425 catalog_manager.cc:5697] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 reported cstate change: term changed from 2 to 3, leader changed from b0c6581491d341e09aea4bb7528025c5 (127.24.204.194) to 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "4495e708d9054d6ca2691297176c5bd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.182809 25866 raft_consensus.cc:993] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5: : Instructing follower 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:40.183245 25859 raft_consensus.cc:1081] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Signalling peer 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:40.184856 25530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:08:40.185246 25530 raft_consensus.cc:493] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:40.185462 25530 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.189275 25530 raft_consensus.cc:515] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.190837 25530 leader_election.cc:290] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 4 election: Requested vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:40.191773 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:40.192234 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52433a05833644b9960a9e1b5bf8a286" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:40.192399 25605 raft_consensus.cc:3055] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:40.192760 25605 raft_consensus.cc:740] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:40.192811 25679 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.193933 25605 consensus_queue.cc:260] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.195078 25605 raft_consensus.cc:3060] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.199923 25679 raft_consensus.cc:2468] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 4.
I20260709 13:08:40.201495 25605 raft_consensus.cc:2468] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 4.
I20260709 13:08:40.201541 25496 leader_election.cc:304] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 
I20260709 13:08:40.203343 25873 raft_consensus.cc:2804] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:40.204588 25873 raft_consensus.cc:697] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 LEADER]: Becoming Leader. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:40.205312 25873 consensus_queue.cc:237] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.212687 25425 catalog_manager.cc:5697] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 reported cstate change: term changed from 3 to 4, leader changed from b0c6581491d341e09aea4bb7528025c5 (127.24.204.194) to 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193). New cstate: current_term: 4 leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.307931 25866 raft_consensus.cc:993] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5: : Instructing follower 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:40.308401 25866 raft_consensus.cc:1081] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Signalling peer 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:40.310160 25529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:08:40.310623 25529 raft_consensus.cc:493] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:40.310900 25529 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.315466 25529 raft_consensus.cc:515] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.316875 25529 leader_election.cc:290] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 4 election: Requested vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:40.317785 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:40.318231 25605 raft_consensus.cc:3055] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:40.318329 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f352f1a60a40a0a09acfc8422b9736" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:40.318554 25605 raft_consensus.cc:740] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:40.318955 25679 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.319329 25605 consensus_queue.cc:260] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.320168 25605 raft_consensus.cc:3060] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.323108 25679 raft_consensus.cc:2468] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 4.
I20260709 13:08:40.324080 25605 raft_consensus.cc:2468] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 4.
I20260709 13:08:40.324083 25496 leader_election.cc:304] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 
I20260709 13:08:40.324988 25873 raft_consensus.cc:2804] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:40.325372 25873 raft_consensus.cc:697] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 LEADER]: Becoming Leader. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:40.326105 25873 consensus_queue.cc:237] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.332494 25425 catalog_manager.cc:5697] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 reported cstate change: term changed from 3 to 4, leader changed from b0c6581491d341e09aea4bb7528025c5 (127.24.204.194) to 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193). New cstate: current_term: 4 leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.382472 25859 raft_consensus.cc:993] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5: : Instructing follower 4495e708d9054d6ca2691297176c5bd7 to start an election
I20260709 13:08:40.382946 25866 raft_consensus.cc:1081] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Signalling peer 4495e708d9054d6ca2691297176c5bd7 to start an election
I20260709 13:08:40.384357 25679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10caecec8c054b18a4a2bf178b001a54"
dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
 from {username='slave'} at 127.0.0.1:58276
I20260709 13:08:40.384899 25679 raft_consensus.cc:493] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:40.385207 25679 raft_consensus.cc:3060] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.388516 25859 raft_consensus.cc:993] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5: : Instructing follower 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:40.389089 25859 raft_consensus.cc:1081] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Signalling peer 82bc0106fc9140d5a7cebd0e74679ad4 to start an election
I20260709 13:08:40.391162 25679 raft_consensus.cc:515] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.391846 25530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404"
dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
 from {username='slave'} at 127.0.0.1:50606
I20260709 13:08:40.392520 25530 raft_consensus.cc:493] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:40.393078 25679 leader_election.cc:290] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585), b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957)
I20260709 13:08:40.392935 25530 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.393756 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10caecec8c054b18a4a2bf178b001a54" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82bc0106fc9140d5a7cebd0e74679ad4"
I20260709 13:08:40.394134 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10caecec8c054b18a4a2bf178b001a54" candidate_uuid: "4495e708d9054d6ca2691297176c5bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:40.394338 25529 raft_consensus.cc:3060] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.394641 25605 raft_consensus.cc:3055] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.394956 25605 raft_consensus.cc:740] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:40.395812 25605 consensus_queue.cc:260] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.397060 25605 raft_consensus.cc:3060] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.400470 25529 raft_consensus.cc:2468] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 2.
I20260709 13:08:40.401511 25642 leader_election.cc:304] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 
I20260709 13:08:40.402055 25528 raft_consensus.cc:1275] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Refusing update from remote peer 4495e708d9054d6ca2691297176c5bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:40.402293 25826 raft_consensus.cc:2804] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.403040 25530 raft_consensus.cc:515] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.407609 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b0c6581491d341e09aea4bb7528025c5"
I20260709 13:08:40.408349 25604 raft_consensus.cc:3055] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:40.408668 25604 raft_consensus.cc:740] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0c6581491d341e09aea4bb7528025c5, State: Running, Role: LEADER
I20260709 13:08:40.409590 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36befdfc5fb49719a7da9da167ee404" candidate_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4495e708d9054d6ca2691297176c5bd7"
I20260709 13:08:40.409698 25604 consensus_queue.cc:260] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.410270 25679 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.410670 25604 raft_consensus.cc:3060] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.410732 25878 consensus_queue.cc:1048] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:40.409726 25826 raft_consensus.cc:697] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 4495e708d9054d6ca2691297176c5bd7, State: Running, Role: LEADER
I20260709 13:08:40.413674 25826 consensus_queue.cc:237] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.417722 25530 leader_election.cc:290] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 4 election: Requested vote from peers b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957), 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195:43835)
I20260709 13:08:40.419929 25605 raft_consensus.cc:2468] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4495e708d9054d6ca2691297176c5bd7 in term 2.
I20260709 13:08:40.422521 25679 raft_consensus.cc:2468] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 4.
I20260709 13:08:40.423902 25496 leader_election.cc:304] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4495e708d9054d6ca2691297176c5bd7, 82bc0106fc9140d5a7cebd0e74679ad4; no voters: 
I20260709 13:08:40.424363 25604 raft_consensus.cc:2468] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82bc0106fc9140d5a7cebd0e74679ad4 in term 4.
I20260709 13:08:40.427450 25678 raft_consensus.cc:1240] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Rejecting Update request from peer b0c6581491d341e09aea4bb7528025c5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:40.429200 25425 catalog_manager.cc:5697] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 reported cstate change: term changed from 1 to 2, leader changed from b0c6581491d341e09aea4bb7528025c5 (127.24.204.194) to 4495e708d9054d6ca2691297176c5bd7 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "4495e708d9054d6ca2691297176c5bd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.431710 25873 raft_consensus.cc:2804] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:40.432179 25873 raft_consensus.cc:697] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 LEADER]: Becoming Leader. State: Replica: 82bc0106fc9140d5a7cebd0e74679ad4, State: Running, Role: LEADER
I20260709 13:08:40.433075 25873 consensus_queue.cc:237] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } }
I20260709 13:08:40.456019 25604 raft_consensus.cc:1275] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Refusing update from remote peer 4495e708d9054d6ca2691297176c5bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:40.457757 25878 consensus_queue.cc:1048] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.456800 25425 catalog_manager.cc:5697] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 reported cstate change: term changed from 3 to 4, leader changed from b0c6581491d341e09aea4bb7528025c5 (127.24.204.194) to 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193). New cstate: current_term: 4 leader_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82bc0106fc9140d5a7cebd0e74679ad4" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.610707 25604 raft_consensus.cc:1275] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:40.612128 25873 consensus_queue.cc:1048] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.622123 25679 raft_consensus.cc:1275] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:40.623632 25873 consensus_queue.cc:1048] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.743738 25679 raft_consensus.cc:1275] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:40.745810 25873 consensus_queue.cc:1048] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:40.757104 25604 raft_consensus.cc:1275] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:40.758857 25873 consensus_queue.cc:1048] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.826865 25679 raft_consensus.cc:1275] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:40.828172 25873 consensus_queue.cc:1048] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4495e708d9054d6ca2691297176c5bd7" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.833969 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:40.839416 25604 raft_consensus.cc:1275] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Refusing update from remote peer 82bc0106fc9140d5a7cebd0e74679ad4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:40.841826 25888 consensus_queue.cc:1048] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:40.843252 25395 tablet_server.cc:179] TabletServer@127.24.204.193:0 shutting down...
W20260709 13:08:40.866385 25642 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:40.874150 25642 consensus_peers.cc:597] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 -> Peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Couldn't send request to peer 82bc0106fc9140d5a7cebd0e74679ad4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:40.889026 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:40.890077 25395 tablet_replica.cc:333] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4: stopping tablet replica
I20260709 13:08:40.891543 25395 raft_consensus.cc:2243] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:40.892474 25395 raft_consensus.cc:2272] T b36befdfc5fb49719a7da9da167ee404 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.895597 25395 tablet_replica.cc:333] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4: stopping tablet replica
I20260709 13:08:40.896202 25395 raft_consensus.cc:2243] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:40.896977 25395 raft_consensus.cc:2272] T b9f352f1a60a40a0a09acfc8422b9736 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.898895 25395 tablet_replica.cc:333] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4: stopping tablet replica
I20260709 13:08:40.899446 25395 raft_consensus.cc:2243] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.899809 25395 raft_consensus.cc:2272] T 8bb596975e484608a46c0fe9b20bb5fe P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.901960 25395 tablet_replica.cc:333] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4: stopping tablet replica
I20260709 13:08:40.902408 25395 raft_consensus.cc:2243] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.902738 25395 raft_consensus.cc:2272] T 10caecec8c054b18a4a2bf178b001a54 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.904245 25395 tablet_replica.cc:333] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4: stopping tablet replica
I20260709 13:08:40.904707 25395 raft_consensus.cc:2243] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.905061 25395 raft_consensus.cc:2272] T 674e65cc442345b7923817b336a936a2 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.906821 25395 tablet_replica.cc:333] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4: stopping tablet replica
I20260709 13:08:40.907238 25395 raft_consensus.cc:2243] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.907553 25395 raft_consensus.cc:2272] T f147bb3c4d3e4c499012718b59ec3863 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.909058 25395 tablet_replica.cc:333] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4: stopping tablet replica
I20260709 13:08:40.909462 25395 raft_consensus.cc:2243] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:40.910159 25395 raft_consensus.cc:2272] T 52433a05833644b9960a9e1b5bf8a286 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.912195 25395 tablet_replica.cc:333] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4: stopping tablet replica
I20260709 13:08:40.912631 25395 raft_consensus.cc:2243] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.912981 25395 raft_consensus.cc:2272] T 09cea5bbd30a461a9b4f7188780a0850 P 82bc0106fc9140d5a7cebd0e74679ad4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.914500 25395 tablet_replica.cc:333] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4: stopping tablet replica
I20260709 13:08:40.914901 25395 raft_consensus.cc:2243] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.915356 25395 raft_consensus.cc:2272] T 79d40dbd48594f80985fa77016912dbd P 82bc0106fc9140d5a7cebd0e74679ad4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:40.938684 25642 consensus_peers.cc:597] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 -> Peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Couldn't send request to peer 82bc0106fc9140d5a7cebd0e74679ad4. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:33585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.069607 25604 raft_consensus.cc:1275] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Refusing update from remote peer 4495e708d9054d6ca2691297176c5bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:41.077955 25642 consensus_peers.cc:597] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 -> Peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Couldn't send request to peer 82bc0106fc9140d5a7cebd0e74679ad4. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:33585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.078177 25878 consensus_queue.cc:1048] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0c6581491d341e09aea4bb7528025c5" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:41.091028 25395 tablet_server.cc:196] TabletServer@127.24.204.193:0 shutdown complete.
W20260709 13:08:41.094692 25568 consensus_peers.cc:597] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 -> Peer 82bc0106fc9140d5a7cebd0e74679ad4 (127.24.204.193:33585): Couldn't send request to peer 82bc0106fc9140d5a7cebd0e74679ad4. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:33585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.118446 25395 tablet_server.cc:179] TabletServer@127.24.204.194:0 shutting down...
I20260709 13:08:41.145753 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:41.146433 25395 tablet_replica.cc:333] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5: stopping tablet replica
I20260709 13:08:41.147151 25395 raft_consensus.cc:2243] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.148043 25395 raft_consensus.cc:2272] T f147bb3c4d3e4c499012718b59ec3863 P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.149909 25395 tablet_replica.cc:333] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5: stopping tablet replica
I20260709 13:08:41.150425 25395 raft_consensus.cc:2243] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.150856 25395 raft_consensus.cc:2272] T 52433a05833644b9960a9e1b5bf8a286 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.152959 25395 tablet_replica.cc:333] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5: stopping tablet replica
I20260709 13:08:41.153663 25395 raft_consensus.cc:2243] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.154207 25395 raft_consensus.cc:2272] T 674e65cc442345b7923817b336a936a2 P b0c6581491d341e09aea4bb7528025c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.155819 25395 tablet_replica.cc:333] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5: stopping tablet replica
I20260709 13:08:41.156353 25395 raft_consensus.cc:2243] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.156780 25395 raft_consensus.cc:2272] T b36befdfc5fb49719a7da9da167ee404 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.158774 25395 tablet_replica.cc:333] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5: stopping tablet replica
I20260709 13:08:41.159300 25395 raft_consensus.cc:2243] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.159982 25395 raft_consensus.cc:2272] T 79d40dbd48594f80985fa77016912dbd P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.161521 25395 tablet_replica.cc:333] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5: stopping tablet replica
I20260709 13:08:41.162007 25395 raft_consensus.cc:2243] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.162667 25395 raft_consensus.cc:2272] T 09cea5bbd30a461a9b4f7188780a0850 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.164198 25395 tablet_replica.cc:333] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5: stopping tablet replica
I20260709 13:08:41.164657 25395 raft_consensus.cc:2243] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.165091 25395 raft_consensus.cc:2272] T 10caecec8c054b18a4a2bf178b001a54 P b0c6581491d341e09aea4bb7528025c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.167176 25395 tablet_replica.cc:333] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5: stopping tablet replica
I20260709 13:08:41.167649 25395 raft_consensus.cc:2243] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.168031 25395 raft_consensus.cc:2272] T 8bb596975e484608a46c0fe9b20bb5fe P b0c6581491d341e09aea4bb7528025c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.170135 25395 tablet_replica.cc:333] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5: stopping tablet replica
I20260709 13:08:41.170589 25395 raft_consensus.cc:2243] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.170981 25395 raft_consensus.cc:2272] T b9f352f1a60a40a0a09acfc8422b9736 P b0c6581491d341e09aea4bb7528025c5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:41.184964 25645 consensus_peers.cc:597] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 -> Peer b0c6581491d341e09aea4bb7528025c5 (127.24.204.194:41957): Couldn't send request to peer b0c6581491d341e09aea4bb7528025c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.199909 25395 tablet_server.cc:196] TabletServer@127.24.204.194:0 shutdown complete.
I20260709 13:08:41.217242 25395 tablet_server.cc:179] TabletServer@127.24.204.195:0 shutting down...
I20260709 13:08:41.246373 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:41.247146 25395 tablet_replica.cc:333] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7: stopping tablet replica
I20260709 13:08:41.247682 25395 raft_consensus.cc:2243] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.248428 25395 raft_consensus.cc:2272] T 8bb596975e484608a46c0fe9b20bb5fe P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.250877 25395 tablet_replica.cc:333] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7: stopping tablet replica
I20260709 13:08:41.251401 25395 raft_consensus.cc:2243] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.252043 25395 raft_consensus.cc:2272] T 10caecec8c054b18a4a2bf178b001a54 P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.254333 25395 tablet_replica.cc:333] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7: stopping tablet replica
I20260709 13:08:41.254777 25395 raft_consensus.cc:2243] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.255148 25395 raft_consensus.cc:2272] T 52433a05833644b9960a9e1b5bf8a286 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.257174 25395 tablet_replica.cc:333] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7: stopping tablet replica
I20260709 13:08:41.257681 25395 raft_consensus.cc:2243] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.258430 25395 raft_consensus.cc:2272] T 674e65cc442345b7923817b336a936a2 P 4495e708d9054d6ca2691297176c5bd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.259945 25395 tablet_replica.cc:333] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7: stopping tablet replica
I20260709 13:08:41.260375 25395 raft_consensus.cc:2243] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.260717 25395 raft_consensus.cc:2272] T f147bb3c4d3e4c499012718b59ec3863 P 4495e708d9054d6ca2691297176c5bd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.262223 25395 tablet_replica.cc:333] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7: stopping tablet replica
I20260709 13:08:41.262632 25395 raft_consensus.cc:2243] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.262979 25395 raft_consensus.cc:2272] T 09cea5bbd30a461a9b4f7188780a0850 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.264545 25395 tablet_replica.cc:333] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7: stopping tablet replica
I20260709 13:08:41.264941 25395 raft_consensus.cc:2243] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.265273 25395 raft_consensus.cc:2272] T 79d40dbd48594f80985fa77016912dbd P 4495e708d9054d6ca2691297176c5bd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.266739 25395 tablet_replica.cc:333] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7: stopping tablet replica
I20260709 13:08:41.267114 25395 raft_consensus.cc:2243] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.267452 25395 raft_consensus.cc:2272] T b9f352f1a60a40a0a09acfc8422b9736 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.269399 25395 tablet_replica.cc:333] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7: stopping tablet replica
I20260709 13:08:41.269909 25395 raft_consensus.cc:2243] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.270339 25395 raft_consensus.cc:2272] T b36befdfc5fb49719a7da9da167ee404 P 4495e708d9054d6ca2691297176c5bd7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.302150 25395 tablet_server.cc:196] TabletServer@127.24.204.195:0 shutdown complete.
I20260709 13:08:41.323485 25395 master.cc:562] Master@127.24.204.254:36299 shutting down...
I20260709 13:08:41.457336 25395 raft_consensus.cc:2243] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.458035 25395 raft_consensus.cc:2272] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.458405 25395 tablet_replica.cc:333] T 00000000000000000000000000000000 P da50a70270dd46c7872edd07590154fa: stopping tablet replica
I20260709 13:08:41.479174 25395 master.cc:584] Master@127.24.204.254:36299 shutdown complete.
4495e708d9054d6ca2691297176c5bd7  1
82bc0106fc9140d5a7cebd0e74679ad4  4
b0c6581491d341e09aea4bb7528025c5  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13070 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:08:41.526262 25395 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.204.254:36669
I20260709 13:08:41.527448 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:41.534066 25903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.535064 25904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.535974 25906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.537609 25395 server_base.cc:1061] running on GCE node
I20260709 13:08:41.538431 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:41.538607 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:41.538710 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602521538699 us; error 0 us; skew 500 ppm
I20260709 13:08:41.539171 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:41.553659 25395 webserver.cc:533] Webserver started at http://127.24.204.254:40971/ using document root <none> and password file <none>
I20260709 13:08:41.554206 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:41.554379 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:41.554641 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:41.555954 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/master-0-root/instance:
uuid: "71339cf6b43d4578aab1274104b4a93e"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-qv7r"
I20260709 13:08:41.560935 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:08:41.564647 25911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.565480 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:41.565877 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/master-0-root
uuid: "71339cf6b43d4578aab1274104b4a93e"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-qv7r"
I20260709 13:08:41.566164 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:41.602432 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:41.603719 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:41.651948 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.254:36669
I20260709 13:08:41.652449 25962 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.254:36669 every 8 connection(s)
I20260709 13:08:41.656716 25963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.668100 25963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e: Bootstrap starting.
I20260709 13:08:41.674027 25963 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:41.680333 25963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e: No bootstrap required, opened a new log
I20260709 13:08:41.682708 25963 raft_consensus.cc:359] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71339cf6b43d4578aab1274104b4a93e" member_type: VOTER }
I20260709 13:08:41.683117 25963 raft_consensus.cc:385] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:41.683284 25963 raft_consensus.cc:740] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71339cf6b43d4578aab1274104b4a93e, State: Initialized, Role: FOLLOWER
I20260709 13:08:41.683890 25963 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71339cf6b43d4578aab1274104b4a93e" member_type: VOTER }
I20260709 13:08:41.684331 25963 raft_consensus.cc:399] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:41.684530 25963 raft_consensus.cc:493] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:41.684749 25963 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:41.689603 25963 raft_consensus.cc:515] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71339cf6b43d4578aab1274104b4a93e" member_type: VOTER }
I20260709 13:08:41.690128 25963 leader_election.cc:304] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71339cf6b43d4578aab1274104b4a93e; no voters: 
I20260709 13:08:41.691262 25963 leader_election.cc:290] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:41.691881 25966 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:41.693392 25966 raft_consensus.cc:697] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 1 LEADER]: Becoming Leader. State: Replica: 71339cf6b43d4578aab1274104b4a93e, State: Running, Role: LEADER
I20260709 13:08:41.694164 25966 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71339cf6b43d4578aab1274104b4a93e" member_type: VOTER }
I20260709 13:08:41.694433 25963 sys_catalog.cc:565] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:41.700867 25968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71339cf6b43d4578aab1274104b4a93e. Latest consensus state: current_term: 1 leader_uuid: "71339cf6b43d4578aab1274104b4a93e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71339cf6b43d4578aab1274104b4a93e" member_type: VOTER } }
I20260709 13:08:41.701944 25968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:41.700896 25967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71339cf6b43d4578aab1274104b4a93e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71339cf6b43d4578aab1274104b4a93e" member_type: VOTER } }
I20260709 13:08:41.704537 25967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:41.709038 25975 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:41.716120 25975 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:41.717322 25395 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:41.726979 25975 catalog_manager.cc:1383] Generated new cluster ID: f3fc8adb2cb54776a98be2f4e7842289
I20260709 13:08:41.727367 25975 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:41.750942 25975 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:41.753172 25975 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:41.778474 25975 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e: Generated new TSK 0
I20260709 13:08:41.779594 25975 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:41.848289 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:41.857847 25984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.858268 25985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.859407 25395 server_base.cc:1061] running on GCE node
W20260709 13:08:41.859891 25987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.861418 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:41.862192 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:41.862327 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602521862315 us; error 0 us; skew 500 ppm
I20260709 13:08:41.862834 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:41.865338 25395 webserver.cc:533] Webserver started at http://127.24.204.193:35805/ using document root <none> and password file <none>
I20260709 13:08:41.866237 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:41.866804 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:41.867133 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:41.868407 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-0-root/instance:
uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-qv7r"
I20260709 13:08:41.873741 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:08:41.877696 25992 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.878628 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:08:41.878962 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-0-root
uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-qv7r"
I20260709 13:08:41.879307 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:41.898619 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:41.900084 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:41.901913 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:41.904251 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:41.904490 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.904744 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:41.904934 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.947335 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.193:36089
I20260709 13:08:41.947424 26054 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.193:36089 every 8 connection(s)
I20260709 13:08:41.952129 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:41.959231 26059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.960328 26060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.964586 25395 server_base.cc:1061] running on GCE node
I20260709 13:08:41.965303 26055 heartbeater.cc:344] Connected to a master server at 127.24.204.254:36669
I20260709 13:08:41.965693 26055 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:41.966602 26055 heartbeater.cc:507] Master 127.24.204.254:36669 requested a full tablet report, sending...
W20260709 13:08:41.966650 26062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.967794 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:41.968206 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:41.968432 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602521968413 us; error 0 us; skew 500 ppm
I20260709 13:08:41.969192 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:41.969496 25928 ts_manager.cc:194] Registered new tserver with Master: a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089)
I20260709 13:08:41.972249 25395 webserver.cc:533] Webserver started at http://127.24.204.194:43841/ using document root <none> and password file <none>
I20260709 13:08:41.972328 25928 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36612
I20260709 13:08:41.973078 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:41.973361 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:41.973785 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:41.975430 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-1-root/instance:
uuid: "f6d4782c3eec4af9a293443bf3401429"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-qv7r"
I20260709 13:08:41.980280 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:08:41.983850 26067 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.984742 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:41.985067 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-1-root
uuid: "f6d4782c3eec4af9a293443bf3401429"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-qv7r"
I20260709 13:08:41.985320 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:42.015058 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:42.016288 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:42.017860 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:42.020047 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:42.020274 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:42.020519 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:42.020694 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:42.060607 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.194:44367
I20260709 13:08:42.060724 26129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.194:44367 every 8 connection(s)
I20260709 13:08:42.065912 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:42.074261 26134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:42.075040 26133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:42.078859 26136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:42.080062 26130 heartbeater.cc:344] Connected to a master server at 127.24.204.254:36669
I20260709 13:08:42.080451 26130 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:42.080617 25395 server_base.cc:1061] running on GCE node
I20260709 13:08:42.081426 26130 heartbeater.cc:507] Master 127.24.204.254:36669 requested a full tablet report, sending...
I20260709 13:08:42.081671 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:42.081964 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:42.082157 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602522082137 us; error 0 us; skew 500 ppm
I20260709 13:08:42.082873 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:42.083825 25928 ts_manager.cc:194] Registered new tserver with Master: f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:42.085500 25928 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36620
I20260709 13:08:42.085683 25395 webserver.cc:533] Webserver started at http://127.24.204.195:44709/ using document root <none> and password file <none>
I20260709 13:08:42.086273 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:42.086510 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:42.086838 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:42.088236 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-2-root/instance:
uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
format_stamp: "Formatted at 2026-07-09 13:08:42 on dist-test-slave-qv7r"
I20260709 13:08:42.092805 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:42.096822 26141 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:42.098065 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:08:42.098449 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-2-root
uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
format_stamp: "Formatted at 2026-07-09 13:08:42 on dist-test-slave-qv7r"
I20260709 13:08:42.098722 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602508284650-25395-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:42.133894 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:42.135179 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:42.136705 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:42.139102 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:42.139348 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:42.139606 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:42.139783 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:42.183228 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.195:44387
I20260709 13:08:42.183320 26203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.195:44387 every 8 connection(s)
I20260709 13:08:42.200939 26204 heartbeater.cc:344] Connected to a master server at 127.24.204.254:36669
I20260709 13:08:42.201363 26204 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:42.202167 26204 heartbeater.cc:507] Master 127.24.204.254:36669 requested a full tablet report, sending...
I20260709 13:08:42.204504 25928 ts_manager.cc:194] Registered new tserver with Master: 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:42.205605 25395 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017981804s
I20260709 13:08:42.206112 25928 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36632
I20260709 13:08:42.233393 25928 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36644:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:42.236289 25928 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:42.316728 26168 tablet_service.cc:1511] Processing CreateTablet for tablet 184495209f5d41de9538072e9418f62e (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:42.318295 26168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184495209f5d41de9538072e9418f62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.316728 26169 tablet_service.cc:1511] Processing CreateTablet for tablet 32eb0e81167b4cbbabff9ea0e675aa36 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:42.323258 26167 tablet_service.cc:1511] Processing CreateTablet for tablet dd0b2700bc8145a49e260b8233d98d04 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:42.324841 26169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32eb0e81167b4cbbabff9ea0e675aa36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.326938 26166 tablet_service.cc:1511] Processing CreateTablet for tablet 822cf0b215a04a21972380eb1cd2ef8d (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:42.328293 26166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822cf0b215a04a21972380eb1cd2ef8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.331051 26167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0b2700bc8145a49e260b8233d98d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.330718 26165 tablet_service.cc:1511] Processing CreateTablet for tablet 445aff88fdce4055b7b73ea9518144c6 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:42.332131 26165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445aff88fdce4055b7b73ea9518144c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.342765 26094 tablet_service.cc:1511] Processing CreateTablet for tablet 184495209f5d41de9538072e9418f62e (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:42.343182 26092 tablet_service.cc:1511] Processing CreateTablet for tablet 822cf0b215a04a21972380eb1cd2ef8d (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:42.344255 26094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184495209f5d41de9538072e9418f62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.345330 26091 tablet_service.cc:1511] Processing CreateTablet for tablet 445aff88fdce4055b7b73ea9518144c6 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:42.346694 26091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445aff88fdce4055b7b73ea9518144c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.347110 26095 tablet_service.cc:1511] Processing CreateTablet for tablet 32eb0e81167b4cbbabff9ea0e675aa36 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:42.346709 26093 tablet_service.cc:1511] Processing CreateTablet for tablet dd0b2700bc8145a49e260b8233d98d04 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:42.348646 26095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32eb0e81167b4cbbabff9ea0e675aa36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.353958 26093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0b2700bc8145a49e260b8233d98d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.357918 26092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822cf0b215a04a21972380eb1cd2ef8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.371760 26020 tablet_service.cc:1511] Processing CreateTablet for tablet 32eb0e81167b4cbbabff9ea0e675aa36 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:42.374759 26019 tablet_service.cc:1511] Processing CreateTablet for tablet 184495209f5d41de9538072e9418f62e (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:42.377998 26016 tablet_service.cc:1511] Processing CreateTablet for tablet 445aff88fdce4055b7b73ea9518144c6 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:42.378253 26018 tablet_service.cc:1511] Processing CreateTablet for tablet dd0b2700bc8145a49e260b8233d98d04 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:42.377998 26017 tablet_service.cc:1511] Processing CreateTablet for tablet 822cf0b215a04a21972380eb1cd2ef8d (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:42.380988 26020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32eb0e81167b4cbbabff9ea0e675aa36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.381966 26018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd0b2700bc8145a49e260b8233d98d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.385989 26019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184495209f5d41de9538072e9418f62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.390043 26017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822cf0b215a04a21972380eb1cd2ef8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.394179 26016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445aff88fdce4055b7b73ea9518144c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.417244 26015 tablet_service.cc:1511] Processing CreateTablet for tablet 11815ab907f14eb193c3b667d23f0568 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:42.420055 26015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11815ab907f14eb193c3b667d23f0568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.431988 26219 tablet_bootstrap.cc:492] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca: Bootstrap starting.
I20260709 13:08:42.437830 26220 tablet_bootstrap.cc:492] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429: Bootstrap starting.
I20260709 13:08:42.440339 26166 tablet_service.cc:1511] Processing CreateTablet for tablet 11815ab907f14eb193c3b667d23f0568 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:42.442163 26166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11815ab907f14eb193c3b667d23f0568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.443917 26093 tablet_service.cc:1511] Processing CreateTablet for tablet 018f68fb988b4014a5bf56372b63b5dc (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:42.445324 26093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018f68fb988b4014a5bf56372b63b5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.445354 26220 tablet_bootstrap.cc:654] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.452543 26219 tablet_bootstrap.cc:654] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.453927 26095 tablet_service.cc:1511] Processing CreateTablet for tablet 11815ab907f14eb193c3b667d23f0568 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:42.455471 26018 tablet_service.cc:1511] Processing CreateTablet for tablet 018f68fb988b4014a5bf56372b63b5dc (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:42.457806 26165 tablet_service.cc:1511] Processing CreateTablet for tablet 018f68fb988b4014a5bf56372b63b5dc (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:42.461548 26091 tablet_service.cc:1511] Processing CreateTablet for tablet 5655c36f8c1541158fc4340810f5a73f (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:42.463099 26019 tablet_service.cc:1511] Processing CreateTablet for tablet 5655c36f8c1541158fc4340810f5a73f (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:42.467839 26165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018f68fb988b4014a5bf56372b63b5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.470417 26091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5655c36f8c1541158fc4340810f5a73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.477005 26019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5655c36f8c1541158fc4340810f5a73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.482112 26018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018f68fb988b4014a5bf56372b63b5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.505303 26095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11815ab907f14eb193c3b667d23f0568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.512311 26166 tablet_service.cc:1511] Processing CreateTablet for tablet 5655c36f8c1541158fc4340810f5a73f (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:42.513720 26166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5655c36f8c1541158fc4340810f5a73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.520695 26222 tablet_bootstrap.cc:492] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Bootstrap starting.
I20260709 13:08:42.520748 26219 tablet_bootstrap.cc:492] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca: No bootstrap required, opened a new log
I20260709 13:08:42.520740 26220 tablet_bootstrap.cc:492] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429: No bootstrap required, opened a new log
I20260709 13:08:42.521646 26220 ts_tablet_manager.cc:1403] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429: Time spent bootstrapping tablet: real 0.084s	user 0.025s	sys 0.004s
I20260709 13:08:42.524588 26220 raft_consensus.cc:359] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.525312 26220 raft_consensus.cc:385] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.525698 26220 raft_consensus.cc:740] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.526561 26220 consensus_queue.cc:260] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.527947 26219 ts_tablet_manager.cc:1403] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent bootstrapping tablet: real 0.096s	user 0.029s	sys 0.018s
I20260709 13:08:42.528905 26222 tablet_bootstrap.cc:654] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.531977 26220 ts_tablet_manager.cc:1434] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:42.532228 26016 tablet_service.cc:1511] Processing CreateTablet for tablet bd7e90455dfe41d0becce4182ca86df2 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:42.532716 26130 heartbeater.cc:499] Master 127.24.204.254:36669 was elected leader, sending a full tablet report...
I20260709 13:08:42.533670 26016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7e90455dfe41d0becce4182ca86df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.534451 26091 tablet_service.cc:1511] Processing CreateTablet for tablet bd7e90455dfe41d0becce4182ca86df2 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:42.536620 26220 tablet_bootstrap.cc:492] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429: Bootstrap starting.
I20260709 13:08:42.537505 26219 raft_consensus.cc:359] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.538285 26219 raft_consensus.cc:385] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.538578 26219 raft_consensus.cc:740] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.539575 26219 consensus_queue.cc:260] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.540908 26091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7e90455dfe41d0becce4182ca86df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.547976 26166 tablet_service.cc:1511] Processing CreateTablet for tablet bd7e90455dfe41d0becce4182ca86df2 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:42.549436 26166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7e90455dfe41d0becce4182ca86df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.559779 26018 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed18719260a4d38a94f5f0c089af721 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:42.561362 26018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed18719260a4d38a94f5f0c089af721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.562839 26165 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed18719260a4d38a94f5f0c089af721 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:42.563694 26224 raft_consensus.cc:493] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.564054 26165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed18719260a4d38a94f5f0c089af721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.564184 26224 raft_consensus.cc:515] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.566618 26093 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed18719260a4d38a94f5f0c089af721 (DEFAULT_TABLE table=test-workload [id=647aa5fc57b4433c8e5358b0ecb4047e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:42.567001 26224 leader_election.cc:290] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:42.567927 26093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed18719260a4d38a94f5f0c089af721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.582568 26222 tablet_bootstrap.cc:492] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: No bootstrap required, opened a new log
I20260709 13:08:42.583081 26222 ts_tablet_manager.cc:1403] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.015s
I20260709 13:08:42.585523 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445aff88fdce4055b7b73ea9518144c6" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" is_pre_election: true
W20260709 13:08:42.587445 26068 leader_election.cc:343] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.592703 26222 raft_consensus.cc:359] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.593473 26222 raft_consensus.cc:385] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.598088 26219 ts_tablet_manager.cc:1434] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent starting tablet: real 0.070s	user 0.012s	sys 0.020s
I20260709 13:08:42.598840 26204 heartbeater.cc:499] Master 127.24.204.254:36669 was elected leader, sending a full tablet report...
I20260709 13:08:42.595476 26222 raft_consensus.cc:740] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.603102 26219 tablet_bootstrap.cc:492] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca: Bootstrap starting.
I20260709 13:08:42.603605 26222 consensus_queue.cc:260] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.611999 26179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445aff88fdce4055b7b73ea9518144c6" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" is_pre_election: true
I20260709 13:08:42.613306 26220 tablet_bootstrap.cc:654] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:42.613915 26070 leader_election.cc:343] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.614434 26070 leader_election.cc:304] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6d4782c3eec4af9a293443bf3401429; no voters: 9d16148758cb40bfa71e1a3b0649f4ca, a7eb8c2a624c4ec7a10f60e8b1f6c05b
I20260709 13:08:42.616285 26055 heartbeater.cc:499] Master 127.24.204.254:36669 was elected leader, sending a full tablet report...
I20260709 13:08:42.617251 26224 raft_consensus.cc:2749] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:42.624018 26219 tablet_bootstrap.cc:654] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.625599 26220 tablet_bootstrap.cc:492] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429: No bootstrap required, opened a new log
I20260709 13:08:42.634001 26220 ts_tablet_manager.cc:1403] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429: Time spent bootstrapping tablet: real 0.098s	user 0.002s	sys 0.013s
I20260709 13:08:42.633138 26222 ts_tablet_manager.cc:1434] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.001s
I20260709 13:08:42.637632 26222 tablet_bootstrap.cc:492] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Bootstrap starting.
I20260709 13:08:42.637518 26220 raft_consensus.cc:359] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.638792 26220 raft_consensus.cc:385] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.639140 26220 raft_consensus.cc:740] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.640141 26220 consensus_queue.cc:260] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.645035 26222 tablet_bootstrap.cc:654] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.645780 26220 ts_tablet_manager.cc:1434] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.007s
I20260709 13:08:42.646878 26220 tablet_bootstrap.cc:492] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429: Bootstrap starting.
I20260709 13:08:42.655426 26220 tablet_bootstrap.cc:654] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.662282 26219 tablet_bootstrap.cc:492] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca: No bootstrap required, opened a new log
I20260709 13:08:42.662843 26219 ts_tablet_manager.cc:1403] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.020s
I20260709 13:08:42.663326 26222 tablet_bootstrap.cc:492] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: No bootstrap required, opened a new log
I20260709 13:08:42.663954 26222 ts_tablet_manager.cc:1403] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.003s
I20260709 13:08:42.665868 26219 raft_consensus.cc:359] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.666671 26219 raft_consensus.cc:385] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.667019 26219 raft_consensus.cc:740] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.667656 26222 raft_consensus.cc:359] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:42.668390 26222 raft_consensus.cc:385] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.667959 26219 consensus_queue.cc:260] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.668737 26222 raft_consensus.cc:740] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.669499 26222 consensus_queue.cc:260] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:42.670198 26220 tablet_bootstrap.cc:492] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429: No bootstrap required, opened a new log
I20260709 13:08:42.670312 26219 ts_tablet_manager.cc:1434] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:08:42.670676 26220 ts_tablet_manager.cc:1403] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 13:08:42.671258 26219 tablet_bootstrap.cc:492] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca: Bootstrap starting.
I20260709 13:08:42.671897 26222 ts_tablet_manager.cc:1434] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:08:42.672974 26222 tablet_bootstrap.cc:492] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Bootstrap starting.
I20260709 13:08:42.673688 26220 raft_consensus.cc:359] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.674410 26220 raft_consensus.cc:385] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.674696 26220 raft_consensus.cc:740] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.675626 26220 consensus_queue.cc:260] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.678072 26219 tablet_bootstrap.cc:654] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.679536 26222 tablet_bootstrap.cc:654] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.685767 26220 ts_tablet_manager.cc:1434] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:08:42.688150 26226 raft_consensus.cc:493] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.688622 26226 raft_consensus.cc:515] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.696126 26220 tablet_bootstrap.cc:492] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429: Bootstrap starting.
I20260709 13:08:42.701812 26226 leader_election.cc:290] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:42.705832 26222 tablet_bootstrap.cc:492] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: No bootstrap required, opened a new log
I20260709 13:08:42.706401 26222 ts_tablet_manager.cc:1403] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.016s
I20260709 13:08:42.706478 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" is_pre_election: true
W20260709 13:08:42.708145 26142 leader_election.cc:343] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:42.708528 25976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:42.712016 26220 tablet_bootstrap.cc:654] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.711870 26222 raft_consensus.cc:359] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.712818 26222 raft_consensus.cc:385] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.713172 26222 raft_consensus.cc:740] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.713982 26222 consensus_queue.cc:260] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.720099 26220 tablet_bootstrap.cc:492] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429: No bootstrap required, opened a new log
I20260709 13:08:42.720788 26220 ts_tablet_manager.cc:1403] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.006s
I20260709 13:08:42.723212 26222 ts_tablet_manager.cc:1434] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:08:42.724156 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:42.724047 26220 raft_consensus.cc:359] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.724860 26222 tablet_bootstrap.cc:492] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Bootstrap starting.
I20260709 13:08:42.724903 26105 raft_consensus.cc:2468] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 0.
I20260709 13:08:42.720152 26219 tablet_bootstrap.cc:492] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca: No bootstrap required, opened a new log
I20260709 13:08:42.725786 26219 ts_tablet_manager.cc:1403] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.013s
I20260709 13:08:42.726542 26143 leader_election.cc:304] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b
I20260709 13:08:42.727370 26226 raft_consensus.cc:2804] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.727718 26226 raft_consensus.cc:493] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.728061 26226 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.728694 26219 raft_consensus.cc:359] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:42.724912 26220 raft_consensus.cc:385] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.729923 26220 raft_consensus.cc:740] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.730698 26220 consensus_queue.cc:260] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.731550 26222 tablet_bootstrap.cc:654] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.732911 26220 ts_tablet_manager.cc:1434] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:08:42.733939 26220 tablet_bootstrap.cc:492] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429: Bootstrap starting.
I20260709 13:08:42.729409 26219 raft_consensus.cc:385] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.737826 26219 raft_consensus.cc:740] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.737102 26226 raft_consensus.cc:515] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.738684 26219 consensus_queue.cc:260] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:42.740628 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
W20260709 13:08:42.743155 26142 leader_election.cc:343] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.744127 26226 leader_election.cc:290] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:42.744340 26220 tablet_bootstrap.cc:654] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.745862 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:42.746459 26105 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.756366 26105 raft_consensus.cc:2468] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 1.
I20260709 13:08:42.758016 26143 leader_election.cc:304] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b
I20260709 13:08:42.763337 26226 raft_consensus.cc:2804] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.764142 26226 raft_consensus.cc:697] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Becoming Leader. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:42.765169 26226 consensus_queue.cc:237] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.770406 26219 ts_tablet_manager.cc:1434] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.013s
I20260709 13:08:42.772110 26219 tablet_bootstrap.cc:492] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca: Bootstrap starting.
I20260709 13:08:42.774410 26220 tablet_bootstrap.cc:492] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429: No bootstrap required, opened a new log
I20260709 13:08:42.775100 26220 ts_tablet_manager.cc:1403] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.013s
I20260709 13:08:42.776271 26222 tablet_bootstrap.cc:492] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b: No bootstrap required, opened a new log
I20260709 13:08:42.776783 26222 ts_tablet_manager.cc:1403] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent bootstrapping tablet: real 0.052s	user 0.026s	sys 0.021s
I20260709 13:08:42.778014 26220 raft_consensus.cc:359] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:42.778843 26219 tablet_bootstrap.cc:654] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.779975 26222 raft_consensus.cc:359] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.780771 26222 raft_consensus.cc:385] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.781373 26222 raft_consensus.cc:740] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.780210 25928 catalog_manager.cc:5697] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195). New cstate: current_term: 1 leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.778810 26220 raft_consensus.cc:385] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.782379 26220 raft_consensus.cc:740] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.782370 26222 consensus_queue.cc:260] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.784893 26222 ts_tablet_manager.cc:1434] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:08:42.785975 26222 tablet_bootstrap.cc:492] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Bootstrap starting.
I20260709 13:08:42.791247 26219 tablet_bootstrap.cc:492] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca: No bootstrap required, opened a new log
I20260709 13:08:42.791716 26219 ts_tablet_manager.cc:1403] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 13:08:42.793159 26222 tablet_bootstrap.cc:654] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.794620 26219 raft_consensus.cc:359] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.795362 26219 raft_consensus.cc:385] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.795658 26219 raft_consensus.cc:740] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.783362 26220 consensus_queue.cc:260] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:42.796810 26219 consensus_queue.cc:260] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.799618 26219 ts_tablet_manager.cc:1434] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:42.800563 26219 tablet_bootstrap.cc:492] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca: Bootstrap starting.
I20260709 13:08:42.802345 26228 raft_consensus.cc:493] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.803416 26220 ts_tablet_manager.cc:1434] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:08:42.802997 26228 raft_consensus.cc:515] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:42.805051 26220 tablet_bootstrap.cc:492] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429: Bootstrap starting.
I20260709 13:08:42.808830 26219 tablet_bootstrap.cc:654] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.817626 26228 leader_election.cc:290] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:42.823551 26222 tablet_bootstrap.cc:492] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b: No bootstrap required, opened a new log
I20260709 13:08:42.817343 26220 tablet_bootstrap.cc:654] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.824388 26222 ts_tablet_manager.cc:1403] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.012s
I20260709 13:08:42.828372 26222 raft_consensus.cc:359] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.829525 26222 raft_consensus.cc:385] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.829957 26222 raft_consensus.cc:740] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.831205 26222 consensus_queue.cc:260] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.832453 26219 tablet_bootstrap.cc:492] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca: No bootstrap required, opened a new log
I20260709 13:08:42.833048 26219 ts_tablet_manager.cc:1403] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.009s
I20260709 13:08:42.835544 26222 ts_tablet_manager.cc:1434] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.007s
I20260709 13:08:42.836656 26222 tablet_bootstrap.cc:492] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Bootstrap starting.
I20260709 13:08:42.837597 26219 raft_consensus.cc:359] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.838595 26219 raft_consensus.cc:385] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.838994 26219 raft_consensus.cc:740] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.840152 26219 consensus_queue.cc:260] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.843779 26222 tablet_bootstrap.cc:654] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.844950 26219 ts_tablet_manager.cc:1434] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.005s
I20260709 13:08:42.845994 26219 tablet_bootstrap.cc:492] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca: Bootstrap starting.
I20260709 13:08:42.852900 26219 tablet_bootstrap.cc:654] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.865625 26220 tablet_bootstrap.cc:492] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429: No bootstrap required, opened a new log
I20260709 13:08:42.866288 26220 ts_tablet_manager.cc:1403] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.000s
I20260709 13:08:42.870337 26220 raft_consensus.cc:359] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.871320 26220 raft_consensus.cc:385] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.871716 26220 raft_consensus.cc:740] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.876642 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:42.877596 26105 raft_consensus.cc:2468] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 0.
I20260709 13:08:42.879290 25994 leader_election.cc:304] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:42.879380 26179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" is_pre_election: true
I20260709 13:08:42.880512 26228 raft_consensus.cc:2804] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.880873 26179 raft_consensus.cc:2468] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 0.
I20260709 13:08:42.881034 26228 raft_consensus.cc:493] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.881644 26228 raft_consensus.cc:3060] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.886004 26222 tablet_bootstrap.cc:492] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: No bootstrap required, opened a new log
I20260709 13:08:42.886718 26222 ts_tablet_manager.cc:1403] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.028s
I20260709 13:08:42.886852 26220 consensus_queue.cc:260] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.887682 26219 tablet_bootstrap.cc:492] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca: No bootstrap required, opened a new log
I20260709 13:08:42.888125 26219 ts_tablet_manager.cc:1403] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent bootstrapping tablet: real 0.042s	user 0.030s	sys 0.008s
I20260709 13:08:42.889251 26220 ts_tablet_manager.cc:1434] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:08:42.890292 26220 tablet_bootstrap.cc:492] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429: Bootstrap starting.
I20260709 13:08:42.890554 26222 raft_consensus.cc:359] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.891006 26219 raft_consensus.cc:359] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.891499 26222 raft_consensus.cc:385] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.891731 26219 raft_consensus.cc:385] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.892122 26219 raft_consensus.cc:740] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.892032 26222 raft_consensus.cc:740] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.893198 26219 consensus_queue.cc:260] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.893339 26222 consensus_queue.cc:260] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.895606 26219 ts_tablet_manager.cc:1434] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:42.896675 26219 tablet_bootstrap.cc:492] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca: Bootstrap starting.
I20260709 13:08:42.903143 26219 tablet_bootstrap.cc:654] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.906915 26220 tablet_bootstrap.cc:654] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.918285 26228 raft_consensus.cc:515] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:42.921304 26228 leader_election.cc:290] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 election: Requested vote from peers 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:42.922397 26179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:42.923189 26179 raft_consensus.cc:3060] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.924593 26228 raft_consensus.cc:493] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.925256 26228 raft_consensus.cc:515] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.928885 26104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822cf0b215a04a21972380eb1cd2ef8d" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:42.929219 26228 leader_election.cc:290] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:42.922435 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:42.930510 26105 raft_consensus.cc:3060] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.932161 26222 ts_tablet_manager.cc:1434] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.013s
I20260709 13:08:42.932988 26219 tablet_bootstrap.cc:492] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca: No bootstrap required, opened a new log
I20260709 13:08:42.933066 26222 tablet_bootstrap.cc:492] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Bootstrap starting.
I20260709 13:08:42.929706 26104 raft_consensus.cc:2468] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 0.
I20260709 13:08:42.933538 26219 ts_tablet_manager.cc:1403] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.015s
I20260709 13:08:42.934641 25994 leader_election.cc:304] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:42.936427 26219 raft_consensus.cc:359] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.937152 26219 raft_consensus.cc:385] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.937489 26219 raft_consensus.cc:740] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.937747 26251 raft_consensus.cc:2804] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.938200 26251 raft_consensus.cc:493] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.938632 26251 raft_consensus.cc:3060] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.938362 26219 consensus_queue.cc:260] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.938953 26178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822cf0b215a04a21972380eb1cd2ef8d" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" is_pre_election: true
I20260709 13:08:42.939592 26178 raft_consensus.cc:2468] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 0.
I20260709 13:08:42.940359 26219 ts_tablet_manager.cc:1434] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:08:42.941305 26219 tablet_bootstrap.cc:492] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca: Bootstrap starting.
I20260709 13:08:42.936940 26179 raft_consensus.cc:2468] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 1.
I20260709 13:08:42.943637 26220 tablet_bootstrap.cc:492] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429: No bootstrap required, opened a new log
I20260709 13:08:42.944687 26220 ts_tablet_manager.cc:1403] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.005s
I20260709 13:08:42.947389 26219 tablet_bootstrap.cc:654] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.948101 26220 raft_consensus.cc:359] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.948954 26220 raft_consensus.cc:385] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.949348 26220 raft_consensus.cc:740] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.950094 26222 tablet_bootstrap.cc:654] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.950281 26220 consensus_queue.cc:260] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.955237 26220 ts_tablet_manager.cc:1434] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 13:08:42.954954 26251 raft_consensus.cc:515] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.956486 26220 tablet_bootstrap.cc:492] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429: Bootstrap starting.
I20260709 13:08:42.958060 26104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822cf0b215a04a21972380eb1cd2ef8d" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:42.958703 26104 raft_consensus.cc:3060] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.964051 26220 tablet_bootstrap.cc:654] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.966379 26104 raft_consensus.cc:2468] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 1.
I20260709 13:08:42.967868 25994 leader_election.cc:304] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:42.969203 26228 raft_consensus.cc:2804] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.969904 26228 raft_consensus.cc:697] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:42.971036 26228 consensus_queue.cc:237] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:42.947430 25995 leader_election.cc:304] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, a7eb8c2a624c4ec7a10f60e8b1f6c05b; no voters: 
I20260709 13:08:42.974575 26252 raft_consensus.cc:2804] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.979048 26251 leader_election.cc:290] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 election: Requested vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:42.981835 26179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822cf0b215a04a21972380eb1cd2ef8d" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:42.982693 26179 raft_consensus.cc:3060] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.992575 25927 catalog_manager.cc:5697] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 0 to 1, leader changed from <none> to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 1 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.973383 26105 raft_consensus.cc:2468] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 1.
I20260709 13:08:43.022535 26252 raft_consensus.cc:697] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:43.023787 26252 consensus_queue.cc:237] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:43.018965 26179 raft_consensus.cc:2468] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 1.
I20260709 13:08:43.027541 26222 tablet_bootstrap.cc:492] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b: No bootstrap required, opened a new log
I20260709 13:08:43.028275 26222 ts_tablet_manager.cc:1403] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent bootstrapping tablet: real 0.095s	user 0.023s	sys 0.035s
I20260709 13:08:43.032339 26222 raft_consensus.cc:359] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.033228 26222 raft_consensus.cc:385] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.033408 26219 tablet_bootstrap.cc:492] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca: No bootstrap required, opened a new log
I20260709 13:08:43.033524 26222 raft_consensus.cc:740] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.033936 26219 ts_tablet_manager.cc:1403] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent bootstrapping tablet: real 0.093s	user 0.049s	sys 0.028s
I20260709 13:08:43.034422 26222 consensus_queue.cc:260] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.035000 25927 catalog_manager.cc:5697] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 0 to 1, leader changed from <none> to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 1 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.036432 26219 raft_consensus.cc:359] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.036752 26222 ts_tablet_manager.cc:1434] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:43.037063 26219 raft_consensus.cc:385] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.037365 26219 raft_consensus.cc:740] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.037843 26226 raft_consensus.cc:493] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.037986 26222 tablet_bootstrap.cc:492] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Bootstrap starting.
I20260709 13:08:43.038235 26219 consensus_queue.cc:260] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.038357 26226 raft_consensus.cc:515] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.040491 26226 leader_election.cc:290] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.041330 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445aff88fdce4055b7b73ea9518144c6" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" is_pre_election: true
I20260709 13:08:43.041663 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445aff88fdce4055b7b73ea9518144c6" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:43.042029 26030 raft_consensus.cc:2468] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 0.
I20260709 13:08:43.042275 26105 raft_consensus.cc:2468] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 0.
I20260709 13:08:43.043550 26143 leader_election.cc:304] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.044540 26238 raft_consensus.cc:2804] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.044718 26219 ts_tablet_manager.cc:1434] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:43.044921 26238 raft_consensus.cc:493] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.044983 26222 tablet_bootstrap.cc:654] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.045344 26238 raft_consensus.cc:3060] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.045650 26219 tablet_bootstrap.cc:492] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca: Bootstrap starting.
I20260709 13:08:43.051314 26219 tablet_bootstrap.cc:654] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.051707 26220 tablet_bootstrap.cc:492] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429: No bootstrap required, opened a new log
I20260709 13:08:43.052202 26220 ts_tablet_manager.cc:1403] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429: Time spent bootstrapping tablet: real 0.096s	user 0.036s	sys 0.038s
I20260709 13:08:43.055212 26220 raft_consensus.cc:359] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.056022 26220 raft_consensus.cc:385] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.052237 26238 raft_consensus.cc:515] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.061349 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445aff88fdce4055b7b73ea9518144c6" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:43.062024 26030 raft_consensus.cc:3060] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.063282 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445aff88fdce4055b7b73ea9518144c6" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:43.063796 26222 tablet_bootstrap.cc:492] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b: No bootstrap required, opened a new log
I20260709 13:08:43.064283 26222 ts_tablet_manager.cc:1403] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.003s
I20260709 13:08:43.064148 26105 raft_consensus.cc:3060] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.066846 26226 raft_consensus.cc:493] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.066983 26222 raft_consensus.cc:359] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.067919 26222 raft_consensus.cc:385] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.068259 26222 raft_consensus.cc:740] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.069042 26222 consensus_queue.cc:260] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.070335 26030 raft_consensus.cc:2468] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 1.
I20260709 13:08:43.056344 26220 raft_consensus.cc:740] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.071936 26220 consensus_queue.cc:260] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.072742 26142 leader_election.cc:304] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, a7eb8c2a624c4ec7a10f60e8b1f6c05b; no voters: 
I20260709 13:08:43.067605 26226 raft_consensus.cc:515] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.075702 26222 ts_tablet_manager.cc:1434] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:08:43.076607 26222 tablet_bootstrap.cc:492] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Bootstrap starting.
I20260709 13:08:43.078019 26104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0b2700bc8145a49e260b8233d98d04" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:43.078892 26104 raft_consensus.cc:2468] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 0.
I20260709 13:08:43.080852 26143 leader_election.cc:304] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.082731 26222 tablet_bootstrap.cc:654] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.085688 26220 ts_tablet_manager.cc:1434] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:08:43.087584 26258 raft_consensus.cc:493] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.088078 26258 raft_consensus.cc:515] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.090377 26258 leader_election.cc:290] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.091863 26104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0b2700bc8145a49e260b8233d98d04" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:43.092538 26104 raft_consensus.cc:2468] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 0.
I20260709 13:08:43.094394 26226 leader_election.cc:290] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.094489 25994 leader_election.cc:304] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.098654 26220 tablet_bootstrap.cc:492] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429: Bootstrap starting.
I20260709 13:08:43.099462 26238 leader_election.cc:290] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.100162 26238 raft_consensus.cc:2804] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.100589 26238 raft_consensus.cc:493] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.101013 26238 raft_consensus.cc:3060] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.101531 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0b2700bc8145a49e260b8233d98d04" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" is_pre_election: true
I20260709 13:08:43.098079 26226 raft_consensus.cc:2804] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:43.103183 26226 raft_consensus.cc:697] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Becoming Leader. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:43.103899 26258 raft_consensus.cc:2804] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.104449 26258 raft_consensus.cc:493] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.093415 26105 raft_consensus.cc:2468] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 1.
I20260709 13:08:43.105100 26258 raft_consensus.cc:3060] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.109228 26179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0b2700bc8145a49e260b8233d98d04" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" is_pre_election: true
I20260709 13:08:43.113514 26264 raft_consensus.cc:493] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.114019 26258 raft_consensus.cc:515] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.106160 26226 consensus_queue.cc:237] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.114024 26264 raft_consensus.cc:515] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.115374 26030 raft_consensus.cc:2393] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d16148758cb40bfa71e1a3b0649f4ca in current term 1: Already voted for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in this term.
I20260709 13:08:43.116339 26220 tablet_bootstrap.cc:654] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.117939 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0b2700bc8145a49e260b8233d98d04" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:43.118574 26105 raft_consensus.cc:3060] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.128577 26219 tablet_bootstrap.cc:492] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca: No bootstrap required, opened a new log
I20260709 13:08:43.129004 26219 ts_tablet_manager.cc:1403] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent bootstrapping tablet: real 0.084s	user 0.027s	sys 0.032s
I20260709 13:08:43.132149 26178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0b2700bc8145a49e260b8233d98d04" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:43.132082 26219 raft_consensus.cc:359] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.132799 26219 raft_consensus.cc:385] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.133070 26219 raft_consensus.cc:740] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.125756 26105 raft_consensus.cc:2468] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 1.
I20260709 13:08:43.133848 26219 consensus_queue.cc:260] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.135203 25994 leader_election.cc:304] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 9d16148758cb40bfa71e1a3b0649f4ca
I20260709 13:08:43.135836 26219 ts_tablet_manager.cc:1434] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:08:43.136047 26252 raft_consensus.cc:2804] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:43.136463 26252 raft_consensus.cc:697] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:43.136761 26219 tablet_bootstrap.cc:492] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca: Bootstrap starting.
I20260709 13:08:43.137229 26252 consensus_queue.cc:237] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.125782 26238 raft_consensus.cc:515] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.138540 26179 raft_consensus.cc:2393] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in current term 1: Already voted for candidate 9d16148758cb40bfa71e1a3b0649f4ca in this term.
I20260709 13:08:43.142825 26224 raft_consensus.cc:493] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.143323 26224 raft_consensus.cc:515] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.127554 26258 leader_election.cc:290] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 election: Requested vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.148492 26224 leader_election.cc:290] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.144977 26238 leader_election.cc:290] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.149269 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0b2700bc8145a49e260b8233d98d04" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:43.149852 26251 raft_consensus.cc:493] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.150333 26251 raft_consensus.cc:515] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.150854 26179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" is_pre_election: true
I20260709 13:08:43.151433 26179 raft_consensus.cc:2468] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 0.
I20260709 13:08:43.151463 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" is_pre_election: true
I20260709 13:08:43.152390 26251 leader_election.cc:290] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.152431 26029 raft_consensus.cc:2468] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 0.
I20260709 13:08:43.152709 26070 leader_election.cc:304] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.154803 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:43.155670 26103 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 0.
I20260709 13:08:43.156853 25994 leader_election.cc:304] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.157168 26219 tablet_bootstrap.cc:654] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.157855 26179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" is_pre_election: true
I20260709 13:08:43.158828 26179 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 0.
I20260709 13:08:43.158965 26220 tablet_bootstrap.cc:492] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429: No bootstrap required, opened a new log
I20260709 13:08:43.159627 26220 ts_tablet_manager.cc:1403] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429: Time spent bootstrapping tablet: real 0.064s	user 0.029s	sys 0.006s
I20260709 13:08:43.166200 26263 raft_consensus.cc:493] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.159499 26224 raft_consensus.cc:2804] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.160748 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd0b2700bc8145a49e260b8233d98d04" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:43.170253 26222 tablet_bootstrap.cc:492] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: No bootstrap required, opened a new log
I20260709 13:08:43.170706 26222 ts_tablet_manager.cc:1403] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.023s
I20260709 13:08:43.171634 26105 raft_consensus.cc:2393] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d16148758cb40bfa71e1a3b0649f4ca in current term 1: Already voted for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in this term.
I20260709 13:08:43.167220 26263 raft_consensus.cc:515] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.173144 26143 leader_election.cc:304] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca; no voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429
I20260709 13:08:43.160060 26251 raft_consensus.cc:2804] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.167695 26224 raft_consensus.cc:493] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.176669 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" is_pre_election: true
I20260709 13:08:43.180742 26029 raft_consensus.cc:2468] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 0.
I20260709 13:08:43.182183 26142 leader_election.cc:304] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, a7eb8c2a624c4ec7a10f60e8b1f6c05b; no voters: 
I20260709 13:08:43.178298 26222 raft_consensus.cc:359] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.179822 26263 leader_election.cc:290] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.183435 26224 raft_consensus.cc:3060] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.184306 25925 catalog_manager.cc:5697] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 0 to 1, leader changed from <none> to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 1 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.174647 26251 raft_consensus.cc:493] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.187852 26251 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.160367 26238 consensus_queue.cc:1048] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:08:43.183245 26222 raft_consensus.cc:385] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.189719 26222 raft_consensus.cc:740] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.190248 26264 leader_election.cc:290] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.196544 26264 raft_consensus.cc:2804] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.199736 26264 raft_consensus.cc:493] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.197165 26222 consensus_queue.cc:260] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.183840 26263 raft_consensus.cc:2749] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:43.200245 26264 raft_consensus.cc:3060] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.202316 26222 ts_tablet_manager.cc:1434] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:08:43.203830 26222 tablet_bootstrap.cc:492] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Bootstrap starting.
I20260709 13:08:43.206076 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" is_pre_election: true
I20260709 13:08:43.198961 26220 raft_consensus.cc:359] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.209692 26220 raft_consensus.cc:385] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.210000 26220 raft_consensus.cc:740] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.211184 26220 consensus_queue.cc:260] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.194972 26224 raft_consensus.cc:515] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.238838 26219 tablet_bootstrap.cc:492] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca: No bootstrap required, opened a new log
I20260709 13:08:43.239256 26219 ts_tablet_manager.cc:1403] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.000s
I20260709 13:08:43.237036 26252 raft_consensus.cc:493] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:43.236941 26143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:44367, user_credentials={real_user=slave}} blocked reactor thread for 63892.4us
I20260709 13:08:43.245468 26252 raft_consensus.cc:515] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.252787 26030 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.253598 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:43.254020 26252 leader_election.cc:290] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.255293 26104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:43.249104 26272 raft_consensus.cc:493] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.255574 26179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" is_pre_election: true
I20260709 13:08:43.255998 26104 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 0.
I20260709 13:08:43.255992 26272 raft_consensus.cc:515] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.257241 26105 raft_consensus.cc:2468] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 0.
I20260709 13:08:43.252135 26222 tablet_bootstrap.cc:654] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.255437 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:43.259056 26272 leader_election.cc:290] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.248303 26251 raft_consensus.cc:515] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.259274 26028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" is_pre_election: true
I20260709 13:08:43.260053 26179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" is_pre_election: true
I20260709 13:08:43.260130 26028 raft_consensus.cc:2468] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 0.
I20260709 13:08:43.260838 26251 leader_election.cc:290] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 election: Requested vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.261742 26068 leader_election.cc:304] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.259328 26103 raft_consensus.cc:2393] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in current term 1: Already voted for candidate 9d16148758cb40bfa71e1a3b0649f4ca in this term.
I20260709 13:08:43.262135 26029 raft_consensus.cc:2393] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d16148758cb40bfa71e1a3b0649f4ca in current term 1: Already voted for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in this term.
I20260709 13:08:43.262614 26178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:43.265856 26178 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.266253 26272 raft_consensus.cc:2804] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.266616 26272 raft_consensus.cc:493] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.267874 26143 leader_election.cc:304] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.268071 26272 raft_consensus.cc:3060] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.265692 25994 leader_election.cc:304] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b; no voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429
I20260709 13:08:43.263314 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:43.272524 26105 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.272593 26251 raft_consensus.cc:2749] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:43.274326 26219 raft_consensus.cc:359] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.275213 26219 raft_consensus.cc:385] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.275542 26219 raft_consensus.cc:740] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.276681 26219 consensus_queue.cc:260] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.284093 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:43.284716 26029 raft_consensus.cc:3060] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.284811 26178 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 1.
I20260709 13:08:43.282882 25927 catalog_manager.cc:5697] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195). New cstate: current_term: 1 leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.288250 26271 raft_consensus.cc:2764] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:08:43.288630 26219 ts_tablet_manager.cc:1434] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:08:43.288161 26270 consensus_queue.cc:1048] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:43.294190 25995 leader_election.cc:304] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, a7eb8c2a624c4ec7a10f60e8b1f6c05b; no voters: 
I20260709 13:08:43.295253 26251 raft_consensus.cc:2804] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:43.295776 26251 raft_consensus.cc:697] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:43.296437 26222 tablet_bootstrap.cc:492] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: No bootstrap required, opened a new log
I20260709 13:08:43.296900 26222 ts_tablet_manager.cc:1403] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.006s
I20260709 13:08:43.296613 26251 consensus_queue.cc:237] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.299166 26220 ts_tablet_manager.cc:1434] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429: Time spent starting tablet: real 0.133s	user 0.021s	sys 0.013s
I20260709 13:08:43.306921 26272 raft_consensus.cc:515] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.308733 26220 tablet_bootstrap.cc:492] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429: Bootstrap starting.
I20260709 13:08:43.310698 26271 raft_consensus.cc:493] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.314910 26271 raft_consensus.cc:515] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.317054 26224 leader_election.cc:290] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.311530 26029 raft_consensus.cc:2468] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 1.
I20260709 13:08:43.318288 26068 leader_election.cc:304] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.318308 26178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:43.319599 26178 raft_consensus.cc:3060] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.320214 26222 raft_consensus.cc:359] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.321610 26222 raft_consensus.cc:385] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.316960 26028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:43.320981 26027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7e90455dfe41d0becce4182ca86df2" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" is_pre_election: true
I20260709 13:08:43.322121 26028 raft_consensus.cc:3060] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.321830 26271 leader_election.cc:290] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.322206 26027 raft_consensus.cc:2468] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 0.
I20260709 13:08:43.324193 26142 leader_election.cc:304] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, a7eb8c2a624c4ec7a10f60e8b1f6c05b; no voters: 
I20260709 13:08:43.310680 26264 raft_consensus.cc:515] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.289891 26105 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 1.
I20260709 13:08:43.325332 26222 raft_consensus.cc:740] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.328070 26222 consensus_queue.cc:260] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.328229 26104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7e90455dfe41d0becce4182ca86df2" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:43.329062 26104 raft_consensus.cc:2468] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 0.
I20260709 13:08:43.329897 26222 ts_tablet_manager.cc:1434] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:08:43.329186 26271 raft_consensus.cc:2804] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.331106 26271 raft_consensus.cc:493] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.332075 26272 leader_election.cc:290] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.332602 26271 raft_consensus.cc:3060] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.336755 26179 raft_consensus.cc:2393] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6d4782c3eec4af9a293443bf3401429 in current term 1: Already voted for candidate 9d16148758cb40bfa71e1a3b0649f4ca in this term.
I20260709 13:08:43.331570 26263 raft_consensus.cc:493] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.343463 26263 raft_consensus.cc:515] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.345992 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:43.347194 26177 raft_consensus.cc:2393] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f6d4782c3eec4af9a293443bf3401429 in current term 1: Already voted for candidate 9d16148758cb40bfa71e1a3b0649f4ca in this term.
I20260709 13:08:43.346689 26271 raft_consensus.cc:515] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.350979 26271 leader_election.cc:290] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.351091 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7e90455dfe41d0becce4182ca86df2" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:43.351735 26029 raft_consensus.cc:3060] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.351790 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7e90455dfe41d0becce4182ca86df2" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:43.352294 26105 raft_consensus.cc:3060] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.356032 26263 leader_election.cc:290] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.356290 26027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed18719260a4d38a94f5f0c089af721" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" is_pre_election: true
I20260709 13:08:43.327474 26224 raft_consensus.cc:2804] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:43.356703 26104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed18719260a4d38a94f5f0c089af721" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429" is_pre_election: true
I20260709 13:08:43.357616 26027 raft_consensus.cc:2468] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 0.
I20260709 13:08:43.359189 26142 leader_election.cc:304] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, a7eb8c2a624c4ec7a10f60e8b1f6c05b; no voters: 
I20260709 13:08:43.359618 26028 raft_consensus.cc:2468] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 1.
W20260709 13:08:43.360925 26143 leader_election.cc:343] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.361421 26068 leader_election.cc:304] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 9d16148758cb40bfa71e1a3b0649f4ca
I20260709 13:08:43.361709 26178 raft_consensus.cc:2468] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 1.
I20260709 13:08:43.362999 26263 raft_consensus.cc:2804] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:43.363456 26272 raft_consensus.cc:2804] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:43.363566 26224 raft_consensus.cc:697] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 1 LEADER]: Becoming Leader. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Running, Role: LEADER
I20260709 13:08:43.363991 26272 raft_consensus.cc:697] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 1 LEADER]: Becoming Leader. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Running, Role: LEADER
I20260709 13:08:43.364502 26224 consensus_queue.cc:237] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.364787 26272 consensus_queue.cc:237] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.365657 26105 raft_consensus.cc:2468] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 1.
I20260709 13:08:43.366888 26143 leader_election.cc:304] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.363451 26263 raft_consensus.cc:493] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.369064 26027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:43.369910 26027 raft_consensus.cc:2393] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d16148758cb40bfa71e1a3b0649f4ca in current term 1: Already voted for candidate f6d4782c3eec4af9a293443bf3401429 in this term.
I20260709 13:08:43.369199 26263 raft_consensus.cc:3060] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.367542 26264 leader_election.cc:290] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.371595 26271 raft_consensus.cc:2804] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:43.384618 26271 raft_consensus.cc:697] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Becoming Leader. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:43.384336 26029 raft_consensus.cc:2468] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 1.
I20260709 13:08:43.387215 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:43.392376 26220 tablet_bootstrap.cc:654] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:43.394268 26271 consensus_queue.cc:237] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.402360 26143 leader_election.cc:304] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca; no voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429
I20260709 13:08:43.403937 26226 raft_consensus.cc:2749] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:43.403940 25925 catalog_manager.cc:5697] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 0 to 1, leader changed from <none> to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 1 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.405920 26263 raft_consensus.cc:515] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.408288 26263 leader_election.cc:290] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:43.409191 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed18719260a4d38a94f5f0c089af721" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:43.409829 26030 raft_consensus.cc:3060] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.409674 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ed18719260a4d38a94f5f0c089af721" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:43.418021 26030 raft_consensus.cc:2468] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 1.
I20260709 13:08:43.419786 26142 leader_election.cc:304] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, a7eb8c2a624c4ec7a10f60e8b1f6c05b; no voters: 
W20260709 13:08:43.420396 26143 leader_election.cc:343] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:43.420709 26263 raft_consensus.cc:2804] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:43.422129 26263 raft_consensus.cc:697] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Becoming Leader. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:43.423005 26263 consensus_queue.cc:237] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.425999 25927 catalog_manager.cc:5697] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6d4782c3eec4af9a293443bf3401429 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "f6d4782c3eec4af9a293443bf3401429" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.429168 25928 catalog_manager.cc:5697] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195). New cstate: current_term: 1 leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.435308 25927 catalog_manager.cc:5697] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6d4782c3eec4af9a293443bf3401429 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "f6d4782c3eec4af9a293443bf3401429" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.437458 26251 consensus_queue.cc:1048] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.455569 25926 catalog_manager.cc:5697] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195). New cstate: current_term: 1 leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.461760 26251 consensus_queue.cc:1048] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.466629 26220 tablet_bootstrap.cc:492] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429: No bootstrap required, opened a new log
I20260709 13:08:43.467253 26220 ts_tablet_manager.cc:1403] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429: Time spent bootstrapping tablet: real 0.159s	user 0.024s	sys 0.035s
I20260709 13:08:43.470175 26220 raft_consensus.cc:359] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.470767 26220 raft_consensus.cc:385] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:43.471015 26220 raft_consensus.cc:740] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Initialized, Role: FOLLOWER
I20260709 13:08:43.471616 26220 consensus_queue.cc:260] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.473424 26220 ts_tablet_manager.cc:1434] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:43.518196 26263 consensus_queue.cc:1048] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.518893 26251 consensus_queue.cc:1048] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.529492 26271 consensus_queue.cc:1048] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.537201 26252 consensus_queue.cc:1048] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.539407 26252 consensus_queue.cc:1048] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.559449 26258 consensus_queue.cc:1048] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.710637 26258 consensus_queue.cc:1048] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.724741 26251 consensus_queue.cc:1048] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:43.754244 26177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "184495209f5d41de9538072e9418f62e"
dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
mode: GRACEFUL
new_leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:08:43.754822 26177 raft_consensus.cc:606] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Received request to transfer leadership to TS a7eb8c2a624c4ec7a10f60e8b1f6c05b
I20260709 13:08:43.766659 26177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "445aff88fdce4055b7b73ea9518144c6"
dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
mode: GRACEFUL
new_leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:08:43.767230 26177 raft_consensus.cc:606] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Received request to transfer leadership to TS a7eb8c2a624c4ec7a10f60e8b1f6c05b
I20260709 13:08:43.781636 26029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
mode: GRACEFUL
new_leader_uuid: "f6d4782c3eec4af9a293443bf3401429"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:08:43.782258 26029 raft_consensus.cc:606] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Received request to transfer leadership to TS f6d4782c3eec4af9a293443bf3401429
I20260709 13:08:43.793378 26177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd7e90455dfe41d0becce4182ca86df2"
dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
mode: GRACEFUL
new_leader_uuid: "f6d4782c3eec4af9a293443bf3401429"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:08:43.794140 26177 raft_consensus.cc:606] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Received request to transfer leadership to TS f6d4782c3eec4af9a293443bf3401429
I20260709 13:08:43.830818 26270 raft_consensus.cc:993] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca: : Instructing follower a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:43.831378 26271 raft_consensus.cc:1081] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Signalling peer a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:43.832885 26029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "184495209f5d41de9538072e9418f62e"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:49256
I20260709 13:08:43.833457 26029 raft_consensus.cc:493] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.833873 26029 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.835592 26272 consensus_queue.cc:1048] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.839579 26029 raft_consensus.cc:515] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.842329 26029 leader_election.cc:290] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 2 election: Requested vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.842473 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:43.843067 26103 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.843920 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:43.846884 26177 raft_consensus.cc:3055] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:43.847721 26177 raft_consensus.cc:740] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:43.847801 26224 consensus_queue.cc:1048] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.848932 26177 consensus_queue.cc:260] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.850210 26177 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.854743 26103 raft_consensus.cc:2468] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 2.
I20260709 13:08:43.855898 25994 leader_election.cc:304] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.856848 26251 raft_consensus.cc:2804] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:43.857354 26251 raft_consensus.cc:697] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:43.858225 26251 consensus_queue.cc:237] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.865469 26177 raft_consensus.cc:2468] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 2.
I20260709 13:08:43.868736 25925 catalog_manager.cc:5697] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 1 to 2, leader changed from 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195) to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 2 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.889496 26273 consensus_queue.cc:1048] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.890132 26224 consensus_queue.cc:1048] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.907191 26103 raft_consensus.cc:3060] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:43.915342 26271 consensus_queue.cc:1048] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.916441 26270 consensus_queue.cc:1048] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.938297 26264 consensus_queue.cc:1048] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:43.949473 26226 consensus_queue.cc:1048] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.959535 26264 raft_consensus.cc:993] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca: : Instructing follower f6d4782c3eec4af9a293443bf3401429 to start an election
I20260709 13:08:43.960067 26226 raft_consensus.cc:1081] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Signalling peer f6d4782c3eec4af9a293443bf3401429 to start an election
I20260709 13:08:43.961864 26103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd7e90455dfe41d0becce4182ca86df2"
dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
 from {username='slave'} at 127.0.0.1:51022
I20260709 13:08:43.962373 26103 raft_consensus.cc:493] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.962714 26103 raft_consensus.cc:3060] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.968770 26103 raft_consensus.cc:515] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.970675 26103 leader_election.cc:290] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 2 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:43.971676 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7e90455dfe41d0becce4182ca86df2" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:43.971689 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7e90455dfe41d0becce4182ca86df2" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:43.972276 26177 raft_consensus.cc:3055] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:43.972508 26029 raft_consensus.cc:3060] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.972625 26177 raft_consensus.cc:740] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:43.973763 26177 consensus_queue.cc:260] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.975073 26177 raft_consensus.cc:3060] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.978021 26029 raft_consensus.cc:2468] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 2.
I20260709 13:08:43.979188 26068 leader_election.cc:304] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:43.979640 26177 raft_consensus.cc:2468] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 2.
I20260709 13:08:43.979959 26273 raft_consensus.cc:2804] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:43.980501 26273 raft_consensus.cc:697] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 2 LEADER]: Becoming Leader. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Running, Role: LEADER
I20260709 13:08:43.981376 26273 consensus_queue.cc:237] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:43.987978 25925 catalog_manager.cc:5697] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 reported cstate change: term changed from 1 to 2, leader changed from 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195) to f6d4782c3eec4af9a293443bf3401429 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "f6d4782c3eec4af9a293443bf3401429" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.006192 26264 raft_consensus.cc:993] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca: : Instructing follower a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:44.006685 26226 raft_consensus.cc:1081] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Signalling peer a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:44.008215 26029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "445aff88fdce4055b7b73ea9518144c6"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:49256
I20260709 13:08:44.008685 26029 raft_consensus.cc:493] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:44.009012 26029 raft_consensus.cc:3060] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.013495 26029 raft_consensus.cc:515] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:44.015213 26029 leader_election.cc:290] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 2 election: Requested vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:44.016199 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445aff88fdce4055b7b73ea9518144c6" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:44.016330 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445aff88fdce4055b7b73ea9518144c6" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:44.016896 26103 raft_consensus.cc:3060] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.017056 26177 raft_consensus.cc:3055] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:44.017409 26177 raft_consensus.cc:740] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:44.018187 26177 consensus_queue.cc:260] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:44.019064 26177 raft_consensus.cc:3060] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.022675 26103 raft_consensus.cc:2468] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 2.
I20260709 13:08:44.023758 25994 leader_election.cc:304] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:44.024430 26258 raft_consensus.cc:2804] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:44.024937 26258 raft_consensus.cc:697] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:44.024875 26177 raft_consensus.cc:2468] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 2.
I20260709 13:08:44.025859 26258 consensus_queue.cc:237] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:44.031884 25925 catalog_manager.cc:5697] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 1 to 2, leader changed from 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195) to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 2 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.145386 26301 raft_consensus.cc:993] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: : Instructing follower f6d4782c3eec4af9a293443bf3401429 to start an election
I20260709 13:08:44.145931 26258 raft_consensus.cc:1081] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Signalling peer f6d4782c3eec4af9a293443bf3401429 to start an election
I20260709 13:08:44.147575 26103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568"
dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
 from {username='slave'} at 127.0.0.1:51036
I20260709 13:08:44.148192 26103 raft_consensus.cc:493] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:44.148569 26103 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.155905 26103 raft_consensus.cc:515] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:44.157799 26103 leader_election.cc:290] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 2 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:44.158685 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:44.159056 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:44.159258 26029 raft_consensus.cc:3055] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:44.159675 26177 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.159689 26029 raft_consensus.cc:740] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:44.160596 26029 consensus_queue.cc:260] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:44.161635 26029 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.165205 26177 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 2.
I20260709 13:08:44.166386 26029 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 2.
I20260709 13:08:44.166471 26070 leader_election.cc:304] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:44.167193 26273 raft_consensus.cc:2804] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:44.167696 26273 raft_consensus.cc:697] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 2 LEADER]: Becoming Leader. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Running, Role: LEADER
I20260709 13:08:44.168500 26273 consensus_queue.cc:237] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:44.175446 25925 catalog_manager.cc:5697] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 reported cstate change: term changed from 1 to 2, leader changed from a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193) to f6d4782c3eec4af9a293443bf3401429 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "f6d4782c3eec4af9a293443bf3401429" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.308071 26177 raft_consensus.cc:1275] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.309626 26301 consensus_queue.cc:1048] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.317673 26103 raft_consensus.cc:1275] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.318915 26251 consensus_queue.cc:1048] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.375339 26177 raft_consensus.cc:1275] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Refusing update from remote peer f6d4782c3eec4af9a293443bf3401429: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.376793 26308 consensus_queue.cc:1048] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.384516 26029 raft_consensus.cc:1275] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Refusing update from remote peer f6d4782c3eec4af9a293443bf3401429: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.386101 26224 consensus_queue.cc:1048] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.407495 26103 raft_consensus.cc:1275] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.408747 26251 consensus_queue.cc:1048] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.416703 26177 raft_consensus.cc:1275] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.418254 26258 consensus_queue.cc:1048] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.549768 26029 raft_consensus.cc:1275] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Refusing update from remote peer f6d4782c3eec4af9a293443bf3401429: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.551169 26224 consensus_queue.cc:1048] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.559948 26177 raft_consensus.cc:1275] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Refusing update from remote peer f6d4782c3eec4af9a293443bf3401429: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.561614 26272 consensus_queue.cc:1048] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:46.836369 25395 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:08:46.837240 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:46.858244 26029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "184495209f5d41de9538072e9418f62e"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
mode: GRACEFUL
new_leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
 from {username='slave'} at 127.0.0.1:49272
I20260709 13:08:46.858873 26029 raft_consensus.cc:606] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Received request to transfer leadership to TS 9d16148758cb40bfa71e1a3b0649f4ca
I20260709 13:08:46.861496 26029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
mode: GRACEFUL
new_leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
 from {username='slave'} at 127.0.0.1:49272
I20260709 13:08:46.862151 26029 raft_consensus.cc:606] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Received request to transfer leadership to TS 9d16148758cb40bfa71e1a3b0649f4ca
I20260709 13:08:46.863353 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:46.863868 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:46.971266 26251 raft_consensus.cc:993] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: : Instructing follower 9d16148758cb40bfa71e1a3b0649f4ca to start an election
I20260709 13:08:46.971695 26251 raft_consensus.cc:1081] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Signalling peer 9d16148758cb40bfa71e1a3b0649f4ca to start an election
I20260709 13:08:46.973174 26177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36"
dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
 from {username='slave'} at 127.0.0.1:39414
I20260709 13:08:46.973675 26177 raft_consensus.cc:493] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.973978 26177 raft_consensus.cc:3060] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.978497 26177 raft_consensus.cc:515] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:46.980077 26177 leader_election.cc:290] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 2 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:46.980978 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:46.981155 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:46.981612 26029 raft_consensus.cc:3055] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:46.981887 26105 raft_consensus.cc:3060] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.981952 26029 raft_consensus.cc:740] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:46.982811 26029 consensus_queue.cc:260] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:46.983700 26029 raft_consensus.cc:3060] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.986466 26105 raft_consensus.cc:2468] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 2.
I20260709 13:08:46.987875 26143 leader_election.cc:304] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:46.988739 26226 raft_consensus.cc:2804] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:46.989517 26029 raft_consensus.cc:2468] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 2.
I20260709 13:08:46.989890 26226 raft_consensus.cc:697] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 LEADER]: Becoming Leader. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:46.991341 26226 consensus_queue.cc:237] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:46.999449 25925 catalog_manager.cc:5697] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca reported cstate change: term changed from 1 to 2, leader changed from a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193) to 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195). New cstate: current_term: 2 leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.100492 26311 raft_consensus.cc:993] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b: : Instructing follower 9d16148758cb40bfa71e1a3b0649f4ca to start an election
I20260709 13:08:47.101081 26251 raft_consensus.cc:1081] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Signalling peer 9d16148758cb40bfa71e1a3b0649f4ca to start an election
I20260709 13:08:47.102656 26177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "184495209f5d41de9538072e9418f62e"
dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
 from {username='slave'} at 127.0.0.1:39414
I20260709 13:08:47.103093 26177 raft_consensus.cc:493] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.103348 26177 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.108074 26177 raft_consensus.cc:515] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:47.109614 26177 leader_election.cc:290] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 3 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:47.110563 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:47.110836 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:47.111171 26029 raft_consensus.cc:3055] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:47.111436 26105 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.111526 26029 raft_consensus.cc:740] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:47.112385 26029 consensus_queue.cc:260] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:47.113291 26029 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.116602 26105 raft_consensus.cc:2468] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 3.
I20260709 13:08:47.117741 26029 raft_consensus.cc:2468] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 3.
I20260709 13:08:47.117781 26143 leader_election.cc:304] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:47.118666 26226 raft_consensus.cc:2804] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:47.119141 26226 raft_consensus.cc:697] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 LEADER]: Becoming Leader. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:47.119755 26226 consensus_queue.cc:237] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:47.127220 25925 catalog_manager.cc:5697] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca reported cstate change: term changed from 2 to 3, leader changed from a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193) to 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195). New cstate: current_term: 3 leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.529109 26030 raft_consensus.cc:1275] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Refusing update from remote peer 9d16148758cb40bfa71e1a3b0649f4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:47.530565 26226 consensus_queue.cc:1048] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.541217 26105 raft_consensus.cc:1275] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Refusing update from remote peer 9d16148758cb40bfa71e1a3b0649f4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:47.542847 26322 consensus_queue.cc:1048] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.565631 26030 raft_consensus.cc:1275] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Refusing update from remote peer 9d16148758cb40bfa71e1a3b0649f4ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.567049 26322 consensus_queue.cc:1048] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:47.575701 26105 raft_consensus.cc:1275] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Refusing update from remote peer 9d16148758cb40bfa71e1a3b0649f4ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.577189 26312 consensus_queue.cc:1048] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:47.864841 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:47.875794 26177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36"
dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
mode: GRACEFUL
new_leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:08:47.876338 26177 raft_consensus.cc:606] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 LEADER]: Received request to transfer leadership to TS a7eb8c2a624c4ec7a10f60e8b1f6c05b
I20260709 13:08:47.882333 26177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "184495209f5d41de9538072e9418f62e"
dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
mode: GRACEFUL
new_leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:08:47.883020 26177 raft_consensus.cc:606] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 LEADER]: Received request to transfer leadership to TS a7eb8c2a624c4ec7a10f60e8b1f6c05b
I20260709 13:08:47.906452 26105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568"
dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
mode: GRACEFUL
new_leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:08:47.907155 26105 raft_consensus.cc:606] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 2 LEADER]: Received request to transfer leadership to TS a7eb8c2a624c4ec7a10f60e8b1f6c05b
I20260709 13:08:47.913339 26105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc"
dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
mode: GRACEFUL
new_leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:08:47.913988 26105 raft_consensus.cc:606] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 1 LEADER]: Received request to transfer leadership to TS a7eb8c2a624c4ec7a10f60e8b1f6c05b
I20260709 13:08:47.919412 26105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f"
dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
mode: GRACEFUL
new_leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:08:47.919991 26105 raft_consensus.cc:606] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 1 LEADER]: Received request to transfer leadership to TS a7eb8c2a624c4ec7a10f60e8b1f6c05b
I20260709 13:08:48.042301 26319 raft_consensus.cc:993] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429: : Instructing follower a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:48.042819 26330 raft_consensus.cc:1081] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 1 LEADER]: Signalling peer a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:48.044521 26030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:49246
I20260709 13:08:48.044946 26030 raft_consensus.cc:493] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.045189 26030 raft_consensus.cc:3060] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.050025 26030 raft_consensus.cc:515] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.051697 26030 leader_election.cc:290] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 2 election: Requested vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:48.052687 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:48.053292 26177 raft_consensus.cc:3060] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.052695 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:48.054337 26105 raft_consensus.cc:3055] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:48.054721 26105 raft_consensus.cc:740] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Running, Role: LEADER
I20260709 13:08:48.055686 26105 consensus_queue.cc:260] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.056911 26105 raft_consensus.cc:3060] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.060451 26177 raft_consensus.cc:2468] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 2.
I20260709 13:08:48.061617 25995 leader_election.cc:304] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, a7eb8c2a624c4ec7a10f60e8b1f6c05b; no voters: 
I20260709 13:08:48.062461 26251 raft_consensus.cc:2804] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:48.063251 26105 raft_consensus.cc:2468] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 2.
I20260709 13:08:48.063645 26251 raft_consensus.cc:697] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:48.064558 26251 consensus_queue.cc:237] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.072152 25927 catalog_manager.cc:5697] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 1 to 2, leader changed from f6d4782c3eec4af9a293443bf3401429 (127.24.204.194) to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 2 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.122232 26312 raft_consensus.cc:993] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca: : Instructing follower a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:48.122767 26322 raft_consensus.cc:1081] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 LEADER]: Signalling peer a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:48.124214 26030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "184495209f5d41de9538072e9418f62e"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:49256
I20260709 13:08:48.124720 26030 raft_consensus.cc:493] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.125093 26030 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.129621 26030 raft_consensus.cc:515] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.131352 26030 leader_election.cc:290] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 4 election: Requested vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:48.132439 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:48.132359 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184495209f5d41de9538072e9418f62e" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:48.132974 26177 raft_consensus.cc:3055] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:48.133045 26105 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.133386 26177 raft_consensus.cc:740] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:48.134146 26177 consensus_queue.cc:260] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.135246 26177 raft_consensus.cc:3060] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.139678 26105 raft_consensus.cc:2468] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 4.
I20260709 13:08:48.140980 25994 leader_election.cc:304] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:48.141340 26177 raft_consensus.cc:2468] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 4.
I20260709 13:08:48.141921 26251 raft_consensus.cc:2804] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:48.142351 26251 raft_consensus.cc:697] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 4 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:48.143137 26251 consensus_queue.cc:237] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.149006 25927 catalog_manager.cc:5697] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 3 to 4, leader changed from 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195) to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 4 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.150851 26312 raft_consensus.cc:993] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca: : Instructing follower a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:48.151335 26322 raft_consensus.cc:1081] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 LEADER]: Signalling peer a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:48.152841 26030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:49256
I20260709 13:08:48.153373 26030 raft_consensus.cc:493] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.153790 26030 raft_consensus.cc:3060] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.159160 26030 raft_consensus.cc:515] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:48.160795 26030 leader_election.cc:290] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 3 election: Requested vote from peers 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:48.161881 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:48.161881 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb0e81167b4cbbabff9ea0e675aa36" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:48.162616 26177 raft_consensus.cc:3055] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:48.162690 26105 raft_consensus.cc:3060] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.162902 26177 raft_consensus.cc:740] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:48.163475 26177 consensus_queue.cc:260] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:48.164307 26177 raft_consensus.cc:3060] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.167613 26105 raft_consensus.cc:2468] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 3.
I20260709 13:08:48.168644 26177 raft_consensus.cc:2468] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 3.
I20260709 13:08:48.168804 25994 leader_election.cc:304] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:48.169768 26251 raft_consensus.cc:2804] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:48.170348 26251 raft_consensus.cc:697] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:48.170980 26251 consensus_queue.cc:237] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } }
I20260709 13:08:48.176599 25927 catalog_manager.cc:5697] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 2 to 3, leader changed from 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195) to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 3 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.257051 26319 raft_consensus.cc:993] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429: : Instructing follower a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:48.257529 26336 raft_consensus.cc:993] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429: : Instructing follower a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:48.257704 26337 raft_consensus.cc:1081] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 2 LEADER]: Signalling peer a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:48.258203 26319 raft_consensus.cc:1081] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 1 LEADER]: Signalling peer a7eb8c2a624c4ec7a10f60e8b1f6c05b to start an election
I20260709 13:08:48.259498 26029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:49246
I20260709 13:08:48.259894 26030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
 from {username='slave'} at 127.0.0.1:49246
I20260709 13:08:48.260043 26029 raft_consensus.cc:493] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.260450 26030 raft_consensus.cc:493] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.260447 26029 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.260959 26030 raft_consensus.cc:3060] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.265519 26029 raft_consensus.cc:515] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.266498 26030 raft_consensus.cc:515] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.267104 26029 leader_election.cc:290] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 3 election: Requested vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:48.268072 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:48.268213 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:48.268635 26105 raft_consensus.cc:3055] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:48.268680 26177 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.269078 26105 raft_consensus.cc:740] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Running, Role: LEADER
I20260709 13:08:48.269158 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:48.269793 26103 raft_consensus.cc:3055] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:48.270117 26103 raft_consensus.cc:740] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Running, Role: LEADER
I20260709 13:08:48.270249 26030 leader_election.cc:290] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 2 election: Requested vote from peers f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:48.269994 26105 consensus_queue.cc:260] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.270964 26103 consensus_queue.cc:260] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.271462 26178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:48.271986 26103 raft_consensus.cc:3060] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.272019 26178 raft_consensus.cc:3060] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.271286 26105 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.275204 26177 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 3.
I20260709 13:08:48.276269 25995 leader_election.cc:304] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, a7eb8c2a624c4ec7a10f60e8b1f6c05b; no voters: 
I20260709 13:08:48.277158 26251 raft_consensus.cc:2804] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:48.277653 26251 raft_consensus.cc:697] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:48.278664 26105 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 3.
I20260709 13:08:48.278805 26103 raft_consensus.cc:2468] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 2.
I20260709 13:08:48.278545 26251 consensus_queue.cc:237] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.280246 25994 leader_election.cc:304] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7eb8c2a624c4ec7a10f60e8b1f6c05b, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:48.280369 26178 raft_consensus.cc:2468] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7eb8c2a624c4ec7a10f60e8b1f6c05b in term 2.
I20260709 13:08:48.281071 26331 raft_consensus.cc:2804] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:48.282819 26331 raft_consensus.cc:697] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Becoming Leader. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:48.283560 26331 consensus_queue.cc:237] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:48.286499 25927 catalog_manager.cc:5697] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 2 to 3, leader changed from f6d4782c3eec4af9a293443bf3401429 (127.24.204.194) to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 3 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.298621 25927 catalog_manager.cc:5697] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b reported cstate change: term changed from 1 to 2, leader changed from f6d4782c3eec4af9a293443bf3401429 (127.24.204.194) to a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193). New cstate: current_term: 2 leader_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.490733 26103 raft_consensus.cc:1275] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.492107 26331 consensus_queue.cc:1048] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.502796 26178 raft_consensus.cc:1275] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.504451 26331 consensus_queue.cc:1048] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.587934 26103 raft_consensus.cc:1275] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 4 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:48.589881 26339 consensus_queue.cc:1048] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:48.603696 26178 raft_consensus.cc:1275] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 4 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:48.606068 26339 consensus_queue.cc:1048] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.689596 26178 raft_consensus.cc:1275] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.691171 26339 consensus_queue.cc:1048] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.694451 26103 raft_consensus.cc:1275] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:48.695928 26251 consensus_queue.cc:1048] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.706337 26105 raft_consensus.cc:1275] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.707741 26251 consensus_queue.cc:1048] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.716945 26178 raft_consensus.cc:1275] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:48.718556 26339 consensus_queue.cc:1048] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.884905 26103 raft_consensus.cc:1275] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:48.886240 26339 consensus_queue.cc:1048] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.896056 26178 raft_consensus.cc:1275] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Refusing update from remote peer a7eb8c2a624c4ec7a10f60e8b1f6c05b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:48.897921 26339 consensus_queue.cc:1048] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.928038 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:50.936167 26030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
mode: GRACEFUL
new_leader_uuid: "f6d4782c3eec4af9a293443bf3401429"
 from {username='slave'} at 127.0.0.1:49272
I20260709 13:08:50.936790 26030 raft_consensus.cc:606] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Received request to transfer leadership to TS f6d4782c3eec4af9a293443bf3401429
I20260709 13:08:50.939783 26030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
mode: GRACEFUL
new_leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
 from {username='slave'} at 127.0.0.1:49272
I20260709 13:08:50.940351 26030 raft_consensus.cc:606] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 LEADER]: Received request to transfer leadership to TS 9d16148758cb40bfa71e1a3b0649f4ca
I20260709 13:08:50.943301 26030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
mode: GRACEFUL
new_leader_uuid: "f6d4782c3eec4af9a293443bf3401429"
 from {username='slave'} at 127.0.0.1:49272
I20260709 13:08:50.944171 26030 raft_consensus.cc:606] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Received request to transfer leadership to TS f6d4782c3eec4af9a293443bf3401429
I20260709 13:08:50.947358 26030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "822cf0b215a04a21972380eb1cd2ef8d"
dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
mode: GRACEFUL
new_leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
 from {username='slave'} at 127.0.0.1:49272
I20260709 13:08:50.947916 26030 raft_consensus.cc:606] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Received request to transfer leadership to TS 9d16148758cb40bfa71e1a3b0649f4ca
I20260709 13:08:50.949230 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:50.950021 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:51.145057 26331 raft_consensus.cc:993] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b: : Instructing follower f6d4782c3eec4af9a293443bf3401429 to start an election
I20260709 13:08:51.145592 26339 raft_consensus.cc:1081] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Signalling peer f6d4782c3eec4af9a293443bf3401429 to start an election
I20260709 13:08:51.147300 26105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc"
dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
 from {username='slave'} at 127.0.0.1:51036
I20260709 13:08:51.147902 26105 raft_consensus.cc:493] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.148216 26105 raft_consensus.cc:3060] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.153842 26105 raft_consensus.cc:515] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.155977 26105 leader_election.cc:290] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 3 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:51.156939 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:51.157341 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018f68fb988b4014a5bf56372b63b5dc" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:51.157697 26030 raft_consensus.cc:3055] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:51.157869 26177 raft_consensus.cc:3060] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.158069 26030 raft_consensus.cc:740] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:51.158972 26030 consensus_queue.cc:260] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.160351 26030 raft_consensus.cc:3060] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.165337 26177 raft_consensus.cc:2468] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 3.
I20260709 13:08:51.166916 26070 leader_election.cc:304] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:51.167702 26030 raft_consensus.cc:2468] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 3.
I20260709 13:08:51.167974 26319 raft_consensus.cc:2804] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:51.169214 26319 raft_consensus.cc:697] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 3 LEADER]: Becoming Leader. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Running, Role: LEADER
I20260709 13:08:51.170253 26319 consensus_queue.cc:237] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.177172 25927 catalog_manager.cc:5697] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 reported cstate change: term changed from 2 to 3, leader changed from a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193) to f6d4782c3eec4af9a293443bf3401429 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "f6d4782c3eec4af9a293443bf3401429" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.317309 26331 raft_consensus.cc:993] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: : Instructing follower 9d16148758cb40bfa71e1a3b0649f4ca to start an election
I20260709 13:08:51.317816 26331 raft_consensus.cc:1081] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 LEADER]: Signalling peer 9d16148758cb40bfa71e1a3b0649f4ca to start an election
I20260709 13:08:51.319247 26177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568"
dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
 from {username='slave'} at 127.0.0.1:39414
I20260709 13:08:51.319644 26177 raft_consensus.cc:493] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.319893 26177 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.324632 26177 raft_consensus.cc:515] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.326335 26177 leader_election.cc:290] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 4 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:51.326360 26339 raft_consensus.cc:993] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b: : Instructing follower f6d4782c3eec4af9a293443bf3401429 to start an election
I20260709 13:08:51.327217 26339 raft_consensus.cc:1081] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Signalling peer f6d4782c3eec4af9a293443bf3401429 to start an election
I20260709 13:08:51.327181 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:51.327581 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11815ab907f14eb193c3b667d23f0568" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:51.328006 26029 raft_consensus.cc:3055] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:51.328130 26105 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.328361 26029 raft_consensus.cc:740] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:51.328974 26103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f"
dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
 from {username='slave'} at 127.0.0.1:51036
I20260709 13:08:51.329142 26029 consensus_queue.cc:260] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.329478 26103 raft_consensus.cc:493] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.329910 26103 raft_consensus.cc:3060] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.330267 26029 raft_consensus.cc:3060] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.332726 26105 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 4.
I20260709 13:08:51.333940 26143 leader_election.cc:304] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:51.334719 26322 raft_consensus.cc:2804] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:51.335988 26322 raft_consensus.cc:697] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 4 LEADER]: Becoming Leader. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:51.336495 26029 raft_consensus.cc:2468] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 4.
I20260709 13:08:51.336529 26103 raft_consensus.cc:515] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.336869 26322 consensus_queue.cc:237] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.338590 26103 leader_election.cc:290] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 3 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195:44387)
I20260709 13:08:51.339335 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:51.339877 26029 raft_consensus.cc:3055] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:51.340144 26177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5655c36f8c1541158fc4340810f5a73f" candidate_uuid: "f6d4782c3eec4af9a293443bf3401429" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
I20260709 13:08:51.340245 26029 raft_consensus.cc:740] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:51.340695 26177 raft_consensus.cc:3060] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.341176 26029 consensus_queue.cc:260] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.345896 26029 raft_consensus.cc:3060] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.344600 25927 catalog_manager.cc:5697] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca reported cstate change: term changed from 3 to 4, leader changed from a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193) to 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195). New cstate: current_term: 4 leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.349690 26177 raft_consensus.cc:2468] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 3.
I20260709 13:08:51.350796 26070 leader_election.cc:304] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:51.351570 26319 raft_consensus.cc:2804] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:51.352058 26029 raft_consensus.cc:2468] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6d4782c3eec4af9a293443bf3401429 in term 3.
I20260709 13:08:51.352062 26319 raft_consensus.cc:697] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 3 LEADER]: Becoming Leader. State: Replica: f6d4782c3eec4af9a293443bf3401429, State: Running, Role: LEADER
I20260709 13:08:51.353381 26319 consensus_queue.cc:237] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.361440 25927 catalog_manager.cc:5697] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 reported cstate change: term changed from 2 to 3, leader changed from a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193) to f6d4782c3eec4af9a293443bf3401429 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "f6d4782c3eec4af9a293443bf3401429" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.438637 26331 raft_consensus.cc:993] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b: : Instructing follower 9d16148758cb40bfa71e1a3b0649f4ca to start an election
I20260709 13:08:51.439081 26339 raft_consensus.cc:1081] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Signalling peer 9d16148758cb40bfa71e1a3b0649f4ca to start an election
I20260709 13:08:51.440577 26177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "822cf0b215a04a21972380eb1cd2ef8d"
dest_uuid: "9d16148758cb40bfa71e1a3b0649f4ca"
 from {username='slave'} at 127.0.0.1:39414
I20260709 13:08:51.441035 26177 raft_consensus.cc:493] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.441360 26177 raft_consensus.cc:3060] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.445343 26177 raft_consensus.cc:515] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.447558 26029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822cf0b215a04a21972380eb1cd2ef8d" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b"
I20260709 13:08:51.447727 26177 leader_election.cc:290] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 2 election: Requested vote from peers a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089), f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367)
I20260709 13:08:51.447885 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822cf0b215a04a21972380eb1cd2ef8d" candidate_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6d4782c3eec4af9a293443bf3401429"
I20260709 13:08:51.448185 26029 raft_consensus.cc:3055] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:51.448519 26029 raft_consensus.cc:740] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7eb8c2a624c4ec7a10f60e8b1f6c05b, State: Running, Role: LEADER
I20260709 13:08:51.448560 26103 raft_consensus.cc:3060] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.449290 26029 consensus_queue.cc:260] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.450172 26029 raft_consensus.cc:3060] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.452929 26103 raft_consensus.cc:2468] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 2.
I20260709 13:08:51.453869 26143 leader_election.cc:304] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d16148758cb40bfa71e1a3b0649f4ca, f6d4782c3eec4af9a293443bf3401429; no voters: 
I20260709 13:08:51.454172 26029 raft_consensus.cc:2468] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d16148758cb40bfa71e1a3b0649f4ca in term 2.
I20260709 13:08:51.454629 26322 raft_consensus.cc:2804] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:51.455077 26322 raft_consensus.cc:697] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 LEADER]: Becoming Leader. State: Replica: 9d16148758cb40bfa71e1a3b0649f4ca, State: Running, Role: LEADER
I20260709 13:08:51.455837 26322 consensus_queue.cc:237] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } }
I20260709 13:08:51.463063 25927 catalog_manager.cc:5697] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca reported cstate change: term changed from 1 to 2, leader changed from a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193) to 9d16148758cb40bfa71e1a3b0649f4ca (127.24.204.195). New cstate: current_term: 2 leader_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.586167 26177 raft_consensus.cc:1275] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Refusing update from remote peer f6d4782c3eec4af9a293443bf3401429: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:51.587544 26319 consensus_queue.cc:1048] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.598102 26029 raft_consensus.cc:1275] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Refusing update from remote peer f6d4782c3eec4af9a293443bf3401429: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:51.599637 26367 consensus_queue.cc:1048] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.735671 26029 raft_consensus.cc:1275] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Refusing update from remote peer f6d4782c3eec4af9a293443bf3401429: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:51.736873 26367 consensus_queue.cc:1048] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.745460 26177 raft_consensus.cc:1275] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Refusing update from remote peer f6d4782c3eec4af9a293443bf3401429: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:51.746752 26319 consensus_queue.cc:1048] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d16148758cb40bfa71e1a3b0649f4ca" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:51.825299 26029 raft_consensus.cc:1275] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 4 FOLLOWER]: Refusing update from remote peer 9d16148758cb40bfa71e1a3b0649f4ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:51.826807 26322 consensus_queue.cc:1048] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:51.839387 26103 raft_consensus.cc:1275] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 4 FOLLOWER]: Refusing update from remote peer 9d16148758cb40bfa71e1a3b0649f4ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:51.840876 26361 consensus_queue.cc:1048] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:51.923048 26029 raft_consensus.cc:1275] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Refusing update from remote peer 9d16148758cb40bfa71e1a3b0649f4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:51.924578 26361 consensus_queue.cc:1048] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7eb8c2a624c4ec7a10f60e8b1f6c05b" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 36089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.934146 26103 raft_consensus.cc:1275] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Refusing update from remote peer 9d16148758cb40bfa71e1a3b0649f4ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:51.935551 26361 consensus_queue.cc:1048] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6d4782c3eec4af9a293443bf3401429" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 44367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.950879 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:51.956445 25395 tablet_server.cc:179] TabletServer@127.24.204.193:0 shutting down...
I20260709 13:08:51.986647 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:51.987514 25395 tablet_replica.cc:333] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: stopping tablet replica
I20260709 13:08:51.988229 25395 raft_consensus.cc:2243] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.988842 25395 raft_consensus.cc:2272] T 2ed18719260a4d38a94f5f0c089af721 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.991096 25395 tablet_replica.cc:333] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: stopping tablet replica
I20260709 13:08:51.991726 25395 raft_consensus.cc:2243] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.992238 25395 raft_consensus.cc:2272] T bd7e90455dfe41d0becce4182ca86df2 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.994341 25395 tablet_replica.cc:333] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b: stopping tablet replica
I20260709 13:08:51.994874 25395 raft_consensus.cc:2243] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.995333 25395 raft_consensus.cc:2272] T 5655c36f8c1541158fc4340810f5a73f P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.997545 25395 tablet_replica.cc:333] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: stopping tablet replica
I20260709 13:08:51.998212 25395 raft_consensus.cc:2243] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.998672 25395 raft_consensus.cc:2272] T 11815ab907f14eb193c3b667d23f0568 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.000907 25395 tablet_replica.cc:333] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: stopping tablet replica
I20260709 13:08:52.001468 25395 raft_consensus.cc:2243] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.002329 25395 raft_consensus.cc:2272] T dd0b2700bc8145a49e260b8233d98d04 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.004622 25395 tablet_replica.cc:333] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: stopping tablet replica
I20260709 13:08:52.005249 25395 raft_consensus.cc:2243] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.006060 25395 raft_consensus.cc:2272] T 32eb0e81167b4cbbabff9ea0e675aa36 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.007854 25395 tablet_replica.cc:333] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b: stopping tablet replica
I20260709 13:08:52.008488 25395 raft_consensus.cc:2243] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.009150 25395 raft_consensus.cc:2272] T 184495209f5d41de9538072e9418f62e P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.010927 25395 tablet_replica.cc:333] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b: stopping tablet replica
I20260709 13:08:52.011372 25395 raft_consensus.cc:2243] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.011761 25395 raft_consensus.cc:2272] T 018f68fb988b4014a5bf56372b63b5dc P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.014074 25395 tablet_replica.cc:333] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b: stopping tablet replica
I20260709 13:08:52.014532 25395 raft_consensus.cc:2243] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.014904 25395 raft_consensus.cc:2272] T 822cf0b215a04a21972380eb1cd2ef8d P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.017058 25395 tablet_replica.cc:333] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b: stopping tablet replica
I20260709 13:08:52.017673 25395 raft_consensus.cc:2243] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.018432 25395 raft_consensus.cc:2272] T 445aff88fdce4055b7b73ea9518144c6 P a7eb8c2a624c4ec7a10f60e8b1f6c05b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:52.031708 25993 connection.cc:466] server connection from 127.0.0.1:49246 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49246 (request call id 68) could send its response
W20260709 13:08:52.032855 26068 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.204.193:36089 (error 108) [suppressed 4 similar messages]
W20260709 13:08:52.039367 26068 consensus_peers.cc:597] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 -> Peer a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089): Couldn't send request to peer a7eb8c2a624c4ec7a10f60e8b1f6c05b. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:36089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:52.041379 25395 tablet_server.cc:196] TabletServer@127.24.204.193:0 shutdown complete.
I20260709 13:08:52.061898 25395 tablet_server.cc:179] TabletServer@127.24.204.194:0 shutting down...
I20260709 13:08:52.087074 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:52.087857 25395 tablet_replica.cc:333] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429: stopping tablet replica
I20260709 13:08:52.088667 25395 raft_consensus.cc:2243] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.089171 25395 raft_consensus.cc:2272] T 2ed18719260a4d38a94f5f0c089af721 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.091041 25395 tablet_replica.cc:333] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429: stopping tablet replica
I20260709 13:08:52.091560 25395 raft_consensus.cc:2243] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.092340 25395 raft_consensus.cc:2272] T bd7e90455dfe41d0becce4182ca86df2 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.094091 25395 tablet_replica.cc:333] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429: stopping tablet replica
I20260709 13:08:52.094614 25395 raft_consensus.cc:2243] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.095038 25395 raft_consensus.cc:2272] T 11815ab907f14eb193c3b667d23f0568 P f6d4782c3eec4af9a293443bf3401429 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.097195 25395 tablet_replica.cc:333] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429: stopping tablet replica
I20260709 13:08:52.097751 25395 raft_consensus.cc:2243] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.098449 25395 raft_consensus.cc:2272] T 5655c36f8c1541158fc4340810f5a73f P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.100382 25395 tablet_replica.cc:333] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429: stopping tablet replica
I20260709 13:08:52.100988 25395 raft_consensus.cc:2243] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.101408 25395 raft_consensus.cc:2272] T 32eb0e81167b4cbbabff9ea0e675aa36 P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.103084 25395 tablet_replica.cc:333] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429: stopping tablet replica
I20260709 13:08:52.103554 25395 raft_consensus.cc:2243] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.103946 25395 raft_consensus.cc:2272] T dd0b2700bc8145a49e260b8233d98d04 P f6d4782c3eec4af9a293443bf3401429 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.105515 25395 tablet_replica.cc:333] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429: stopping tablet replica
I20260709 13:08:52.106051 25395 raft_consensus.cc:2243] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.106438 25395 raft_consensus.cc:2272] T 184495209f5d41de9538072e9418f62e P f6d4782c3eec4af9a293443bf3401429 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.108109 25395 tablet_replica.cc:333] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429: stopping tablet replica
I20260709 13:08:52.108564 25395 raft_consensus.cc:2243] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.109290 25395 raft_consensus.cc:2272] T 018f68fb988b4014a5bf56372b63b5dc P f6d4782c3eec4af9a293443bf3401429 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.111294 25395 tablet_replica.cc:333] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429: stopping tablet replica
I20260709 13:08:52.111770 25395 raft_consensus.cc:2243] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.112171 25395 raft_consensus.cc:2272] T 822cf0b215a04a21972380eb1cd2ef8d P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.114382 25395 tablet_replica.cc:333] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429: stopping tablet replica
I20260709 13:08:52.114817 25395 raft_consensus.cc:2243] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.115243 25395 raft_consensus.cc:2272] T 445aff88fdce4055b7b73ea9518144c6 P f6d4782c3eec4af9a293443bf3401429 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:52.137648 26142 consensus_peers.cc:597] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca -> Peer a7eb8c2a624c4ec7a10f60e8b1f6c05b (127.24.204.193:36089): Couldn't send request to peer a7eb8c2a624c4ec7a10f60e8b1f6c05b. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:36089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:52.143901 25395 tablet_server.cc:196] TabletServer@127.24.204.194:0 shutdown complete.
I20260709 13:08:52.162567 25395 tablet_server.cc:179] TabletServer@127.24.204.195:0 shutting down...
W20260709 13:08:52.183876 26143 consensus_peers.cc:597] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca -> Peer f6d4782c3eec4af9a293443bf3401429 (127.24.204.194:44367): Couldn't send request to peer f6d4782c3eec4af9a293443bf3401429. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:44367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:52.191938 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:52.192786 25395 tablet_replica.cc:333] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca: stopping tablet replica
I20260709 13:08:52.193522 25395 raft_consensus.cc:2243] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.194461 25395 raft_consensus.cc:2272] T 2ed18719260a4d38a94f5f0c089af721 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.196607 25395 tablet_replica.cc:333] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca: stopping tablet replica
I20260709 13:08:52.197201 25395 raft_consensus.cc:2243] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.197757 25395 raft_consensus.cc:2272] T bd7e90455dfe41d0becce4182ca86df2 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.200739 25395 tablet_replica.cc:333] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca: stopping tablet replica
I20260709 13:08:52.201339 25395 raft_consensus.cc:2243] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.201826 25395 raft_consensus.cc:2272] T 5655c36f8c1541158fc4340810f5a73f P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.203946 25395 tablet_replica.cc:333] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca: stopping tablet replica
I20260709 13:08:52.204520 25395 raft_consensus.cc:2243] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.205247 25395 raft_consensus.cc:2272] T 11815ab907f14eb193c3b667d23f0568 P 9d16148758cb40bfa71e1a3b0649f4ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.207494 25395 tablet_replica.cc:333] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca: stopping tablet replica
I20260709 13:08:52.208078 25395 raft_consensus.cc:2243] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.208462 25395 raft_consensus.cc:2272] T 32eb0e81167b4cbbabff9ea0e675aa36 P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.210108 25395 tablet_replica.cc:333] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca: stopping tablet replica
I20260709 13:08:52.210563 25395 raft_consensus.cc:2243] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.210917 25395 raft_consensus.cc:2272] T dd0b2700bc8145a49e260b8233d98d04 P 9d16148758cb40bfa71e1a3b0649f4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.212570 25395 tablet_replica.cc:333] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca: stopping tablet replica
I20260709 13:08:52.213013 25395 raft_consensus.cc:2243] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.213405 25395 raft_consensus.cc:2272] T 445aff88fdce4055b7b73ea9518144c6 P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.215019 25395 tablet_replica.cc:333] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca: stopping tablet replica
I20260709 13:08:52.215441 25395 raft_consensus.cc:2243] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.215766 25395 raft_consensus.cc:2272] T 018f68fb988b4014a5bf56372b63b5dc P 9d16148758cb40bfa71e1a3b0649f4ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.217900 25395 tablet_replica.cc:333] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca: stopping tablet replica
I20260709 13:08:52.218321 25395 raft_consensus.cc:2243] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.218984 25395 raft_consensus.cc:2272] T 822cf0b215a04a21972380eb1cd2ef8d P 9d16148758cb40bfa71e1a3b0649f4ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.221200 25395 tablet_replica.cc:333] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca: stopping tablet replica
I20260709 13:08:52.221766 25395 raft_consensus.cc:2243] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:52.222143 25395 raft_consensus.cc:2272] T 184495209f5d41de9538072e9418f62e P 9d16148758cb40bfa71e1a3b0649f4ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.250800 25395 tablet_server.cc:196] TabletServer@127.24.204.195:0 shutdown complete.
I20260709 13:08:52.270439 25395 master.cc:562] Master@127.24.204.254:36669 shutting down...
I20260709 13:08:52.293037 25395 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.293726 25395 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.294019 25395 tablet_replica.cc:333] T 00000000000000000000000000000000 P 71339cf6b43d4578aab1274104b4a93e: stopping tablet replica
I20260709 13:08:52.315245 25395 master.cc:584] Master@127.24.204.254:36669 shutdown complete.
9d16148758cb40bfa71e1a3b0649f4ca  1
a7eb8c2a624c4ec7a10f60e8b1f6c05b  5
f6d4782c3eec4af9a293443bf3401429  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10830 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:08:52.356761 25395 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.204.254:32835
I20260709 13:08:52.358075 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.364414 26383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.364653 26384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.365567 26386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.366434 25395 server_base.cc:1061] running on GCE node
I20260709 13:08:52.367352 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.367537 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.367650 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602532367639 us; error 0 us; skew 500 ppm
I20260709 13:08:52.368136 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.370697 25395 webserver.cc:533] Webserver started at http://127.24.204.254:43485/ using document root <none> and password file <none>
I20260709 13:08:52.371130 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:52.371280 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:52.371500 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:52.372546 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/master-0-root/instance:
uuid: "6b5d6a3be49c419aa4980b2ed2efd28a"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-qv7r"
I20260709 13:08:52.377089 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:08:52.380555 26391 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.381309 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:08:52.381659 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/master-0-root
uuid: "6b5d6a3be49c419aa4980b2ed2efd28a"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-qv7r"
I20260709 13:08:52.381950 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:52.395936 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:52.397171 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:52.439016 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.254:32835
I20260709 13:08:52.439177 26442 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.254:32835 every 8 connection(s)
I20260709 13:08:52.443424 26443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.454167 26443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Bootstrap starting.
I20260709 13:08:52.459391 26443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.464249 26443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: No bootstrap required, opened a new log
I20260709 13:08:52.466602 26443 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5d6a3be49c419aa4980b2ed2efd28a" member_type: VOTER }
I20260709 13:08:52.467001 26443 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.467295 26443 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5d6a3be49c419aa4980b2ed2efd28a, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.467960 26443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5d6a3be49c419aa4980b2ed2efd28a" member_type: VOTER }
I20260709 13:08:52.468505 26443 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:52.468755 26443 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:52.469079 26443 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:52.473670 26443 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5d6a3be49c419aa4980b2ed2efd28a" member_type: VOTER }
I20260709 13:08:52.474367 26443 leader_election.cc:304] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b5d6a3be49c419aa4980b2ed2efd28a; no voters: 
I20260709 13:08:52.475607 26443 leader_election.cc:290] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:52.476115 26446 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:52.477521 26446 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 1 LEADER]: Becoming Leader. State: Replica: 6b5d6a3be49c419aa4980b2ed2efd28a, State: Running, Role: LEADER
I20260709 13:08:52.478212 26446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5d6a3be49c419aa4980b2ed2efd28a" member_type: VOTER }
I20260709 13:08:52.478820 26443 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:52.483893 26448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b5d6a3be49c419aa4980b2ed2efd28a. Latest consensus state: current_term: 1 leader_uuid: "6b5d6a3be49c419aa4980b2ed2efd28a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5d6a3be49c419aa4980b2ed2efd28a" member_type: VOTER } }
I20260709 13:08:52.483749 26447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b5d6a3be49c419aa4980b2ed2efd28a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5d6a3be49c419aa4980b2ed2efd28a" member_type: VOTER } }
I20260709 13:08:52.484602 26448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:52.484987 26447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:52.486910 26453 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:52.491921 26453 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:52.496583 25395 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:52.500976 26453 catalog_manager.cc:1383] Generated new cluster ID: f7c7002ff5b14cb0aeda4a18f685b143
I20260709 13:08:52.501307 26453 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:52.534017 26453 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:52.535283 26453 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:52.550395 26453 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Generated new TSK 0
I20260709 13:08:52.551035 26453 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:52.564705 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.572201 26465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.572183 26464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.574267 26467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.575294 25395 server_base.cc:1061] running on GCE node
I20260709 13:08:52.576176 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.576360 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.576481 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602532576468 us; error 0 us; skew 500 ppm
I20260709 13:08:52.576938 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.579473 25395 webserver.cc:533] Webserver started at http://127.24.204.193:40015/ using document root <none> and password file <none>
I20260709 13:08:52.580017 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:52.580232 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:52.580454 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:52.581491 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/instance:
uuid: "b9c3761688a64982ae1c4aeb758e09ef"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-qv7r"
I20260709 13:08:52.586148 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:08:52.589684 26472 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.590608 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:52.590943 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root
uuid: "b9c3761688a64982ae1c4aeb758e09ef"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-qv7r"
I20260709 13:08:52.591219 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:52.625546 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:52.626919 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:52.628472 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:52.630826 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:52.631058 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.631325 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:52.631546 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.675753 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.193:37907
I20260709 13:08:52.675884 26534 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.193:37907 every 8 connection(s)
I20260709 13:08:52.680611 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.689252 26539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.692500 26540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.692654 26542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.695403 25395 server_base.cc:1061] running on GCE node
I20260709 13:08:52.696977 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.697288 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.697510 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602532697492 us; error 0 us; skew 500 ppm
I20260709 13:08:52.698313 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.699153 26535 heartbeater.cc:344] Connected to a master server at 127.24.204.254:32835
I20260709 13:08:52.699597 26535 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:52.700392 26535 heartbeater.cc:507] Master 127.24.204.254:32835 requested a full tablet report, sending...
I20260709 13:08:52.701006 25395 webserver.cc:533] Webserver started at http://127.24.204.194:41409/ using document root <none> and password file <none>
I20260709 13:08:52.701670 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:52.701946 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:52.702287 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:52.702700 26408 ts_manager.cc:194] Registered new tserver with Master: b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:08:52.703646 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/instance:
uuid: "ef2886777a8f45e69e213b02a22ecec7"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-qv7r"
I20260709 13:08:52.704603 26408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34738
I20260709 13:08:52.708851 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:08:52.712906 26547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.713958 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:08:52.714277 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root
uuid: "ef2886777a8f45e69e213b02a22ecec7"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-qv7r"
I20260709 13:08:52.714524 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:52.733493 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:52.734967 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:52.736578 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:52.739073 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:52.739319 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.739591 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:52.739794 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.787773 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.194:33025
I20260709 13:08:52.787873 26609 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.194:33025 every 8 connection(s)
I20260709 13:08:52.792654 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.799749 26613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.800375 26614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.804338 26617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.804957 25395 server_base.cc:1061] running on GCE node
I20260709 13:08:52.805229 26610 heartbeater.cc:344] Connected to a master server at 127.24.204.254:32835
I20260709 13:08:52.805666 26610 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:52.805979 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.806222 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.806411 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602532806395 us; error 0 us; skew 500 ppm
I20260709 13:08:52.806468 26610 heartbeater.cc:507] Master 127.24.204.254:32835 requested a full tablet report, sending...
I20260709 13:08:52.807013 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.808701 26408 ts_manager.cc:194] Registered new tserver with Master: ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:52.809681 25395 webserver.cc:533] Webserver started at http://127.24.204.195:35223/ using document root <none> and password file <none>
I20260709 13:08:52.810191 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:52.810415 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:52.810276 26408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34748
I20260709 13:08:52.810782 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:52.812016 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/instance:
uuid: "af1b5d6d444447b7a580afb4aff33320"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-qv7r"
I20260709 13:08:52.816650 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:52.820418 26621 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.821345 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:08:52.821741 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root
uuid: "af1b5d6d444447b7a580afb4aff33320"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-qv7r"
I20260709 13:08:52.822098 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:52.846518 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:52.847852 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:52.849502 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:52.851948 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:52.852154 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.852439 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:52.852666 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.899402 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.195:34711
I20260709 13:08:52.899502 26683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.195:34711 every 8 connection(s)
I20260709 13:08:52.915177 26684 heartbeater.cc:344] Connected to a master server at 127.24.204.254:32835
I20260709 13:08:52.915614 26684 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:52.916479 26684 heartbeater.cc:507] Master 127.24.204.254:32835 requested a full tablet report, sending...
I20260709 13:08:52.919163 26408 ts_manager.cc:194] Registered new tserver with Master: af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:52.920248 25395 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017200082s
I20260709 13:08:52.920936 26408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34762
I20260709 13:08:52.950089 26408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34776:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:52.957039 26408 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:53.169049 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 41780cfc14f24065b0d12741153c5b15 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:53.169893 26574 tablet_service.cc:1511] Processing CreateTablet for tablet 9b74cbdc379342d4832425ebe52bbac5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:53.170614 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41780cfc14f24065b0d12741153c5b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.171233 26574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b74cbdc379342d4832425ebe52bbac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.187713 26500 tablet_service.cc:1511] Processing CreateTablet for tablet 41780cfc14f24065b0d12741153c5b15 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:53.188060 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 9b74cbdc379342d4832425ebe52bbac5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:53.190948 26498 tablet_service.cc:1511] Processing CreateTablet for tablet 7fdbcbb3a7ce412c93c07413fe11793f (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:53.189360 26500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41780cfc14f24065b0d12741153c5b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.193933 26573 tablet_service.cc:1511] Processing CreateTablet for tablet 7fdbcbb3a7ce412c93c07413fe11793f (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:53.195300 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b74cbdc379342d4832425ebe52bbac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.196694 26649 tablet_service.cc:1511] Processing CreateTablet for tablet 41780cfc14f24065b0d12741153c5b15 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:53.196944 26572 tablet_service.cc:1511] Processing CreateTablet for tablet f79cbcb2b1924d9c9e584d9a32e92bfa (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:53.197942 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fdbcbb3a7ce412c93c07413fe11793f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.198258 26649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41780cfc14f24065b0d12741153c5b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.195307 26573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fdbcbb3a7ce412c93c07413fe11793f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.202050 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79cbcb2b1924d9c9e584d9a32e92bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.203960 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 9b74cbdc379342d4832425ebe52bbac5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:53.205633 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b74cbdc379342d4832425ebe52bbac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.207983 26571 tablet_service.cc:1511] Processing CreateTablet for tablet 574d2707e806420dab53495563bd03aa (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:53.210819 26570 tablet_service.cc:1511] Processing CreateTablet for tablet 479f20ff71c04b8ea8eea5b4f8c922ff (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:53.212284 26647 tablet_service.cc:1511] Processing CreateTablet for tablet 7fdbcbb3a7ce412c93c07413fe11793f (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:53.213122 26569 tablet_service.cc:1511] Processing CreateTablet for tablet fa6a5d55926746d28b7b8b8862f40c10 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:53.215158 26646 tablet_service.cc:1511] Processing CreateTablet for tablet f79cbcb2b1924d9c9e584d9a32e92bfa (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:53.216200 26568 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcf073468e44507a058097dedeaa5df (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:53.216861 26647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fdbcbb3a7ce412c93c07413fe11793f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.218408 26567 tablet_service.cc:1511] Processing CreateTablet for tablet 7672ae1d65b4497686627cb041189424 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:53.220569 26566 tablet_service.cc:1511] Processing CreateTablet for tablet 15ce1ae648ca45aba8c6efb73a35ae9e (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:53.221969 26646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79cbcb2b1924d9c9e584d9a32e92bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.222637 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574d2707e806420dab53495563bd03aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.226894 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 574d2707e806420dab53495563bd03aa (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:53.228178 26566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ce1ae648ca45aba8c6efb73a35ae9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.228531 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574d2707e806420dab53495563bd03aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.231268 26644 tablet_service.cc:1511] Processing CreateTablet for tablet 479f20ff71c04b8ea8eea5b4f8c922ff (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:53.234078 26567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7672ae1d65b4497686627cb041189424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.234623 26643 tablet_service.cc:1511] Processing CreateTablet for tablet fa6a5d55926746d28b7b8b8862f40c10 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:53.236169 26570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479f20ff71c04b8ea8eea5b4f8c922ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.241995 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479f20ff71c04b8ea8eea5b4f8c922ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.242020 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6a5d55926746d28b7b8b8862f40c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.245954 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6a5d55926746d28b7b8b8862f40c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.245889 26568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcf073468e44507a058097dedeaa5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.249855 26642 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcf073468e44507a058097dedeaa5df (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:53.251302 26642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcf073468e44507a058097dedeaa5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.255190 26641 tablet_service.cc:1511] Processing CreateTablet for tablet 7672ae1d65b4497686627cb041189424 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:53.256784 26641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7672ae1d65b4497686627cb041189424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.267238 26640 tablet_service.cc:1511] Processing CreateTablet for tablet 15ce1ae648ca45aba8c6efb73a35ae9e (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:53.268713 26640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ce1ae648ca45aba8c6efb73a35ae9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.271550 26497 tablet_service.cc:1511] Processing CreateTablet for tablet f79cbcb2b1924d9c9e584d9a32e92bfa (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:53.273037 26494 tablet_service.cc:1511] Processing CreateTablet for tablet fa6a5d55926746d28b7b8b8862f40c10 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:53.273048 26497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79cbcb2b1924d9c9e584d9a32e92bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.284482 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6a5d55926746d28b7b8b8862f40c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.289436 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 574d2707e806420dab53495563bd03aa (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:53.290992 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574d2707e806420dab53495563bd03aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.276015 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 479f20ff71c04b8ea8eea5b4f8c922ff (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:53.277172 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcf073468e44507a058097dedeaa5df (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:53.278224 26492 tablet_service.cc:1511] Processing CreateTablet for tablet 7672ae1d65b4497686627cb041189424 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:53.279366 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 15ce1ae648ca45aba8c6efb73a35ae9e (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:53.293443 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479f20ff71c04b8ea8eea5b4f8c922ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.306025 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcf073468e44507a058097dedeaa5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.307559 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7672ae1d65b4497686627cb041189424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.308975 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ce1ae648ca45aba8c6efb73a35ae9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.356629 26699 tablet_bootstrap.cc:492] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:53.384233 26700 tablet_bootstrap.cc:492] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:53.384912 26699 tablet_bootstrap.cc:654] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.394501 26568 tablet_service.cc:1511] Processing CreateTablet for tablet e14f699cfba34b90b5f92484e9fd0ddc (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:53.395931 26568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14f699cfba34b90b5f92484e9fd0ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.396338 26566 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5c3addfbab45deb9fc008aee1b7ea5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:53.403270 26498 tablet_service.cc:1511] Processing CreateTablet for tablet 54cd8d698474498090aabe4448aa2a2b (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:53.404340 26646 tablet_service.cc:1511] Processing CreateTablet for tablet 274eefdb88c143849b4b07f0d6ffcdc0 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:53.405632 26646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274eefdb88c143849b4b07f0d6ffcdc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.406124 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54cd8d698474498090aabe4448aa2a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.397676 26566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5c3addfbab45deb9fc008aee1b7ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.412730 26700 tablet_bootstrap.cc:654] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.408916 26499 tablet_service.cc:1511] Processing CreateTablet for tablet e14f699cfba34b90b5f92484e9fd0ddc (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:53.403546 26640 tablet_service.cc:1511] Processing CreateTablet for tablet 54cd8d698474498090aabe4448aa2a2b (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:53.420564 26649 tablet_service.cc:1511] Processing CreateTablet for tablet e14f699cfba34b90b5f92484e9fd0ddc (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:53.423821 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 54cd8d698474498090aabe4448aa2a2b (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:53.452275 26641 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5c3addfbab45deb9fc008aee1b7ea5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:53.452276 26569 tablet_service.cc:1511] Processing CreateTablet for tablet 274eefdb88c143849b4b07f0d6ffcdc0 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:53.456982 26572 tablet_service.cc:1511] Processing CreateTablet for tablet 057c1e97d7fb407aaf9cf119a0b63a37 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:53.460246 26570 tablet_service.cc:1511] Processing CreateTablet for tablet 30ffd86793fb4eab863861f1047dec1e (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:53.463153 26649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14f699cfba34b90b5f92484e9fd0ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.465530 26573 tablet_service.cc:1511] Processing CreateTablet for tablet 941b69cce0d24bb9a4f60558447429c4 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:53.470099 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14f699cfba34b90b5f92484e9fd0ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.470144 26567 tablet_service.cc:1511] Processing CreateTablet for tablet a78e2d37ffa144e9ae8e64979146f436 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:53.473763 26500 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb26f1d881541f898a5a148f7f74144 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:53.475077 26500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb26f1d881541f898a5a148f7f74144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.475178 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 30ffd86793fb4eab863861f1047dec1e (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:53.473763 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 274eefdb88c143849b4b07f0d6ffcdc0 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:53.476433 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ffd86793fb4eab863861f1047dec1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.482957 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274eefdb88c143849b4b07f0d6ffcdc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.485517 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274eefdb88c143849b4b07f0d6ffcdc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.501533 26640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54cd8d698474498090aabe4448aa2a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.483457 26574 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb26f1d881541f898a5a148f7f74144 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:53.508080 26699 tablet_bootstrap.cc:492] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:53.507853 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb26f1d881541f898a5a148f7f74144 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:53.508596 26699 ts_tablet_manager.cc:1403] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.016s
I20260709 13:08:53.511309 26642 tablet_service.cc:1511] Processing CreateTablet for tablet 30ffd86793fb4eab863861f1047dec1e (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:53.512627 26642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ffd86793fb4eab863861f1047dec1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.504212 26570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ffd86793fb4eab863861f1047dec1e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:53.515424 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:53.515113 26643 tablet_service.cc:1511] Processing CreateTablet for tablet 108a6730154b42819badee4f37f31ad8 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:53.475200 26497 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5c3addfbab45deb9fc008aee1b7ea5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:53.520645 26699 raft_consensus.cc:359] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } }
I20260709 13:08:53.520921 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 057c1e97d7fb407aaf9cf119a0b63a37 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:53.534428 26699 raft_consensus.cc:385] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.537046 26699 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.526880 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 057c1e97d7fb407aaf9cf119a0b63a37 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:53.521325 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb26f1d881541f898a5a148f7f74144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.539554 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108a6730154b42819badee4f37f31ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.539554 26702 tablet_bootstrap.cc:492] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:53.541074 26641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5c3addfbab45deb9fc008aee1b7ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.518235 26573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941b69cce0d24bb9a4f60558447429c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.538069 26699 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } }
I20260709 13:08:53.544632 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057c1e97d7fb407aaf9cf119a0b63a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.548807 26492 tablet_service.cc:1511] Processing CreateTablet for tablet a78e2d37ffa144e9ae8e64979146f436 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:53.525025 26497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5c3addfbab45deb9fc008aee1b7ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.557816 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057c1e97d7fb407aaf9cf119a0b63a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.559942 26644 tablet_service.cc:1511] Processing CreateTablet for tablet a78e2d37ffa144e9ae8e64979146f436 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:53.561494 26571 tablet_service.cc:1511] Processing CreateTablet for tablet f6d05596fdb0401faeb202a1f8740d44 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:53.573705 26649 tablet_service.cc:1511] Processing CreateTablet for tablet f6d05596fdb0401faeb202a1f8740d44 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:53.574765 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78e2d37ffa144e9ae8e64979146f436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.575978 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78e2d37ffa144e9ae8e64979146f436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.572732 26647 tablet_service.cc:1511] Processing CreateTablet for tablet 941b69cce0d24bb9a4f60558447429c4 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:53.578176 26647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941b69cce0d24bb9a4f60558447429c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.583909 26649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d05596fdb0401faeb202a1f8740d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.590021 26568 tablet_service.cc:1511] Processing CreateTablet for tablet 108a6730154b42819badee4f37f31ad8 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:53.593986 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 941b69cce0d24bb9a4f60558447429c4 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:53.603904 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941b69cce0d24bb9a4f60558447429c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.608177 26643 tablet_service.cc:1511] Processing CreateTablet for tablet ffb5488a21bd418b96b52a8ab8a2e669 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:53.596256 26493 tablet_service.cc:1511] Processing CreateTablet for tablet f6d05596fdb0401faeb202a1f8740d44 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:53.598763 26646 tablet_service.cc:1511] Processing CreateTablet for tablet b1b4bf10cd16491e8819a9dce5192276 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:53.601938 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d05596fdb0401faeb202a1f8740d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.615340 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d05596fdb0401faeb202a1f8740d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.620679 26567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78e2d37ffa144e9ae8e64979146f436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.620038 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffb5488a21bd418b96b52a8ab8a2e669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.627787 26646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b4bf10cd16491e8819a9dce5192276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.633381 26499 tablet_service.cc:1511] Processing CreateTablet for tablet b1b4bf10cd16491e8819a9dce5192276 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:53.635133 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057c1e97d7fb407aaf9cf119a0b63a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.637036 26702 tablet_bootstrap.cc:654] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.645077 26699 ts_tablet_manager.cc:1434] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.136s	user 0.011s	sys 0.010s
I20260709 13:08:53.646538 26610 heartbeater.cc:499] Master 127.24.204.254:32835 was elected leader, sending a full tablet report...
I20260709 13:08:53.649850 26498 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce4b86f29b4456dba024f24f29091e4 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:53.659376 26704 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.664108 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b4bf10cd16491e8819a9dce5192276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.662792 26699 tablet_bootstrap.cc:492] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:53.666678 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54cd8d698474498090aabe4448aa2a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.669800 26497 tablet_service.cc:1511] Processing CreateTablet for tablet 108a6730154b42819badee4f37f31ad8 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:53.683337 26700 tablet_bootstrap.cc:492] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:53.643230 26492 tablet_service.cc:1511] Processing CreateTablet for tablet ffb5488a21bd418b96b52a8ab8a2e669 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:53.678484 26640 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce4b86f29b4456dba024f24f29091e4 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:53.682186 26500 tablet_service.cc:1511] Processing CreateTablet for tablet 0edde491935742d4b076995932d10cc9 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:53.660045 26704 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } }
I20260709 13:08:53.690687 26700 ts_tablet_manager.cc:1403] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.307s	user 0.004s	sys 0.023s
I20260709 13:08:53.701735 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce4b86f29b4456dba024f24f29091e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.707362 26535 heartbeater.cc:499] Master 127.24.204.254:32835 was elected leader, sending a full tablet report...
I20260709 13:08:53.707880 26704 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:08:53.724220 26571 tablet_service.cc:1511] Processing CreateTablet for tablet b1b4bf10cd16491e8819a9dce5192276 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:53.720990 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 0edde491935742d4b076995932d10cc9 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:53.745751 26647 tablet_service.cc:1511] Processing CreateTablet for tablet 32c8792823e44557bace909d8b20d9eb (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:53.748497 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 01228e22d88047b6bc2f5a6b74aa2b51 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:53.755012 26573 tablet_service.cc:1511] Processing CreateTablet for tablet ffb5488a21bd418b96b52a8ab8a2e669 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:53.734666 26568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108a6730154b42819badee4f37f31ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.777822 26497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108a6730154b42819badee4f37f31ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.784564 26641 tablet_service.cc:1511] Processing CreateTablet for tablet 9b26ae30d0734e338bc81b8d9f963b67 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:53.785964 26640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce4b86f29b4456dba024f24f29091e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.796546 26700 raft_consensus.cc:359] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:53.791922 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffb5488a21bd418b96b52a8ab8a2e669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.791431 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 01228e22d88047b6bc2f5a6b74aa2b51 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:53.797376 26700 raft_consensus.cc:385] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.798722 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0edde491935742d4b076995932d10cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.807039 26647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c8792823e44557bace909d8b20d9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.808328 26700 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.809245 26700 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:53.813839 26574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb26f1d881541f898a5a148f7f74144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.845541 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01228e22d88047b6bc2f5a6b74aa2b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.849661 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b4bf10cd16491e8819a9dce5192276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.852083 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 32c8792823e44557bace909d8b20d9eb (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:53.859613 26702 tablet_bootstrap.cc:492] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:53.894044 26702 ts_tablet_manager.cc:1403] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.395s	user 0.036s	sys 0.045s
I20260709 13:08:53.865219 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:53.872912 26644 tablet_service.cc:1511] Processing CreateTablet for tablet 20b4ddf1aa104699a71886717f8e24b6 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:53.873973 26649 tablet_service.cc:1511] Processing CreateTablet for tablet 2a158e3bdc954edd8dde2444100459ef (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 13:08:53.899142 26549 leader_election.cc:343] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.870201 26500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0edde491935742d4b076995932d10cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.900224 26573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffb5488a21bd418b96b52a8ab8a2e669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.901892 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c8792823e44557bace909d8b20d9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.897075 26702 raft_consensus.cc:359] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:53.905481 26702 raft_consensus.cc:385] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.905839 26702 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.906679 26702 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:53.874655 26572 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce4b86f29b4456dba024f24f29091e4 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:53.890468 26641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b26ae30d0734e338bc81b8d9f963b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.893646 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 9b26ae30d0734e338bc81b8d9f963b67 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:53.876808 26642 tablet_service.cc:1511] Processing CreateTablet for tablet 71037b41f3ef4e33946b5099bf7adb3d (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:53.889539 26699 tablet_bootstrap.cc:654] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.913864 26700 ts_tablet_manager.cc:1434] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.182s	user 0.005s	sys 0.006s
I20260709 13:08:53.920486 26700 tablet_bootstrap.cc:492] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:53.923970 26684 heartbeater.cc:499] Master 127.24.204.254:32835 was elected leader, sending a full tablet report...
I20260709 13:08:53.930244 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 20b4ddf1aa104699a71886717f8e24b6 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:53.931596 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b4ddf1aa104699a71886717f8e24b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.933946 26649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a158e3bdc954edd8dde2444100459ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.935976 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b4ddf1aa104699a71886717f8e24b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.937966 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01228e22d88047b6bc2f5a6b74aa2b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.943912 26642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71037b41f3ef4e33946b5099bf7adb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.943959 26710 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.944545 26710 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:53.944927 26646 tablet_service.cc:1511] Processing CreateTablet for tablet e29f1967e75645cbb7842e14e0404518 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:53.946249 26646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29f1967e75645cbb7842e14e0404518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.953245 26710 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:53.968243 26570 tablet_service.cc:1511] Processing CreateTablet for tablet 0edde491935742d4b076995932d10cc9 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:53.969760 26700 tablet_bootstrap.cc:654] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.974125 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:53.986774 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 2a158e3bdc954edd8dde2444100459ef (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 13:08:53.998950 26548 leader_election.cc:343] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.991272 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b26ae30d0734e338bc81b8d9f963b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.996783 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce4b86f29b4456dba024f24f29091e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.021322 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:54.022377 26704 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:54.032835 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a158e3bdc954edd8dde2444100459ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.034781 26566 tablet_service.cc:1511] Processing CreateTablet for tablet 32c8792823e44557bace909d8b20d9eb (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:54.040584 26568 tablet_service.cc:1511] Processing CreateTablet for tablet 9b26ae30d0734e338bc81b8d9f963b67 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:54.047242 26574 tablet_service.cc:1511] Processing CreateTablet for tablet 20b4ddf1aa104699a71886717f8e24b6 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:54.047602 26648 tablet_service.cc:1511] Processing CreateTablet for tablet 7a3ba69234d6417b968d15d31d856dbf (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:54.051065 26499 tablet_service.cc:1511] Processing CreateTablet for tablet e29f1967e75645cbb7842e14e0404518 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:54.052487 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29f1967e75645cbb7842e14e0404518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.057894 26711 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.058411 26711 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.059274 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 7a3ba69234d6417b968d15d31d856dbf (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:54.060688 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a3ba69234d6417b968d15d31d856dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.049427 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a3ba69234d6417b968d15d31d856dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.067245 26571 tablet_service.cc:1511] Processing CreateTablet for tablet 71037b41f3ef4e33946b5099bf7adb3d (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:54.072068 26499 tablet_service.cc:1511] Processing CreateTablet for tablet b0b9da52e1c04100a4d56d1cfce9e2a2 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:54.073727 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b9da52e1c04100a4d56d1cfce9e2a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.026793 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 71037b41f3ef4e33946b5099bf7adb3d (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:54.082269 26702 ts_tablet_manager.cc:1434] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.188s	user 0.015s	sys 0.019s
I20260709 13:08:54.082763 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71037b41f3ef4e33946b5099bf7adb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.083302 26702 tablet_bootstrap.cc:492] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:54.092036 26711 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:54.108676 26570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0edde491935742d4b076995932d10cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.110975 26566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c8792823e44557bace909d8b20d9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.110767 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 2a158e3bdc954edd8dde2444100459ef (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:54.029723 26567 tablet_service.cc:1511] Processing CreateTablet for tablet 01228e22d88047b6bc2f5a6b74aa2b51 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:54.119598 26569 tablet_service.cc:1511] Processing CreateTablet for tablet e29f1967e75645cbb7842e14e0404518 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:54.128118 26643 tablet_service.cc:1511] Processing CreateTablet for tablet b0b9da52e1c04100a4d56d1cfce9e2a2 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:54.128150 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a158e3bdc954edd8dde2444100459ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.129940 26573 tablet_service.cc:1511] Processing CreateTablet for tablet 7a3ba69234d6417b968d15d31d856dbf (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:54.131343 26573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a3ba69234d6417b968d15d31d856dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.132544 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:54.081378 26498 tablet_service.cc:1511] Processing CreateTablet for tablet 23a5091904e646e8b76c8f9103e029b5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 13:08:54.134338 26476 leader_election.cc:343] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.134503 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a5091904e646e8b76c8f9103e029b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.135071 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b9da52e1c04100a4d56d1cfce9e2a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.148460 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 66cd76ef163447878430c4633d13a427 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:54.149837 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cd76ef163447878430c4633d13a427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.155933 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3c8f39cbe14359a810de00ced87a46 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:54.165261 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecc61d0190444bea318620b6a278926 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:54.157452 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3c8f39cbe14359a810de00ced87a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.184584 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3c8f39cbe14359a810de00ced87a46 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:54.185957 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3c8f39cbe14359a810de00ced87a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.190829 26702 tablet_bootstrap.cc:654] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.145473 26568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b26ae30d0734e338bc81b8d9f963b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.174440 26500 tablet_service.cc:1511] Processing CreateTablet for tablet 4887e9161abf4ffe869e9d1cc636b7da (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:54.196545 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecc61d0190444bea318620b6a278926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.206454 26699 tablet_bootstrap.cc:492] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:54.207020 26699 ts_tablet_manager.cc:1403] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.554s	user 0.024s	sys 0.028s
I20260709 13:08:54.208300 26647 tablet_service.cc:1511] Processing CreateTablet for tablet 4887e9161abf4ffe869e9d1cc636b7da (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:54.213661 26641 tablet_service.cc:1511] Processing CreateTablet for tablet 23a5091904e646e8b76c8f9103e029b5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:54.219691 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71037b41f3ef4e33946b5099bf7adb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.221845 26567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01228e22d88047b6bc2f5a6b74aa2b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.224123 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29f1967e75645cbb7842e14e0404518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.209546 26647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4887e9161abf4ffe869e9d1cc636b7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.228482 26574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b4ddf1aa104699a71886717f8e24b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.228645 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:54.228663 26500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4887e9161abf4ffe869e9d1cc636b7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.231393 26492 tablet_service.cc:1511] Processing CreateTablet for tablet a72cbe5dad8844a08aa3bf83d8f3ad27 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:54.232810 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a72cbe5dad8844a08aa3bf83d8f3ad27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.235314 26497 tablet_service.cc:1511] Processing CreateTablet for tablet b0f9b412be4742fc99eac55c24c89cf8 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:54.240269 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 81721f0402d24cbfb7f52e0ba164247b (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:54.243044 26641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a5091904e646e8b76c8f9103e029b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:54.243851 26474 leader_election.cc:343] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.244346 26474 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:54.245551 26710 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:54.255326 26491 tablet_service.cc:1511] Processing CreateTablet for tablet c46a2e31548b4665b067897f6ebe9bf9 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:54.236452 26699 raft_consensus.cc:359] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.260087 26699 raft_consensus.cc:385] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.260565 26699 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.272238 26644 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecc61d0190444bea318620b6a278926 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:54.273965 26642 tablet_service.cc:1511] Processing CreateTablet for tablet 66cd76ef163447878430c4633d13a427 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:54.275597 26649 tablet_service.cc:1511] Processing CreateTablet for tablet 81721f0402d24cbfb7f52e0ba164247b (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:54.273979 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecc61d0190444bea318620b6a278926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.312992 26497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f9b412be4742fc99eac55c24c89cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.316257 26642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cd76ef163447878430c4633d13a427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.316565 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81721f0402d24cbfb7f52e0ba164247b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.322780 26648 tablet_service.cc:1511] Processing CreateTablet for tablet a72cbe5dad8844a08aa3bf83d8f3ad27 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:54.321327 26498 tablet_service.cc:1511] Processing CreateTablet for tablet b945492abb95467c8e66b0f6d8842bc7 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:54.329111 26649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81721f0402d24cbfb7f52e0ba164247b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:54.350235 26392 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 93324.3us
I20260709 13:08:54.330021 26494 tablet_service.cc:1511] Processing CreateTablet for tablet f54605dc5ec04452908dd0efd01fbcaf (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:54.332935 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c46a2e31548b4665b067897f6ebe9bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.357934 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54605dc5ec04452908dd0efd01fbcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.361268 26567 tablet_service.cc:1511] Processing CreateTablet for tablet b0b9da52e1c04100a4d56d1cfce9e2a2 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:54.361914 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b945492abb95467c8e66b0f6d8842bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.362835 26567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b9da52e1c04100a4d56d1cfce9e2a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.366849 26700 tablet_bootstrap.cc:492] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:54.367413 26700 ts_tablet_manager.cc:1403] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.447s	user 0.018s	sys 0.032s
W20260709 13:08:54.370038 26393 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 94770.6us
I20260709 13:08:54.371628 26700 raft_consensus.cc:359] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.372409 26700 raft_consensus.cc:385] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.372722 26700 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.373202 26699 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.375507 26699 ts_tablet_manager.cc:1434] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.168s	user 0.013s	sys 0.000s
I20260709 13:08:54.376601 26699 tablet_bootstrap.cc:492] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:54.385879 26572 tablet_service.cc:1511] Processing CreateTablet for tablet 23a5091904e646e8b76c8f9103e029b5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:54.425624 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a5091904e646e8b76c8f9103e029b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.426025 26498 tablet_service.cc:1511] Processing CreateTablet for tablet bbeed79ff32c46018128de0f6b9a3514 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:54.427276 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeed79ff32c46018128de0f6b9a3514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.430483 26641 tablet_service.cc:1511] Processing CreateTablet for tablet bbeed79ff32c46018128de0f6b9a3514 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:54.430670 26574 tablet_service.cc:1511] Processing CreateTablet for tablet c46a2e31548b4665b067897f6ebe9bf9 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:54.390018 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a72cbe5dad8844a08aa3bf83d8f3ad27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.433480 26574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c46a2e31548b4665b067897f6ebe9bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.419193 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:08:54.435601 26625 leader_election.cc:343] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.413805 26496 tablet_service.cc:1511] Processing CreateTablet for tablet ebe9b36ae60941888203dd2967005c27 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:54.437399 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe9b36ae60941888203dd2967005c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.440269 26641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeed79ff32c46018128de0f6b9a3514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.445010 26498 tablet_service.cc:1511] Processing CreateTablet for tablet 6daa7e0062a14868b29dc1a9144f41c8 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:54.446364 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6daa7e0062a14868b29dc1a9144f41c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.452437 26574 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3c8f39cbe14359a810de00ced87a46 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:54.453791 26574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3c8f39cbe14359a810de00ced87a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.390576 26640 tablet_service.cc:1511] Processing CreateTablet for tablet b0f9b412be4742fc99eac55c24c89cf8 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:54.406558 26570 tablet_service.cc:1511] Processing CreateTablet for tablet b0f9b412be4742fc99eac55c24c89cf8 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:54.457655 26570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f9b412be4742fc99eac55c24c89cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.459985 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 9b1aac0e4d18474e899d9c60448999fc (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:54.461206 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b1aac0e4d18474e899d9c60448999fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.404923 26700 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.463727 26700 ts_tablet_manager.cc:1434] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.002s
I20260709 13:08:54.464668 26700 tablet_bootstrap.cc:492] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:54.449398 26569 tablet_service.cc:1511] Processing CreateTablet for tablet 66cd76ef163447878430c4633d13a427 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:54.466893 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cd76ef163447878430c4633d13a427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.465647 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 63f94c193a504bc1b0601e54e3ec5f9a (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:54.470300 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f94c193a504bc1b0601e54e3ec5f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.471969 26710 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.472647 26640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f9b412be4742fc99eac55c24c89cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.472431 26710 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.474530 26710 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:54.476063 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:54.477181 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:54.482827 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:08:54.484535 26622 leader_election.cc:343] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.484997 26622 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:54.485339 26700 tablet_bootstrap.cc:654] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.486305 26716 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:54.490252 26476 leader_election.cc:343] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:54.491890 26474 leader_election.cc:343] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.492324 26474 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:54.422580 26649 tablet_service.cc:1511] Processing CreateTablet for tablet ebe9b36ae60941888203dd2967005c27 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:54.494098 26649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe9b36ae60941888203dd2967005c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.423835 26702 tablet_bootstrap.cc:492] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:54.498085 26702 ts_tablet_manager.cc:1403] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.415s	user 0.013s	sys 0.009s
I20260709 13:08:54.498008 26710 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:54.380635 26646 tablet_service.cc:1511] Processing CreateTablet for tablet c46a2e31548b4665b067897f6ebe9bf9 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:54.502904 26646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c46a2e31548b4665b067897f6ebe9bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.503389 26491 tablet_service.cc:1511] Processing CreateTablet for tablet 93a535a53cf0452f96a49f9aa849777a (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:54.503556 26566 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecc61d0190444bea318620b6a278926 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:54.504647 26491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a535a53cf0452f96a49f9aa849777a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.504815 26566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecc61d0190444bea318620b6a278926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.506197 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 4b57a114025342d2bdfb15a7bb13db93 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:54.497212 26644 tablet_service.cc:1511] Processing CreateTablet for tablet f54605dc5ec04452908dd0efd01fbcaf (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:54.519711 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54605dc5ec04452908dd0efd01fbcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.501081 26702 raft_consensus.cc:359] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.521092 26702 raft_consensus.cc:385] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.521469 26702 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.522476 26702 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.538955 26699 tablet_bootstrap.cc:654] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.542057 26498 tablet_service.cc:1511] Processing CreateTablet for tablet 40a3c5a4dbcb4d7f8b2517b3d86bcb00 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:54.541953 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b57a114025342d2bdfb15a7bb13db93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.548431 26702 ts_tablet_manager.cc:1434] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:08:54.548492 26643 tablet_service.cc:1511] Processing CreateTablet for tablet 6daa7e0062a14868b29dc1a9144f41c8 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:54.552515 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6daa7e0062a14868b29dc1a9144f41c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.552386 26704 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:54.547137 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:54.553481 26702 tablet_bootstrap.cc:492] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:54.555634 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40a3c5a4dbcb4d7f8b2517b3d86bcb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.562152 26704 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.564615 26704 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:54.566016 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:54.566596 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:08:54.567420 26549 leader_election.cc:343] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:54.567922 26548 leader_election.cc:343] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.568354 26548 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:54.569422 26704 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:54.560271 26642 tablet_service.cc:1511] Processing CreateTablet for tablet 9b1aac0e4d18474e899d9c60448999fc (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:54.572647 26573 tablet_service.cc:1511] Processing CreateTablet for tablet 4887e9161abf4ffe869e9d1cc636b7da (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:54.577319 26573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4887e9161abf4ffe869e9d1cc636b7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.576241 26702 tablet_bootstrap.cc:654] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.604210 26645 tablet_service.cc:1511] Processing CreateTablet for tablet 63f94c193a504bc1b0601e54e3ec5f9a (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:54.611999 26497 tablet_service.cc:1511] Processing CreateTablet for tablet a7aaf3bb8d83488a81bc031ffda595a5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:54.615175 26497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aaf3bb8d83488a81bc031ffda595a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.617273 26641 tablet_service.cc:1511] Processing CreateTablet for tablet b945492abb95467c8e66b0f6d8842bc7 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:54.619238 26572 tablet_service.cc:1511] Processing CreateTablet for tablet bbeed79ff32c46018128de0f6b9a3514 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:54.620302 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeed79ff32c46018128de0f6b9a3514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.623994 26574 tablet_service.cc:1511] Processing CreateTablet for tablet f54605dc5ec04452908dd0efd01fbcaf (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:54.629753 26567 tablet_service.cc:1511] Processing CreateTablet for tablet a72cbe5dad8844a08aa3bf83d8f3ad27 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:54.631481 26567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a72cbe5dad8844a08aa3bf83d8f3ad27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.635206 26499 tablet_service.cc:1511] Processing CreateTablet for tablet 731b96cedb5749df893a1de699717183 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:54.636775 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731b96cedb5749df893a1de699717183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.639408 26492 tablet_service.cc:1511] Processing CreateTablet for tablet fb7b25ba8d2644ceb86280e40ef3c8dc (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:54.639700 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 6daa7e0062a14868b29dc1a9144f41c8 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:54.640755 26492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7b25ba8d2644ceb86280e40ef3c8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.641131 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6daa7e0062a14868b29dc1a9144f41c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.643105 26572 tablet_service.cc:1511] Processing CreateTablet for tablet 9b1aac0e4d18474e899d9c60448999fc (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:54.647480 26644 tablet_service.cc:1511] Processing CreateTablet for tablet 93a535a53cf0452f96a49f9aa849777a (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:54.648344 26570 tablet_service.cc:1511] Processing CreateTablet for tablet 81721f0402d24cbfb7f52e0ba164247b (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:54.648733 26571 tablet_service.cc:1511] Processing CreateTablet for tablet ebe9b36ae60941888203dd2967005c27 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:54.649780 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 203b3a179cc240e6ac8beb1d95728111 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:54.633205 26647 tablet_service.cc:1511] Processing CreateTablet for tablet 4b57a114025342d2bdfb15a7bb13db93 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:08:54.663313 26393 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 66373.4us
I20260709 13:08:54.666824 26700 tablet_bootstrap.cc:492] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:54.670889 26642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b1aac0e4d18474e899d9c60448999fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.671838 26495 tablet_service.cc:1511] Processing CreateTablet for tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:54.681603 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203b3a179cc240e6ac8beb1d95728111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.680357 26498 tablet_service.cc:1511] Processing CreateTablet for tablet e51f289426cf4543b1a962ba324beea3 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:54.689390 26574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54605dc5ec04452908dd0efd01fbcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.695233 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51f289426cf4543b1a962ba324beea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.673362 26567 tablet_service.cc:1511] Processing CreateTablet for tablet 63f94c193a504bc1b0601e54e3ec5f9a (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:54.698855 26647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b57a114025342d2bdfb15a7bb13db93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.701897 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b1aac0e4d18474e899d9c60448999fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.702610 26649 tablet_service.cc:1511] Processing CreateTablet for tablet 203b3a179cc240e6ac8beb1d95728111 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:54.695104 26700 ts_tablet_manager.cc:1403] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.231s	user 0.018s	sys 0.004s
I20260709 13:08:54.707870 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.708189 26645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f94c193a504bc1b0601e54e3ec5f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.715427 26641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b945492abb95467c8e66b0f6d8842bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.716640 26700 raft_consensus.cc:359] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.721814 26700 raft_consensus.cc:385] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.718959 26568 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36124 (request call id 27) took 1032 ms. Trace:
I20260709 13:08:54.718053 26699 tablet_bootstrap.cc:492] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:54.725914 26644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a535a53cf0452f96a49f9aa849777a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.731103 26716 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.731575 26716 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.733716 26716 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:54.735452 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:54.737672 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:08:54.739699 26625 leader_election.cc:343] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:54.766563 26393 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 43515.4us
I20260709 13:08:54.769183 26640 tablet_service.cc:1511] Processing CreateTablet for tablet 40a3c5a4dbcb4d7f8b2517b3d86bcb00 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:54.770869 26570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81721f0402d24cbfb7f52e0ba164247b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.771552 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe9b36ae60941888203dd2967005c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.780829 26699 ts_tablet_manager.cc:1403] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.404s	user 0.032s	sys 0.022s
I20260709 13:08:54.780949 26567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f94c193a504bc1b0601e54e3ec5f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.729705 26700 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.789680 26570 tablet_service.cc:1511] Processing CreateTablet for tablet 4b57a114025342d2bdfb15a7bb13db93 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:54.790202 26700 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.791200 26510 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:54.792200 26702 tablet_bootstrap.cc:492] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:54.792680 26702 ts_tablet_manager.cc:1403] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.239s	user 0.019s	sys 0.016s
I20260709 13:08:54.793545 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:54.795145 26716 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:54.796054 26716 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.796553 26716 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.797144 26649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203b3a179cc240e6ac8beb1d95728111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.803418 26716 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.806054 26648 tablet_service.cc:1511] Processing CreateTablet for tablet a7aaf3bb8d83488a81bc031ffda595a5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:54.807171 26716 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:54.807420 26648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aaf3bb8d83488a81bc031ffda595a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.810832 26640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40a3c5a4dbcb4d7f8b2517b3d86bcb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.811532 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:08:54.813230 26625 leader_election.cc:343] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.806263 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:54.814007 26510 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:54.815629 26642 tablet_service.cc:1511] Processing CreateTablet for tablet 731b96cedb5749df893a1de699717183 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:54.817070 26642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731b96cedb5749df893a1de699717183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.728140 26568 rpcz_store.cc:276] 0709 13:08:53.697216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.039597 (+342381us) service_pool.cc:224] Handling call
0709 13:08:54.041479 (+  1882us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:08:54.053642 (+ 12163us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:08:54.559748 (+506106us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:54.718489 (+158741us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:54.718902 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:54.819959 26568 tablet_service.cc:1511] Processing CreateTablet for tablet 93a535a53cf0452f96a49f9aa849777a (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:54.821125 26573 tablet_service.cc:1511] Processing CreateTablet for tablet b945492abb95467c8e66b0f6d8842bc7 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:54.831537 26570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b57a114025342d2bdfb15a7bb13db93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.871558 26700 ts_tablet_manager.cc:1434] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.158s	user 0.010s	sys 0.009s
I20260709 13:08:54.872026 26573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b945492abb95467c8e66b0f6d8842bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.871919 26569 tablet_service.cc:1511] Processing CreateTablet for tablet 40a3c5a4dbcb4d7f8b2517b3d86bcb00 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:54.873843 26699 raft_consensus.cc:359] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.874558 26699 raft_consensus.cc:385] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.874825 26699 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.875705 26699 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.886840 26700 tablet_bootstrap.cc:492] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:54.889523 26571 tablet_service.cc:1511] Processing CreateTablet for tablet a7aaf3bb8d83488a81bc031ffda595a5 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:54.889967 26643 tablet_service.cc:1511] Processing CreateTablet for tablet fb7b25ba8d2644ceb86280e40ef3c8dc (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:54.891165 26643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7b25ba8d2644ceb86280e40ef3c8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.891721 26566 tablet_service.cc:1511] Processing CreateTablet for tablet 203b3a179cc240e6ac8beb1d95728111 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:54.893782 26510 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:54.897804 26702 raft_consensus.cc:359] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.900774 26572 tablet_service.cc:1511] Processing CreateTablet for tablet fb7b25ba8d2644ceb86280e40ef3c8dc (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:54.884624 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40a3c5a4dbcb4d7f8b2517b3d86bcb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.899237 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 731b96cedb5749df893a1de699717183 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:54.912528 26700 tablet_bootstrap.cc:654] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:54.907001 26567 tablet_service.cc:1511] Processing CreateTablet for tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:54.912536 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:54.921793 26699 ts_tablet_manager.cc:1434] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.140s	user 0.008s	sys 0.002s
I20260709 13:08:54.921974 26716 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:54.923142 26699 tablet_bootstrap.cc:492] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:54.904829 26646 tablet_service.cc:1511] Processing CreateTablet for tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:54.914779 26568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a535a53cf0452f96a49f9aa849777a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.930660 26646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.902338 26702 raft_consensus.cc:385] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.932248 26702 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.933172 26702 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.937885 26566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203b3a179cc240e6ac8beb1d95728111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.940989 26567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.941848 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731b96cedb5749df893a1de699717183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.942642 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aaf3bb8d83488a81bc031ffda595a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.946477 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7b25ba8d2644ceb86280e40ef3c8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.946408 26716 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:54.947718 26716 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.961781 26573 tablet_service.cc:1511] Processing CreateTablet for tablet e51f289426cf4543b1a962ba324beea3 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:54.962319 26700 tablet_bootstrap.cc:492] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:54.962949 26700 ts_tablet_manager.cc:1403] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.076s	user 0.020s	sys 0.000s
I20260709 13:08:54.964695 26702 ts_tablet_manager.cc:1434] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.172s	user 0.011s	sys 0.004s
I20260709 13:08:54.965759 26702 tablet_bootstrap.cc:492] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:54.967120 26700 raft_consensus.cc:359] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.967948 26700 raft_consensus.cc:385] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:54.968290 26700 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:54.969179 26700 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.940656 26649 tablet_service.cc:1511] Processing CreateTablet for tablet e51f289426cf4543b1a962ba324beea3 (DEFAULT_TABLE table=test-workload [id=da66e59da99c4a47861232a8cf9fe043]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:54.978358 26649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51f289426cf4543b1a962ba324beea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.980940 26700 ts_tablet_manager.cc:1434] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:08:54.989912 26573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51f289426cf4543b1a962ba324beea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.990281 26700 tablet_bootstrap.cc:492] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:54.994122 26726 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.994647 26726 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:54.997464 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:54.998289 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:08:54.998973 26622 leader_election.cc:343] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:54.998934 26585 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:55.000864 26625 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:55.001466 26700 tablet_bootstrap.cc:654] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.001858 26725 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.002254 26725 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.002585 26725 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.008427 26726 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:55.021102 26725 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.022046 26700 tablet_bootstrap.cc:492] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.022595 26700 ts_tablet_manager.cc:1403] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.002s
I20260709 13:08:55.024338 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:55.024454 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:55.025127 26585 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:55.025878 26622 leader_election.cc:343] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.029664 26700 raft_consensus.cc:359] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } }
I20260709 13:08:55.030519 26700 raft_consensus.cc:385] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.030867 26700 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.031785 26700 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } }
I20260709 13:08:55.032864 26585 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:55.021106 26699 tablet_bootstrap.cc:654] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.034297 26625 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:55.042104 26700 ts_tablet_manager.cc:1434] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:55.047334 26702 tablet_bootstrap.cc:654] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.051352 26700 tablet_bootstrap.cc:492] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.042220 26726 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:55.056203 26726 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:55.056360 26725 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:55.064996 26407 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.070613 26726 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.074467 26700 tablet_bootstrap.cc:654] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.079757 26699 tablet_bootstrap.cc:492] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.080241 26699 ts_tablet_manager.cc:1403] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.157s	user 0.013s	sys 0.010s
I20260709 13:08:55.083668 26699 raft_consensus.cc:359] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.084447 26699 raft_consensus.cc:385] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.084769 26699 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.085685 26699 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.091035 26702 tablet_bootstrap.cc:492] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.091497 26702 ts_tablet_manager.cc:1403] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.003s
I20260709 13:08:55.091864 26699 ts_tablet_manager.cc:1434] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:55.092928 26699 tablet_bootstrap.cc:492] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:55.093986 26702 raft_consensus.cc:359] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } }
I20260709 13:08:55.094630 26702 raft_consensus.cc:385] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.094877 26702 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.095563 26702 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } }
I20260709 13:08:55.097489 26702 ts_tablet_manager.cc:1434] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:55.098409 26702 tablet_bootstrap.cc:492] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.099975 26699 tablet_bootstrap.cc:654] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.086184 26700 tablet_bootstrap.cc:492] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.101912 26700 ts_tablet_manager.cc:1403] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.002s
I20260709 13:08:55.104655 26702 tablet_bootstrap.cc:654] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.104578 26700 raft_consensus.cc:359] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.105481 26700 raft_consensus.cc:385] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.105991 26700 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.107106 26700 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.119390 26699 tablet_bootstrap.cc:492] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.119839 26700 ts_tablet_manager.cc:1434] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:08:55.119982 26699 ts_tablet_manager.cc:1403] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.006s
I20260709 13:08:55.120910 26702 tablet_bootstrap.cc:492] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.120965 26700 tablet_bootstrap.cc:492] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.121498 26702 ts_tablet_manager.cc:1403] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 13:08:55.122990 26699 raft_consensus.cc:359] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.123751 26699 raft_consensus.cc:385] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.124073 26699 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.124502 26702 raft_consensus.cc:359] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.125373 26702 raft_consensus.cc:385] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.124941 26699 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.125716 26702 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.125936 26407 catalog_manager.cc:5697] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.126526 26702 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.128764 26702 ts_tablet_manager.cc:1434] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:55.129675 26700 tablet_bootstrap.cc:654] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.129751 26702 tablet_bootstrap.cc:492] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.131460 26699 ts_tablet_manager.cc:1434] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:08:55.133119 26699 tablet_bootstrap.cc:492] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:55.137941 26702 tablet_bootstrap.cc:654] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.149281 26699 tablet_bootstrap.cc:654] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.155299 26710 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.155941 26710 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } }
I20260709 13:08:55.156719 26700 tablet_bootstrap.cc:492] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.157191 26700 ts_tablet_manager.cc:1403] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.016s
I20260709 13:08:55.158051 26710 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.159123 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.159950 26659 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:55.160272 26700 raft_consensus.cc:359] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.160907 26702 tablet_bootstrap.cc:492] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.161499 26702 ts_tablet_manager.cc:1403] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.005s
I20260709 13:08:55.161394 26474 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:55.162410 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.162381 26710 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.162663 26699 tablet_bootstrap.cc:492] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.163028 26710 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.163110 26585 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:55.163348 26699 ts_tablet_manager.cc:1403] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.001s
I20260709 13:08:55.163604 26710 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.165040 26702 raft_consensus.cc:359] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.165850 26702 raft_consensus.cc:385] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.166204 26702 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.166407 26699 raft_consensus.cc:359] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.167168 26699 raft_consensus.cc:385] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.167359 26700 raft_consensus.cc:385] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.167603 26699 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.167783 26700 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.167229 26702 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.168846 26699 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.171461 26699 ts_tablet_manager.cc:1434] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:08:55.173583 26702 ts_tablet_manager.cc:1434] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:08:55.173079 26700 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.173416 26710 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } }
I20260709 13:08:55.174820 26702 tablet_bootstrap.cc:492] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.177654 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:55.178298 26659 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.179450 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:55.180042 26699 tablet_bootstrap.cc:492] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:55.180033 26585 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.186127 26659 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:55.187485 26474 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:55.193032 26710 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.193651 26585 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:55.197119 26699 tablet_bootstrap.cc:654] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.200091 26745 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:55.203544 26700 ts_tablet_manager.cc:1434] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.046s	user 0.022s	sys 0.008s
I20260709 13:08:55.205090 26700 tablet_bootstrap.cc:492] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.205662 26745 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:08:55.206358 26702 tablet_bootstrap.cc:654] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.207705 26745 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } }
I20260709 13:08:55.209240 26699 tablet_bootstrap.cc:492] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.209884 26699 ts_tablet_manager.cc:1403] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.003s
I20260709 13:08:55.213654 26700 tablet_bootstrap.cc:654] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.213819 26699 raft_consensus.cc:359] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.214556 26699 raft_consensus.cc:385] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.214875 26699 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.215639 26699 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.217900 26699 ts_tablet_manager.cc:1434] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:55.219188 26699 tablet_bootstrap.cc:492] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:55.228363 26702 tablet_bootstrap.cc:492] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.229050 26702 ts_tablet_manager.cc:1403] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.007s
I20260709 13:08:55.232334 26702 raft_consensus.cc:359] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.228267 26699 tablet_bootstrap.cc:654] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.233289 26702 raft_consensus.cc:385] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.233696 26700 tablet_bootstrap.cc:492] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.234068 26702 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.234371 26700 ts_tablet_manager.cc:1403] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.001s
I20260709 13:08:55.233237 26408 catalog_manager.cc:5697] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.235100 26702 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.237813 26700 raft_consensus.cc:359] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.238679 26700 raft_consensus.cc:385] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.239053 26700 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.239924 26700 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.242097 26702 ts_tablet_manager.cc:1434] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:08:55.242619 26700 ts_tablet_manager.cc:1434] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:55.243120 26702 tablet_bootstrap.cc:492] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.243577 26700 tablet_bootstrap.cc:492] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.249545 26700 tablet_bootstrap.cc:654] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.249545 26702 tablet_bootstrap.cc:654] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.250979 26704 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.251456 26704 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.253638 26704 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.254815 26699 tablet_bootstrap.cc:492] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.255275 26699 ts_tablet_manager.cc:1403] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.013s
I20260709 13:08:55.256008 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:55.256652 26510 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:55.257650 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.257946 26699 raft_consensus.cc:359] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.258258 26659 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:55.258605 26699 raft_consensus.cc:385] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.258872 26699 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.259637 26699 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.260457 26549 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.261940 26699 ts_tablet_manager.cc:1434] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:08:55.262280 26704 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.262650 26704 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.262996 26704 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.264819 26699 tablet_bootstrap.cc:492] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:55.270753 26699 tablet_bootstrap.cc:654] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.282474 26699 tablet_bootstrap.cc:492] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.283023 26699 ts_tablet_manager.cc:1403] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:08:55.285661 26699 raft_consensus.cc:359] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.286473 26699 raft_consensus.cc:385] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.286787 26699 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.287606 26699 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.287794 26704 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.292567 26704 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.294433 26699 ts_tablet_manager.cc:1434] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:08:55.295595 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:55.296129 26510 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.296890 26745 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.297349 26745 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.298498 26699 tablet_bootstrap.cc:492] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:55.299424 26745 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.301909 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:55.301795 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.302590 26659 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.302760 26658 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:55.306213 26474 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:55.306310 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:08:55.307861 26476 leader_election.cc:343] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.308791 26745 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.309001 26699 tablet_bootstrap.cc:654] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.309322 26745 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.309782 26745 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.312060 26659 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:55.313406 26549 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.317886 26510 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:55.319160 26754 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:55.324146 26704 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.325493 26704 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.330018 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:08:55.331568 26548 leader_election.cc:343] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.332185 26699 tablet_bootstrap.cc:492] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.332651 26699 ts_tablet_manager.cc:1403] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.002s
I20260709 13:08:55.335405 26699 raft_consensus.cc:359] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.336041 26699 raft_consensus.cc:385] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.336305 26699 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.336961 26699 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.337656 26754 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:08:55.332603 26745 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.340052 26704 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.340101 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.340878 26700 tablet_bootstrap.cc:492] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.341316 26700 ts_tablet_manager.cc:1403] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.098s	user 0.028s	sys 0.065s
I20260709 13:08:55.341217 26754 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:55.341835 26549 leader_election.cc:343] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.342309 26549 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:55.343981 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:55.344178 26745 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.344149 26700 raft_consensus.cc:359] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.344857 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:55.345152 26700 raft_consensus.cc:385] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.345463 26700 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.345467 26658 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.345789 26585 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.345746 26704 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:55.346326 26700 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.349356 26702 tablet_bootstrap.cc:492] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.349833 26702 ts_tablet_manager.cc:1403] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.107s	user 0.045s	sys 0.025s
I20260709 13:08:55.351316 26700 ts_tablet_manager.cc:1434] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:55.352381 26700 tablet_bootstrap.cc:492] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.352349 26702 raft_consensus.cc:359] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.353099 26702 raft_consensus.cc:385] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.353361 26702 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.354127 26702 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.356308 26702 ts_tablet_manager.cc:1434] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:55.357331 26702 tablet_bootstrap.cc:492] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.357723 26585 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:55.358026 26700 tablet_bootstrap.cc:654] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.364128 26702 tablet_bootstrap.cc:654] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.364591 26754 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.365769 26754 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.370488 26700 tablet_bootstrap.cc:492] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.371088 26700 ts_tablet_manager.cc:1403] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:08:55.371766 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:08:55.373471 26548 leader_election.cc:343] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.374219 26702 tablet_bootstrap.cc:492] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.373944 26700 raft_consensus.cc:359] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.374711 26700 raft_consensus.cc:385] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.374723 26702 ts_tablet_manager.cc:1403] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:08:55.375741 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.376257 26754 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.377058 26699 ts_tablet_manager.cc:1434] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.003s
W20260709 13:08:55.377761 26549 leader_election.cc:343] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.378306 26699 tablet_bootstrap.cc:492] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:55.378077 26702 raft_consensus.cc:359] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.375025 26700 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.378219 26549 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:55.379380 26754 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:55.364305 26658 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:55.368170 26406 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.380014 26700 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.380898 26474 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:55.378774 26702 raft_consensus.cc:385] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.381776 26745 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:55.382011 26702 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.382262 26700 ts_tablet_manager.cc:1434] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:08:55.382261 26745 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:08:55.382737 26702 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.383293 26700 tablet_bootstrap.cc:492] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.383255 26745 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.384965 26702 ts_tablet_manager.cc:1434] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:55.385860 26702 tablet_bootstrap.cc:492] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.389256 26700 tablet_bootstrap.cc:654] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.391662 26702 tablet_bootstrap.cc:654] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.403756 26699 tablet_bootstrap.cc:654] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.416452 26702 tablet_bootstrap.cc:492] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.417023 26702 ts_tablet_manager.cc:1403] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.017s
I20260709 13:08:55.418649 26700 tablet_bootstrap.cc:492] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.419062 26700 ts_tablet_manager.cc:1403] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.020s
I20260709 13:08:55.416790 26406 catalog_manager.cc:5697] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.419611 26702 raft_consensus.cc:359] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.420293 26702 raft_consensus.cc:385] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.420544 26702 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.421185 26699 tablet_bootstrap.cc:492] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.421267 26702 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.421742 26699 ts_tablet_manager.cc:1403] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 13:08:55.421690 26700 raft_consensus.cc:359] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.422397 26700 raft_consensus.cc:385] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.422665 26700 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.423383 26700 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.425681 26754 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.425511 26699 raft_consensus.cc:359] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.426183 26700 ts_tablet_manager.cc:1434] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:55.426425 26699 raft_consensus.cc:385] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.426174 26754 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.426836 26699 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.427184 26700 tablet_bootstrap.cc:492] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.427771 26699 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.428293 26754 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.429404 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.429873 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:55.430022 26658 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:55.430533 26510 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:55.431277 26549 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.433072 26699 ts_tablet_manager.cc:1434] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:08:55.433147 26702 ts_tablet_manager.cc:1434] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:08:55.434267 26699 tablet_bootstrap.cc:492] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:55.434427 26700 tablet_bootstrap.cc:654] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.434466 26702 tablet_bootstrap.cc:492] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.441408 26754 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.441882 26754 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.442257 26754 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.450706 26754 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.450270 26699 tablet_bootstrap.cc:654] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.453644 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:55.454291 26509 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.454571 26726 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:55.456887 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:55.457419 26658 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.458164 26702 tablet_bootstrap.cc:654] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.461750 26509 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:55.463063 26548 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.463882 26704 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:55.464331 26704 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:08:55.464491 26702 tablet_bootstrap.cc:492] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.464993 26702 ts_tablet_manager.cc:1403] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.004s
I20260709 13:08:55.465176 26704 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.467693 26702 raft_consensus.cc:359] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.468422 26702 raft_consensus.cc:385] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.468770 26702 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.464813 26658 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:55.469673 26702 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.472008 26754 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.472622 26700 tablet_bootstrap.cc:492] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.473070 26700 ts_tablet_manager.cc:1403] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.009s
I20260709 13:08:55.476094 26702 ts_tablet_manager.cc:1434] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:08:55.477232 26702 tablet_bootstrap.cc:492] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.475739 26700 raft_consensus.cc:359] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.480858 26700 raft_consensus.cc:385] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.481228 26700 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.482095 26700 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.484721 26704 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.485283 26704 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.488044 26699 tablet_bootstrap.cc:492] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.487569 26407 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.488490 26699 ts_tablet_manager.cc:1403] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.005s
I20260709 13:08:55.490006 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.490736 26658 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:55.492075 26549 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.493043 26704 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.493608 26704 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.493988 26704 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.494433 26702 tablet_bootstrap.cc:654] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.494351 26704 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.495050 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:55.495748 26510 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:55.497506 26700 ts_tablet_manager.cc:1434] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 13:08:55.499989 26745 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.500623 26745 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.501655 26700 tablet_bootstrap.cc:492] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.501976 26704 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.503269 26745 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.504761 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.504840 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:55.505541 26510 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.507543 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.508308 26585 raft_consensus.cc:2393] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:55.508366 26700 tablet_bootstrap.cc:654] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.509637 26476 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:55.511173 26745 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.519425 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:55.519904 26510 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:55.520150 26658 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.521072 26704 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.521024 26548 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.522166 26704 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:55.522668 26704 raft_consensus.cc:697] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:08:55.523844 26699 raft_consensus.cc:359] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.532210 26699 raft_consensus.cc:385] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.530061 26585 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.533699 26700 tablet_bootstrap.cc:492] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.534315 26700 ts_tablet_manager.cc:1403] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.007s
I20260709 13:08:55.539608 26700 raft_consensus.cc:359] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.540205 26702 tablet_bootstrap.cc:492] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.540272 26700 raft_consensus.cc:385] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.530622 26658 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:55.540755 26702 ts_tablet_manager.cc:1403] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.004s
I20260709 13:08:55.525007 26704 consensus_queue.cc:237] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.543658 26702 raft_consensus.cc:359] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.540643 26700 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.544368 26702 raft_consensus.cc:385] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.544682 26702 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.544574 26725 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:55.544936 26700 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.532732 26745 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:55.545372 26702 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.540649 26699 raft_consensus.cc:740] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.549175 26699 consensus_queue.cc:260] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.551203 26699 ts_tablet_manager.cc:1434] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.003s
I20260709 13:08:55.551843 26699 tablet_bootstrap.cc:492] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:55.554641 26700 ts_tablet_manager.cc:1434] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:08:55.555686 26700 tablet_bootstrap.cc:492] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.557689 26699 tablet_bootstrap.cc:654] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.560267 26702 ts_tablet_manager.cc:1434] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:08:55.561545 26702 tablet_bootstrap.cc:492] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
W20260709 13:08:55.567328 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:55.567386 26700 tablet_bootstrap.cc:654] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.569281 26702 tablet_bootstrap.cc:654] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.574810 26725 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:55.585129 26699 tablet_bootstrap.cc:492] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.586099 26699 ts_tablet_manager.cc:1403] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.005s
I20260709 13:08:55.589258 26699 raft_consensus.cc:359] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.588263 26407 catalog_manager.cc:5697] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.590979 26699 raft_consensus.cc:385] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.591427 26699 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.592461 26699 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.595726 26699 ts_tablet_manager.cc:1434] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:55.596953 26699 tablet_bootstrap.cc:492] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:55.598330 26702 tablet_bootstrap.cc:492] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.601207 26702 ts_tablet_manager.cc:1403] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.018s
I20260709 13:08:55.603978 26699 tablet_bootstrap.cc:654] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.604545 26702 raft_consensus.cc:359] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.605262 26702 raft_consensus.cc:385] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.605736 26700 tablet_bootstrap.cc:492] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.605717 26702 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.606294 26700 ts_tablet_manager.cc:1403] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.013s
I20260709 13:08:55.606573 26744 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.606663 26702 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.607178 26744 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.608714 26702 ts_tablet_manager.cc:1434] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:55.609908 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.610711 26700 raft_consensus.cc:359] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.611339 26700 raft_consensus.cc:385] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:55.611521 26476 leader_election.cc:343] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.614156 26702 tablet_bootstrap.cc:492] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.616118 26745 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:55.616398 26726 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:55.611608 26700 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.620568 26700 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.622628 26700 ts_tablet_manager.cc:1434] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:08:55.623925 26702 tablet_bootstrap.cc:654] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.626506 26744 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.628636 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:08:55.630692 26474 leader_election.cc:343] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.631314 26474 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:55.633580 26744 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:55.635217 26700 tablet_bootstrap.cc:492] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.669890 26710 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.670639 26710 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.675160 26726 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.676009 26710 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.676532 26710 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.675213 26745 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:55.676952 26710 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.675712 26726 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.678925 26710 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.680639 26726 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:55.681051 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:55.681286 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.682013 26583 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:55.684201 26700 tablet_bootstrap.cc:654] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:55.694072 26622 leader_election.cc:343] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.695150 26744 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.695894 26744 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.697383 26476 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.698137 26700 tablet_bootstrap.cc:492] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.698777 26700 ts_tablet_manager.cc:1403] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.006s
I20260709 13:08:55.699415 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.700428 26584 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:55.704406 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.702538 26700 raft_consensus.cc:359] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.707206 26700 raft_consensus.cc:385] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.707680 26700 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.709012 26700 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.710424 26745 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.710903 26745 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.711309 26745 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.717262 26726 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.717825 26726 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.707590 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.718447 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.719401 26658 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:55.717269 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.720763 26659 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:55.721488 26744 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.720036 26726 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:55.725872 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.726703 26583 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:55.729836 26700 ts_tablet_manager.cc:1434] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
W20260709 13:08:55.732627 26625 leader_election.cc:343] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.734050 26625 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:55.737052 26726 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:55.737274 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:55.738134 26510 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:55.736280 26700 tablet_bootstrap.cc:492] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.739807 26622 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:55.739948 26476 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.740697 26726 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.741179 26726 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.741509 26726 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.741914 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.745846 26584 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:55.755117 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.758466 26700 tablet_bootstrap.cc:654] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.763257 26702 tablet_bootstrap.cc:492] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.763360 26699 tablet_bootstrap.cc:492] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:55.764003 26702 ts_tablet_manager.cc:1403] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.150s	user 0.056s	sys 0.081s
I20260709 13:08:55.764134 26699 ts_tablet_manager.cc:1403] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.167s	user 0.068s	sys 0.062s
I20260709 13:08:55.722527 26744 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.732101 26745 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.740700 26710 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.765872 26710 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.766265 26710 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.767465 26745 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.767786 26702 raft_consensus.cc:359] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.768453 26702 raft_consensus.cc:385] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.768739 26702 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.768958 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:55.769642 26744 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.769853 26658 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.770159 26744 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.772017 26704 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:55.751727 26726 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.775689 26726 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:55.776842 26659 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:55.777077 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:55.777765 26584 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.777825 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:55.778422 26583 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.779428 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:55.779964 26710 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.781316 26509 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:08:55.782312 26710 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.783969 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:55.785166 26659 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:55.787683 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:55.788625 26730 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.789162 26730 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.789894 26476 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:55.790644 26744 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.791080 26710 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:55.791551 26730 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:55.793004 26744 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.794214 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:55.794451 26702 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.794916 26582 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.796500 26702 ts_tablet_manager.cc:1434] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:08:55.797392 26702 tablet_bootstrap.cc:492] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.794245 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:55.801071 26658 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:55.801741 26730 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.802273 26659 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.802958 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.799618 26584 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:55.802217 26474 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:08:55.804841 26625 leader_election.cc:343] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.805286 26710 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:55.807178 26745 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:55.810004 26699 raft_consensus.cc:359] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.811854 26582 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:55.812152 26583 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:55.813478 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.813935 26659 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:55.802239 26730 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.810712 26699 raft_consensus.cc:385] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.814950 26699 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.815639 26704 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.816090 26730 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:55.816164 26704 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.817269 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.805925 26710 raft_consensus.cc:697] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:08:55.818209 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:55.818656 26704 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.818236 26583 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:55.818953 26710 consensus_queue.cc:237] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.820420 26625 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:55.821238 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:08:55.822631 26548 leader_election.cc:343] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.822669 26625 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:55.821348 26730 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.823640 26726 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:55.825655 26726 raft_consensus.cc:697] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:55.826013 26702 tablet_bootstrap.cc:654] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:55.826642 26699 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.826969 26726 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.828032 26745 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:55.828616 26745 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:08:55.829484 26745 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.823426 26730 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.838876 26730 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.847780 26787 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.847918 26704 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.879897 26699 ts_tablet_manager.cc:1434] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.115s	user 0.001s	sys 0.021s
I20260709 13:08:55.881902 26699 tablet_bootstrap.cc:492] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
W20260709 13:08:55.878860 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 64978.4us
I20260709 13:08:55.885349 26784 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.886128 26784 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:55.889358 26622 leader_election.cc:343] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.881891 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.890033 26754 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:55.890585 26622 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:55.891840 26784 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.892349 26725 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:55.848598 26787 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:55.893918 26549 leader_election.cc:343] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.894887 26700 tablet_bootstrap.cc:492] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:55.894675 26549 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:55.895316 26700 ts_tablet_manager.cc:1403] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.009s
I20260709 13:08:55.895728 26754 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:55.902805 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.903486 26658 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:55.910496 26755 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.911276 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:55.911164 26755 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.912084 26710 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:55.911137 26700 raft_consensus.cc:359] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.912858 26700 raft_consensus.cc:385] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.913060 26700 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.879449 26704 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.913483 26700 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.920428 26700 ts_tablet_manager.cc:1434] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:08:55.921350 26700 tablet_bootstrap.cc:492] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:55.924337 26787 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.914640 26710 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.921963 26755 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.927423 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:55.933406 26702 tablet_bootstrap.cc:492] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:55.935894 26509 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:55.936405 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:55.936479 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.928764 26710 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:55.937417 26702 ts_tablet_manager.cc:1403] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.005s
I20260709 13:08:55.936818 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.940827 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:55.935439 26787 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.941670 26548 leader_election.cc:343] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.941774 26787 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.943523 26787 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:55.927673 26730 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.949640 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:08:55.951639 26474 leader_election.cc:343] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.955088 26784 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:55.961253 26754 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:55.962810 26476 leader_election.cc:343] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:55.967340 26702 raft_consensus.cc:359] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.968442 26702 raft_consensus.cc:385] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:55.968885 26702 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:55.969925 26702 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.965979 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.975031 26584 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:55.978142 26702 ts_tablet_manager.cc:1434] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:08:55.978906 26702 tablet_bootstrap.cc:492] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:55.965986 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:55.983381 26710 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:55.986234 26658 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:55.993633 26657 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:55.994793 26408 catalog_manager.cc:5697] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.010290 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:56.015120 26655 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.015316 26730 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:56.008831 26476 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:08:56.016312 26699 tablet_bootstrap.cc:654] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.003439 26710 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.021782 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:08:56.023792 26548 leader_election.cc:343] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.033645 26745 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:56.035838 26745 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.036242 26745 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.034179 26795 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:08:56.048255 26700 tablet_bootstrap.cc:654] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.050998 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:56.052273 26583 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.040896 26704 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.035270 26549 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:56.064340 26407 catalog_manager.cc:5697] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.067255 26407 catalog_manager.cc:5697] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.088086 26702 tablet_bootstrap.cc:654] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.069792 26704 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:56.120632 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:56.120821 26745 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.129248 26795 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:56.130999 26745 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.135700 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:56.136507 26659 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:56.137467 26699 tablet_bootstrap.cc:492] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:56.137975 26699 ts_tablet_manager.cc:1403] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.257s	user 0.015s	sys 0.011s
I20260709 13:08:56.144410 26699 raft_consensus.cc:359] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.150354 26509 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:08:56.145254 26699 raft_consensus.cc:385] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.155009 26699 raft_consensus.cc:740] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.155732 26699 consensus_queue.cc:260] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.126345 26787 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.126399 26704 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.169956 26704 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:56.175194 26797 log.cc:927] Time spent T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:08:56.161736 26699 ts_tablet_manager.cc:1434] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
W20260709 13:08:56.127220 26476 leader_election.cc:343] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.167748 26700 tablet_bootstrap.cc:492] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:56.178712 26700 ts_tablet_manager.cc:1403] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.258s	user 0.016s	sys 0.022s
I20260709 13:08:56.179870 26699 tablet_bootstrap.cc:492] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:56.181855 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:56.181926 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:56.183737 26702 tablet_bootstrap.cc:492] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:56.184461 26702 ts_tablet_manager.cc:1403] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.206s	user 0.017s	sys 0.000s
I20260709 13:08:56.179749 26583 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:56.178215 26476 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:08:56.188856 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 70047.1us
I20260709 13:08:56.191304 26744 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:56.192025 26784 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.192497 26784 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.177861 26787 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.195665 26625 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:56.197197 26725 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:56.197979 26725 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:56.199743 26796 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:56.201762 26700 raft_consensus.cc:359] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.202291 26700 raft_consensus.cc:385] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.202795 26700 raft_consensus.cc:740] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.203836 26725 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.206110 26700 consensus_queue.cc:260] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.208982 26787 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.211143 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:56.212886 26655 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
W20260709 13:08:56.213255 26474 leader_election.cc:343] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:56.198535 26549 leader_election.cc:343] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.214600 26549 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:56.214848 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:56.220177 26796 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:56.222117 26700 ts_tablet_manager.cc:1434] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:08:56.221390 26710 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:56.222713 26710 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:08:56.223310 26702 raft_consensus.cc:359] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.223564 26710 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.224005 26702 raft_consensus.cc:385] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.224886 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:56.226238 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:56.231182 26582 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:56.226447 26784 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:08:56.227802 26476 leader_election.cc:343] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.232766 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:56.233433 26656 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:56.228623 26700 tablet_bootstrap.cc:492] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:56.229103 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:08:56.234303 26476 leader_election.cc:343] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.237164 26408 catalog_manager.cc:5697] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.244519 26476 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:56.245383 26787 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:08:56.246248 26476 leader_election.cc:343] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.246870 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:56.247062 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:56.248747 26744 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:56.252447 26744 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:56.255105 26744 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.255810 26744 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.241246 26702 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.259603 26702 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.263573 26730 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:56.247637 26704 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.292544 26702 ts_tablet_manager.cc:1434] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.004s
I20260709 13:08:56.300016 26700 tablet_bootstrap.cc:654] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.302134 26704 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.303989 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:56.305137 26699 tablet_bootstrap.cc:654] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.305140 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:08:56.305872 26548 leader_election.cc:343] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.305913 26659 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.307181 26744 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.310470 26710 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:56.312009 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:08:56.313402 26476 leader_election.cc:343] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.311592 26744 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.316000 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:56.317459 26656 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.324961 26700 tablet_bootstrap.cc:492] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:56.326083 26700 ts_tablet_manager.cc:1403] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.009s
I20260709 13:08:56.329262 26710 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:56.328939 26406 catalog_manager.cc:5697] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.333375 26702 tablet_bootstrap.cc:492] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:56.338996 26704 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.339576 26704 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.335532 26656 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:56.345456 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:56.349824 26704 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.352806 26710 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:56.354902 26710 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:08:56.352857 26659 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:56.349324 26725 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:08:56.362468 26549 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:56.355641 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:56.364984 26510 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:56.365757 26755 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:56.366220 26755 raft_consensus.cc:697] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:08:56.366900 26755 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.368150 26548 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:56.357686 26710 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.371835 26700 raft_consensus.cc:359] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.372633 26700 raft_consensus.cc:385] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.373078 26700 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.373674 26744 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:56.373817 26700 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.375478 26704 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:56.375850 26704 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.376178 26704 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.361029 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:56.377507 26700 ts_tablet_manager.cc:1434] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.003s
I20260709 13:08:56.378415 26700 tablet_bootstrap.cc:492] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
W20260709 13:08:56.381873 26549 leader_election.cc:343] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.387717 26787 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.388473 26787 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.383181 26699 tablet_bootstrap.cc:492] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:56.390697 26699 ts_tablet_manager.cc:1403] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.211s	user 0.017s	sys 0.013s
I20260709 13:08:56.394452 26702 tablet_bootstrap.cc:654] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.396782 26787 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.397603 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:56.401273 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:56.402376 26656 raft_consensus.cc:2393] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 1: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:08:56.403855 26474 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:56.405339 26787 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.412554 26704 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.416200 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:56.416666 26510 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.413301 26699 raft_consensus.cc:359] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.419195 26699 raft_consensus.cc:385] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.419499 26699 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.421320 26699 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.424789 26699 ts_tablet_manager.cc:1434] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:08:56.425818 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:56.425967 26704 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:08:56.428483 26549 leader_election.cc:343] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.430332 26699 tablet_bootstrap.cc:492] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:56.433900 26510 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:56.436578 26548 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:08:56.442595 26704 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:56.445607 26704 raft_consensus.cc:697] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:08:56.446292 26704 consensus_queue.cc:237] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.452448 26408 catalog_manager.cc:5697] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.444098 26787 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:56.466153 26700 tablet_bootstrap.cc:654] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.482653 26699 tablet_bootstrap.cc:654] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.483636 26702 tablet_bootstrap.cc:492] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:56.484449 26702 ts_tablet_manager.cc:1403] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.151s	user 0.031s	sys 0.023s
I20260709 13:08:56.487388 26702 raft_consensus.cc:359] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.488179 26702 raft_consensus.cc:385] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.488488 26702 raft_consensus.cc:740] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.489203 26700 tablet_bootstrap.cc:492] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:56.489775 26700 ts_tablet_manager.cc:1403] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.004s
I20260709 13:08:56.489289 26702 consensus_queue.cc:260] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.492216 26700 raft_consensus.cc:359] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.492911 26700 raft_consensus.cc:385] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.493163 26700 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.493836 26700 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.495955 26700 ts_tablet_manager.cc:1434] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:56.496846 26700 tablet_bootstrap.cc:492] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:56.498342 26407 catalog_manager.cc:5697] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.500088 26702 ts_tablet_manager.cc:1434] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:56.501161 26702 tablet_bootstrap.cc:492] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:56.503090 26710 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:56.500494 26407 catalog_manager.cc:5697] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.511942 26700 tablet_bootstrap.cc:654] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.529399 26702 tablet_bootstrap.cc:654] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.557233 26700 tablet_bootstrap.cc:492] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:56.561444 26700 ts_tablet_manager.cc:1403] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.014s
I20260709 13:08:56.565105 26700 raft_consensus.cc:359] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.566053 26700 raft_consensus.cc:385] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.566323 26700 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.567032 26700 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.568007 26702 tablet_bootstrap.cc:492] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:56.568948 26702 ts_tablet_manager.cc:1403] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.021s
I20260709 13:08:56.570663 26699 tablet_bootstrap.cc:492] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:56.571208 26699 ts_tablet_manager.cc:1403] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.141s	user 0.022s	sys 0.018s
I20260709 13:08:56.572732 26702 raft_consensus.cc:359] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.573526 26702 raft_consensus.cc:385] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.573906 26702 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.574079 26699 raft_consensus.cc:359] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.575054 26699 raft_consensus.cc:385] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.575424 26699 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.575014 26702 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.576054 26699 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.577150 26702 ts_tablet_manager.cc:1434] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:08:56.578382 26699 ts_tablet_manager.cc:1434] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:08:56.578891 26702 tablet_bootstrap.cc:492] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:56.586776 26702 tablet_bootstrap.cc:654] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.587567 26700 ts_tablet_manager.cc:1434] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:08:56.588979 26700 tablet_bootstrap.cc:492] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:56.598750 26699 tablet_bootstrap.cc:492] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:56.602010 26744 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.602752 26744 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.607041 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:08:56.609607 26474 leader_election.cc:343] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.605307 26744 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.611244 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:56.612478 26702 tablet_bootstrap.cc:492] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
W20260709 13:08:56.612610 26476 leader_election.cc:343] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.612962 26700 tablet_bootstrap.cc:654] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.613098 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:56.613718 26702 ts_tablet_manager.cc:1403] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.009s
I20260709 13:08:56.614256 26744 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:56.616222 26699 tablet_bootstrap.cc:654] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.617067 26702 raft_consensus.cc:359] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:56.617587 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:56.617974 26702 raft_consensus.cc:385] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.618348 26702 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.619067 26702 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.621551 26700 tablet_bootstrap.cc:492] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:56.622082 26700 ts_tablet_manager.cc:1403] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.001s
I20260709 13:08:56.622663 26702 ts_tablet_manager.cc:1434] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:56.623536 26702 tablet_bootstrap.cc:492] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:56.624776 26700 raft_consensus.cc:359] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.625540 26700 raft_consensus.cc:385] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.625893 26700 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.626652 26700 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.628928 26702 tablet_bootstrap.cc:654] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.629164 26699 tablet_bootstrap.cc:492] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:56.629673 26699 ts_tablet_manager.cc:1403] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.006s
I20260709 13:08:56.632292 26699 raft_consensus.cc:359] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.633019 26699 raft_consensus.cc:385] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.635234 26700 ts_tablet_manager.cc:1434] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:08:56.633426 26699 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.636543 26699 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.638839 26699 ts_tablet_manager.cc:1434] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:56.640976 26700 tablet_bootstrap.cc:492] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:56.642251 26702 tablet_bootstrap.cc:492] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:56.642956 26702 ts_tablet_manager.cc:1403] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:08:56.646718 26702 raft_consensus.cc:359] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.647526 26702 raft_consensus.cc:385] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.647812 26702 raft_consensus.cc:740] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.648433 26702 consensus_queue.cc:260] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.649173 26700 tablet_bootstrap.cc:654] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.650641 26702 ts_tablet_manager.cc:1434] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:56.654021 26702 tablet_bootstrap.cc:492] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:56.654714 26699 tablet_bootstrap.cc:492] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:56.654204 26700 tablet_bootstrap.cc:492] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:56.656126 26700 ts_tablet_manager.cc:1403] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:08:56.658951 26700 raft_consensus.cc:359] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.659703 26700 raft_consensus.cc:385] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.660012 26700 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.661080 26702 tablet_bootstrap.cc:654] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.660771 26700 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.662523 26699 tablet_bootstrap.cc:654] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.663308 26700 ts_tablet_manager.cc:1434] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:56.664638 26700 tablet_bootstrap.cc:492] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:56.667706 26725 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.668443 26725 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.671592 26725 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:56.672938 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:56.673945 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:56.674661 26510 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:56.673967 26582 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:56.676326 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:56.679320 26725 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:56.679776 26704 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.680552 26704 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.687748 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:56.688689 26510 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:56.689963 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:56.690773 26699 tablet_bootstrap.cc:492] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:56.690837 26755 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:56.691249 26755 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.691622 26755 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.692212 26702 tablet_bootstrap.cc:492] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:56.692685 26702 ts_tablet_manager.cc:1403] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.014s
I20260709 13:08:56.693137 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:56.694002 26659 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:56.695554 26704 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.679773 26725 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.691330 26699 ts_tablet_manager.cc:1403] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.016s
I20260709 13:08:56.696966 26725 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.679131 26700 tablet_bootstrap.cc:654] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.698801 26755 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.695451 26702 raft_consensus.cc:359] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.699674 26702 raft_consensus.cc:385] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.699481 26699 raft_consensus.cc:359] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.700083 26702 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.700215 26699 raft_consensus.cc:385] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:56.701077 26702 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.701620 26699 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:56.701803 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:56.702550 26699 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.704156 26702 ts_tablet_manager.cc:1434] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:08:56.704687 26699 ts_tablet_manager.cc:1434] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:56.705775 26702 tablet_bootstrap.cc:492] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:56.706136 26725 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.709280 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:56.710014 26507 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.713688 26702 tablet_bootstrap.cc:654] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.715627 26730 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.716296 26730 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.719995 26726 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.720433 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:56.723425 26726 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.724383 26509 raft_consensus.cc:2393] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:08:56.719293 26730 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:56.721858 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:56.722610 26744 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:56.729722 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:56.702380 26510 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.735304 26699 tablet_bootstrap.cc:492] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:56.740818 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:56.741906 26582 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.759305 26755 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.718261 26507 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:56.759804 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:56.760869 26655 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.761550 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:56.762617 26583 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:56.763942 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:56.764864 26726 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:56.766566 26726 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:56.769085 26726 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.771755 26510 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:56.772550 26582 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:56.773451 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:56.776180 26704 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:56.776845 26704 raft_consensus.cc:697] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:08:56.776949 26726 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.738009 26730 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.756856 26725 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:56.792524 26704 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:56.796370 26476 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.804471 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 74940.9us
I20260709 13:08:56.806670 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:56.810024 26699 tablet_bootstrap.cc:654] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:56.819603 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:56.811298 26726 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.831733 26726 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:56.837041 26835 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:56.837697 26835 raft_consensus.cc:697] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:08:56.842993 26622 leader_election.cc:343] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:56.847235 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 83342.3us
I20260709 13:08:56.846920 26655 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:56.860857 26700 tablet_bootstrap.cc:492] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:56.861416 26700 ts_tablet_manager.cc:1403] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.197s	user 0.049s	sys 0.031s
I20260709 13:08:56.860097 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:56.866329 26583 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.875823 26795 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:56.876571 26726 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:56.881384 26835 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.882524 26730 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:56.902989 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:56.906697 26704 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:56.912303 26702 tablet_bootstrap.cc:492] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:56.913005 26702 ts_tablet_manager.cc:1403] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.207s	user 0.055s	sys 0.056s
I20260709 13:08:56.948065 26754 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:56.961519 26796 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.969838 26796 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.977476 26796 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:56.978717 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:56.979419 26659 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:56.979686 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:56.980792 26549 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:08:56.981796 26548 leader_election.cc:343] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:56.982307 26754 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:56.982751 26754 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.983134 26754 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:56.987370 26702 raft_consensus.cc:359] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:56.989984 26704 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:56.990038 26702 raft_consensus.cc:385] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.001854 26702 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.004659 26702 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.007848 26700 raft_consensus.cc:359] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.008863 26700 raft_consensus.cc:385] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.009235 26700 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.015049 26700 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.017331 26702 ts_tablet_manager.cc:1434] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.002s
I20260709 13:08:57.021729 26702 tablet_bootstrap.cc:492] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
W20260709 13:08:57.011955 26476 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.047224 26700 ts_tablet_manager.cc:1434] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.185s	user 0.010s	sys 0.001s
I20260709 13:08:57.048751 26700 tablet_bootstrap.cc:492] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:57.037223 26784 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.041577 26787 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.066252 26699 tablet_bootstrap.cc:492] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:57.066941 26699 ts_tablet_manager.cc:1403] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.332s	user 0.046s	sys 0.105s
I20260709 13:08:57.057628 26784 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.065482 26787 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.077940 26583 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:57.097869 26841 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.098590 26841 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.101272 26841 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:57.101847 26784 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:57.103380 26754 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:57.105698 26622 leader_election.cc:343] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:57.107596 26841 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.108070 26841 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:57.133410 26842 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:57.125905 26754 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:57.143246 26699 raft_consensus.cc:359] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.143985 26699 raft_consensus.cc:385] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.144282 26699 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.144892 26699 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.147182 26699 ts_tablet_manager.cc:1434] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.080s	user 0.003s	sys 0.003s
I20260709 13:08:57.148231 26699 tablet_bootstrap.cc:492] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:57.152472 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:57.153120 26787 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:57.137149 26841 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:57.159459 26702 tablet_bootstrap.cc:654] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:57.153126 26656 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:57.175825 26700 tablet_bootstrap.cc:654] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:57.183893 26754 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.190270 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:57.186347 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:57.192126 26582 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:57.191093 26754 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:57.194955 26844 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:08:57.200284 26583 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:57.203251 26754 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:57.197620 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:57.205051 26841 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:57.205659 26841 raft_consensus.cc:697] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:57.206135 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:57.206800 26784 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.207286 26784 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.206815 26658 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:57.206543 26841 consensus_queue.cc:237] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.208901 26549 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:57.209272 26699 tablet_bootstrap.cc:654] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:57.209462 26784 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:57.211030 26796 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:57.211650 26796 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.211910 26656 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:57.212009 26796 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:57.216136 26700 tablet_bootstrap.cc:492] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:57.216655 26700 ts_tablet_manager.cc:1403] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.168s	user 0.007s	sys 0.010s
I20260709 13:08:57.216763 26549 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:57.222340 26795 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:57.223026 26795 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:08:57.224128 26795 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.207304 26625 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:57.236111 26835 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:57.253407 26835 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.253942 26835 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:57.263370 26835 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.266733 26702 tablet_bootstrap.cc:492] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:57.267427 26702 ts_tablet_manager.cc:1403] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.246s	user 0.019s	sys 0.008s
I20260709 13:08:57.277494 26700 raft_consensus.cc:359] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.278373 26700 raft_consensus.cc:385] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.278694 26700 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.275308 26840 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.279291 26700 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.279959 26840 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.281301 26700 ts_tablet_manager.cc:1434] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.003s
I20260709 13:08:57.282255 26700 tablet_bootstrap.cc:492] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:57.283869 26835 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:57.284375 26702 raft_consensus.cc:359] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.285224 26702 raft_consensus.cc:385] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.285597 26702 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.286283 26702 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.287195 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:57.287779 26582 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:57.288714 26702 ts_tablet_manager.cc:1434] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:08:57.291689 26784 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.291950 26625 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:57.292244 26784 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.294399 26702 tablet_bootstrap.cc:492] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:57.294026 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:57.298755 26841 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:57.304564 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:57.309816 26841 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.305285 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:57.304896 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:57.310220 26841 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:57.275319 26796 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.304126 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:57.331404 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:57.310748 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:57.330116 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:57.333884 26784 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:57.341847 26699 tablet_bootstrap.cc:492] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:57.342372 26699 ts_tablet_manager.cc:1403] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.194s	user 0.032s	sys 0.038s
I20260709 13:08:57.350142 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:57.350543 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:57.357271 26700 tablet_bootstrap.cc:654] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:57.357913 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:57.363840 26784 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:08:57.371748 26796 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:57.373358 26702 tablet_bootstrap.cc:654] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:57.373971 26851 log.cc:927] Time spent T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:08:57.375120 26699 raft_consensus.cc:359] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:57.351333 26548 leader_election.cc:343] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:57.348217 26508 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:57.389797 26699 raft_consensus.cc:385] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.392306 26699 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.363368 26506 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:57.393133 26699 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:57.382503 26474 leader_election.cc:343] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:57.377570 26582 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:57.417912 26699 ts_tablet_manager.cc:1434] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
W20260709 13:08:57.426275 26474 leader_election.cc:343] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:57.427161 26474 leader_election.cc:343] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:57.416334 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:57.435446 26841 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.438598 26841 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:57.416819 26840 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:57.444368 26656 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:57.631336 26858 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.631989 26858 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.759256 26858 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:08:57.772440 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:57.854171 26700 tablet_bootstrap.cc:492] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:57.854601 26700 ts_tablet_manager.cc:1403] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.573s	user 0.016s	sys 0.038s
I20260709 13:08:57.857164 26700 raft_consensus.cc:359] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.857918 26700 raft_consensus.cc:385] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.858212 26700 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.859115 26700 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.860603 26700 ts_tablet_manager.cc:1434] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 13:08:57.861439 26700 tablet_bootstrap.cc:492] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:57.867100 26700 tablet_bootstrap.cc:654] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:57.871757 26700 tablet_bootstrap.cc:492] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:57.872239 26700 ts_tablet_manager.cc:1403] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:08:57.872735 26405 catalog_manager.cc:5697] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.874853 26700 raft_consensus.cc:359] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.875519 26700 raft_consensus.cc:385] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.875762 26700 raft_consensus.cc:740] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.876528 26700 consensus_queue.cc:260] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.878607 26700 ts_tablet_manager.cc:1434] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:57.879793 26700 tablet_bootstrap.cc:492] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:57.885888 26700 tablet_bootstrap.cc:654] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:57.889828 26476 leader_election.cc:343] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:57.890347 26476 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:57.890588 26700 tablet_bootstrap.cc:492] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:57.891042 26700 ts_tablet_manager.cc:1403] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:08:57.890983 26858 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:57.891378 26476 leader_election.cc:343] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:57.891788 26476 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:57.892400 26858 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:57.892787 26476 leader_election.cc:343] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:57.893195 26476 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:57.893298 26700 raft_consensus.cc:359] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.893850 26858 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:57.893958 26700 raft_consensus.cc:385] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.894315 26700 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.894980 26700 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.895972 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:57.896612 26508 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:57.896858 26700 ts_tablet_manager.cc:1434] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:08:57.897781 26700 tablet_bootstrap.cc:492] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:57.903030 26700 tablet_bootstrap.cc:654] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:57.907298 26700 tablet_bootstrap.cc:492] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:57.907719 26700 ts_tablet_manager.cc:1403] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:57.909492 26700 raft_consensus.cc:359] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.910090 26700 raft_consensus.cc:385] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.910252 26700 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.910732 26700 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.912468 26700 ts_tablet_manager.cc:1434] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:08:57.913091 26700 tablet_bootstrap.cc:492] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:57.913039 26864 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.913611 26864 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:57.915185 26784 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.014s
I20260709 13:08:57.915426 26864 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:08:57.915490 26784 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.011s	sys 0.014s
I20260709 13:08:57.919785 26700 tablet_bootstrap.cc:654] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:57.920614 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:57.923463 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:57.923944 26841 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.924240 26580 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:08:57.924505 26841 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.926425 26700 tablet_bootstrap.cc:492] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:57.926864 26841 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:57.926867 26700 ts_tablet_manager.cc:1403] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.003s
W20260709 13:08:57.929162 26474 leader_election.cc:343] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:57.929767 26700 raft_consensus.cc:359] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.930444 26700 raft_consensus.cc:385] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.930773 26700 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.931428 26700 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.932618 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:57.933075 26700 ts_tablet_manager.cc:1434] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:08:57.933933 26700 tablet_bootstrap.cc:492] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
W20260709 13:08:57.936386 26625 leader_election.cc:343] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:57.937422 26840 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:57.940758 26700 tablet_bootstrap.cc:654] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:57.942433 26625 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:57.946484 26835 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:57.947003 26835 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:57.947873 26835 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.948931 26700 tablet_bootstrap.cc:492] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:57.949440 26700 ts_tablet_manager.cc:1403] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:08:57.950169 26841 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:57.950841 26699 tablet_bootstrap.cc:492] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:57.952103 26700 raft_consensus.cc:359] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.952785 26700 raft_consensus.cc:385] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:57.953114 26700 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:57.953801 26700 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.955760 26700 ts_tablet_manager.cc:1434] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:57.956720 26700 tablet_bootstrap.cc:492] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:57.959389 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:57.960059 26506 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:57.963825 26857 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.964318 26857 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:57.966317 26857 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:57.966440 26508 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:57.967218 26700 tablet_bootstrap.cc:654] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:57.969125 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:57.972616 26622 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:57.973403 26841 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:57.973769 26841 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.974108 26841 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:57.974301 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:57.975189 26505 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:57.980552 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:57.981424 26581 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:57.996484 26582 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:57.997313 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:08:57.999284 26702 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.005s	sys 0.011s
W20260709 13:08:57.999620 26702 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.005s	sys 0.011s
I20260709 13:08:58.002099 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.003196 26581 raft_consensus.cc:2393] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:58.009248 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.015915 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.034583 26699 tablet_bootstrap.cc:654] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:58.035902 26702 tablet_bootstrap.cc:492] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:58.036582 26702 ts_tablet_manager.cc:1403] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.742s	user 0.018s	sys 0.016s
I20260709 13:08:58.043109 26862 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:08:58.045437 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:58.051759 26506 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:58.053646 26704 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:58.054914 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 708523us
I20260709 13:08:58.077622 26744 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.086004 26744 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.088181 26744 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:58.089520 26702 raft_consensus.cc:359] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.090286 26702 raft_consensus.cc:385] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.090809 26702 raft_consensus.cc:740] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.091568 26702 consensus_queue.cc:260] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:58.071133 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 87721us
I20260709 13:08:58.096560 26702 ts_tablet_manager.cc:1434] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.003s
I20260709 13:08:58.098937 26702 tablet_bootstrap.cc:492] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:58.102840 26622 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.104804 26476 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.112746 26883 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:58.113262 26883 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.113714 26883 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.110850 26858 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.131189 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:08:58.131181 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 49217.9us
I20260709 13:08:58.131999 26508 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:58.119767 26858 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.136663 26878 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.130678 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.134083 26744 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.141381 26744 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.143671 26699 tablet_bootstrap.cc:492] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:58.144088 26699 ts_tablet_manager.cc:1403] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.193s	user 0.009s	sys 0.014s
I20260709 13:08:58.134958 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:08:58.134874 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 54207.1us
I20260709 13:08:58.143585 26744 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:58.149605 26730 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:58.150319 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:58.159998 26700 tablet_bootstrap.cc:492] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:58.161070 26700 ts_tablet_manager.cc:1403] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.205s	user 0.043s	sys 0.073s
W20260709 13:08:58.170302 26474 leader_election.cc:343] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.158707 26506 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:58.171342 26835 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.157433 26730 raft_consensus.cc:697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:58.171841 26835 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.172425 26730 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.172935 26840 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:58.158998 26744 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.173960 26835 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:58.173833 26744 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.175801 26744 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:58.176447 26858 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:08:58.176918 26476 leader_election.cc:343] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.177341 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.179404 26476 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.179675 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.180063 26787 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:58.182709 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:58.183611 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:58.184924 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:58.185230 26784 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.187491 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.187965 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.188271 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.188602 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:08:58.181589 26625 leader_election.cc:343] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.153635 26881 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:08:58.148240 26841 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.199736 26653 raft_consensus.cc:2393] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:58.199415 26700 raft_consensus.cc:359] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.202875 26841 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:58.205891 26700 raft_consensus.cc:385] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.206254 26700 raft_consensus.cc:740] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.206938 26700 consensus_queue.cc:260] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.209255 26700 ts_tablet_manager.cc:1434] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.002s
I20260709 13:08:58.217778 26700 tablet_bootstrap.cc:492] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:58.224560 26702 tablet_bootstrap.cc:654] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:58.224925 26841 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:58.236811 26476 leader_election.cc:343] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.238225 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:58.208992 26883 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.239166 26507 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
W20260709 13:08:58.217065 26474 leader_election.cc:343] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.250640 26699 raft_consensus.cc:359] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.262882 26699 raft_consensus.cc:385] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.263190 26699 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.264196 26699 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:58.263900 26476 leader_election.cc:343] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.270316 26883 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:58.258788 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:58.275399 26583 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:58.263810 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 45735.4us
W20260709 13:08:58.280339 26474 leader_election.cc:343] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.280831 26474 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.283819 26754 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:58.282971 26744 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:58.285171 26476 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.286621 26744 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:58.286769 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 49108.1us
W20260709 13:08:58.287513 26476 leader_election.cc:343] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.279557 26878 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:58.294828 26476 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.296377 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:58.296952 26548 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:58.302403 26548 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:08:58.303915 26862 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:08:58.309459 26548 consensus_peers.cc:597] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:58.312686 26699 ts_tablet_manager.cc:1434] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.168s	user 0.011s	sys 0.004s
I20260709 13:08:58.313637 26699 tablet_bootstrap.cc:492] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:58.312728 26878 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:58.317615 26476 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.325172 26702 tablet_bootstrap.cc:492] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:58.325793 26702 ts_tablet_manager.cc:1403] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.227s	user 0.026s	sys 0.010s
I20260709 13:08:58.328001 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:58.328637 26507 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.334023 26702 raft_consensus.cc:359] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.332280 26407 catalog_manager.cc:5697] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.336694 26702 raft_consensus.cc:385] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.337041 26702 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.337703 26702 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.337718 26407 catalog_manager.cc:5697] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.315246 26583 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:58.346455 26702 ts_tablet_manager.cc:1434] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:08:58.347625 26702 tablet_bootstrap.cc:492] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:58.344183 26754 raft_consensus.cc:2764] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:08:58.335882 26507 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:58.336418 26405 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34762 (request call id 47) took 1056 ms. Trace:
W20260709 13:08:58.343343 26625 leader_election.cc:343] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.346809 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.359108 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:58.376238 26622 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:58.376986 26730 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:58.377184 26508 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.377521 26730 raft_consensus.cc:697] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:58.378374 26730 consensus_queue.cc:237] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.372637 26883 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:58.386340 26878 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.396914 26878 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.397382 26878 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.384258 26883 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.399348 26883 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.357673 26405 rpcz_store.cc:276] 0709 13:08:57.270633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.270791 (+   158us) service_pool.cc:224] Handling call
0709 13:08:58.326439 (+1055648us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:57.881343 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:57.881981 (+   638us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:57.882016 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:57.882036 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:57.882408 (+   372us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:57.882480 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:57.882520 (+    40us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:57.882724 (+   204us) tablet.cc:701] Row locks acquired
0709 13:08:57.882752 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:08:57.882889 (+   137us) write_op.cc:270] Start()
0709 13:08:57.883065 (+   176us) write_op.cc:276] Timestamp: P: 1783602537882841 usec, L: 0
0709 13:08:57.883096 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:08:57.883963 (+   867us) log.cc:844] Serialized 543 byte log entry
0709 13:08:58.125220 (+241257us) op_driver.cc:464] REPLICATION: finished
0709 13:08:58.285239 (+160019us) write_op.cc:301] APPLY: starting
0709 13:08:58.287402 (+  2163us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:58.287533 (+   131us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:58.293251 (+  5718us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:58.294982 (+  1731us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:58.295195 (+   213us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:58.295263 (+    68us) write_op.cc:312] APPLY: finished
0709 13:08:58.295537 (+   274us) log.cc:844] Serialized 22 byte log entry
0709 13:08:58.295727 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:58.295802 (+    75us) write_op.cc:454] Released schema lock
0709 13:08:58.295835 (+    33us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:58.296140 (+   305us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:58.296166 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":152780,"apply.run_cpu_time_us":2119,"apply.run_wall_time_us":12865,"num_ops":1,"prepare.queue_time_us":4917,"prepare.run_cpu_time_us":2823,"prepare.run_wall_time_us":2910,"replication_time_us":237990,"thread_start_us":91899,"threads_started":2}]]}
I20260709 13:08:58.407388 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.408138 26700 tablet_bootstrap.cc:654] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:58.409833 26476 leader_election.cc:343] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.414196 26878 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:58.424012 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:08:58.437480 26474 leader_election.cc:343] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.438160 26474 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.439215 26744 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:58.441342 26899 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:58.446554 26883 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.450028 26508 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:58.459504 26699 tablet_bootstrap.cc:654] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:58.460986 26702 tablet_bootstrap.cc:654] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:58.465591 26622 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.467023 26883 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:58.467530 26835 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:58.468106 26835 raft_consensus.cc:697] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:58.468670 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:58.469420 26700 tablet_bootstrap.cc:492] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:58.469004 26835 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.469945 26700 ts_tablet_manager.cc:1403] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.252s	user 0.009s	sys 0.031s
I20260709 13:08:58.470283 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:08:58.470835 26625 leader_election.cc:343] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.470944 26510 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.482810 26700 raft_consensus.cc:359] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.473361 26405 catalog_manager.cc:5697] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:08:58.483623 26700 raft_consensus.cc:385] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.483989 26700 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.487241 26510 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:58.489492 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.491093 26730 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:58.491957 26730 raft_consensus.cc:697] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:58.490696 26700 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.494886 26730 consensus_queue.cc:237] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.496029 26700 ts_tablet_manager.cc:1434] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:08:58.503286 26700 tablet_bootstrap.cc:492] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:58.504434 26702 tablet_bootstrap.cc:492] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:58.505015 26702 ts_tablet_manager.cc:1403] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.158s	user 0.008s	sys 0.007s
I20260709 13:08:58.517369 26406 catalog_manager.cc:5697] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.518960 26702 raft_consensus.cc:359] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.526670 26702 raft_consensus.cc:385] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.526991 26702 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.528086 26702 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.529636 26406 catalog_manager.cc:5697] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.531415 26702 ts_tablet_manager.cc:1434] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 13:08:58.532946 26702 tablet_bootstrap.cc:492] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:58.532645 26406 catalog_manager.cc:5697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.536926 26699 tablet_bootstrap.cc:492] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:58.537459 26699 ts_tablet_manager.cc:1403] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.224s	user 0.012s	sys 0.004s
I20260709 13:08:58.542996 26699 raft_consensus.cc:359] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.543830 26699 raft_consensus.cc:385] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.544126 26699 raft_consensus.cc:740] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.544840 26699 consensus_queue.cc:260] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.546514 26700 tablet_bootstrap.cc:654] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:58.548341 26730 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:58.553345 26699 ts_tablet_manager.cc:1434] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:08:58.554435 26699 tablet_bootstrap.cc:492] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:58.556399 26862 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.556915 26862 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.559769 26862 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:58.561230 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:58.561887 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:58.565057 26702 tablet_bootstrap.cc:654] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:58.565883 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:58.566640 26862 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:58.575150 26730 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:58.575690 26585 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:58.593258 26531 debug-util.cc:398] Leaking SignalData structure 0x7b0800088320 after lost signal to thread 25398
I20260709 13:08:58.593693 26700 tablet_bootstrap.cc:492] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:58.594197 26700 ts_tablet_manager.cc:1403] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.011s
W20260709 13:08:58.594336 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08001ceee0 after lost signal to thread 26442
W20260709 13:08:58.595424 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9340 after lost signal to thread 26534
W20260709 13:08:58.596380 26531 debug-util.cc:398] Leaking SignalData structure 0x7b0800238560 after lost signal to thread 26609
W20260709 13:08:58.597306 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08001fd4c0 after lost signal to thread 26683
I20260709 13:08:58.596911 26700 raft_consensus.cc:359] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.597951 26700 raft_consensus.cc:385] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.598261 26700 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
W20260709 13:08:58.604005 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08001fd840 after lost signal to thread 26726
W20260709 13:08:58.606415 26531 debug-util.cc:398] Leaking SignalData structure 0x7b0800121220 after lost signal to thread 26815
W20260709 13:08:58.606772 26531 debug-util.cc:398] Leaking SignalData structure 0x7b080013e9c0 after lost signal to thread 26834
I20260709 13:08:58.609213 26700 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.609876 26699 tablet_bootstrap.cc:654] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:58.629155 26700 ts_tablet_manager.cc:1434] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:08:58.630353 26700 tablet_bootstrap.cc:492] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:58.675177 26700 tablet_bootstrap.cc:654] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:58.677299 26730 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.679557 26730 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.697765 26730 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:58.698796 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.697472 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:08:58.702801 26625 leader_election.cc:343] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:58.703991 26622 leader_election.cc:343] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.704454 26622 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.704759 26699 tablet_bootstrap.cc:492] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:58.705804 26699 ts_tablet_manager.cc:1403] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.005s
I20260709 13:08:58.706764 26883 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:58.707826 26407 catalog_manager.cc:5697] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.713433 26862 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.714119 26862 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.719017 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:58.719630 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:58.720896 26508 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:08:58.719197 26407 catalog_manager.cc:5697] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.721239 26862 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:58.711206 26699 raft_consensus.cc:359] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.721086 26702 tablet_bootstrap.cc:492] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:58.722636 26699 raft_consensus.cc:385] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.722401 26548 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:58.722990 26699 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.724092 26862 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.723832 26699 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.724651 26702 ts_tablet_manager.cc:1403] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.192s	user 0.013s	sys 0.007s
I20260709 13:08:58.728838 26702 raft_consensus.cc:359] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.729735 26702 raft_consensus.cc:385] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.730139 26702 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.730993 26702 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.735756 26702 ts_tablet_manager.cc:1434] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:08:58.738437 26755 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.739318 26700 tablet_bootstrap.cc:492] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:58.739084 26755 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.740052 26700 ts_tablet_manager.cc:1403] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.110s	user 0.020s	sys 0.007s
I20260709 13:08:58.740991 26699 ts_tablet_manager.cc:1434] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.002s
I20260709 13:08:58.742478 26755 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:58.743891 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:58.744261 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:58.745126 26508 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
W20260709 13:08:58.745900 26549 leader_election.cc:343] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.746503 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:08:58.746338 26700 raft_consensus.cc:359] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.747192 26700 raft_consensus.cc:385] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.747279 26699 tablet_bootstrap.cc:492] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:58.747582 26700 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.748685 26704 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:58.748598 26700 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.749152 26704 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.749519 26704 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.756083 26702 tablet_bootstrap.cc:492] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:58.779278 26862 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:58.780644 26883 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.781384 26883 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.782691 26699 tablet_bootstrap.cc:654] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:58.785108 26881 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.786072 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:58.786530 26881 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.787034 26510 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:58.786084 26508 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.789322 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:08:58.792579 26841 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:58.793021 26841 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.793411 26841 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.791254 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.787281 26730 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:08:58.800908 26883 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:58.789494 26881 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:58.802503 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:08:58.803980 26622 leader_election.cc:343] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.801492 26730 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:08:58.807206 26625 leader_election.cc:343] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.807814 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.809409 26730 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:58.807717 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.851596 26784 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.886920 26702 tablet_bootstrap.cc:654] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:58.888432 26700 ts_tablet_manager.cc:1434] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.148s	user 0.010s	sys 0.002s
I20260709 13:08:58.882670 26704 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.896265 26704 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:58.899642 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:58.899849 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:58.900338 26506 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:58.888149 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 81003.3us
I20260709 13:08:58.897620 26841 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:58.902789 26625 leader_election.cc:343] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.883244 26784 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:58.905000 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:08:58.905740 26549 leader_election.cc:343] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.903831 26841 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:58.915840 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:58.918280 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:08:58.921545 26476 leader_election.cc:343] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.924070 26700 tablet_bootstrap.cc:492] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:58.910583 26784 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:58.919405 26509 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:58.929363 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:58.943436 26841 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:58.945083 26625 leader_election.cc:343] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.947880 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:08:58.966182 26474 leader_election.cc:343] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:58.966789 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:58.968734 26841 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:58.970039 26875 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:58.971357 26878 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:58.991479 26702 tablet_bootstrap.cc:492] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:58.992194 26702 ts_tablet_manager.cc:1403] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.236s	user 0.011s	sys 0.026s
I20260709 13:08:58.995484 26702 raft_consensus.cc:359] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:58.996137 26702 raft_consensus.cc:385] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:58.996440 26702 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:58.997046 26702 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.005447 26700 tablet_bootstrap.cc:654] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:59.006348 26625 consensus_peers.cc:597] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.006848 26922 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.007728 26699 tablet_bootstrap.cc:492] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:59.007470 26922 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.008208 26699 ts_tablet_manager.cc:1403] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.261s	user 0.027s	sys 0.009s
I20260709 13:08:59.030118 26509 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:59.031142 26730 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:59.034763 26922 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.043689 26699 raft_consensus.cc:359] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.044880 26699 raft_consensus.cc:385] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.045079 26699 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.047318 26784 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:08:59.048454 26784 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.052515 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.053480 26883 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:59.054054 26883 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:59.055202 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:59.055052 26883 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.037619 26506 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:59.069866 26702 ts_tablet_manager.cc:1434] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.003s
I20260709 13:08:59.077545 26699 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.087138 26784 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.093521 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:08:59.094378 26841 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:59.094607 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:59.094914 26755 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:59.095376 26755 raft_consensus.cc:697] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:08:59.096901 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:59.097436 26755 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.098052 26699 ts_tablet_manager.cc:1434] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.089s	user 0.011s	sys 0.001s
I20260709 13:08:59.100157 26699 tablet_bootstrap.cc:492] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:59.102450 26700 tablet_bootstrap.cc:492] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:59.102911 26700 ts_tablet_manager.cc:1403] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.179s	user 0.018s	sys 0.006s
W20260709 13:08:59.110497 26474 leader_election.cc:343] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:59.111606 26476 leader_election.cc:343] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.112221 26476 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.113267 26922 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:59.113500 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:59.119618 26702 tablet_bootstrap.cc:492] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:59.122859 26474 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.123906 26922 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.131424 26407 catalog_manager.cc:5697] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.136459 26700 raft_consensus.cc:359] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.137163 26700 raft_consensus.cc:385] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.137405 26700 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.145471 26702 tablet_bootstrap.cc:654] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.146811 26700 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.164559 26700 ts_tablet_manager.cc:1434] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 13:08:59.166021 26700 tablet_bootstrap.cc:492] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:59.157928 26406 catalog_manager.cc:5697] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.172379 26699 tablet_bootstrap.cc:654] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.196270 26700 tablet_bootstrap.cc:654] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.204857 26702 tablet_bootstrap.cc:492] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:59.205379 26702 ts_tablet_manager.cc:1403] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.002s
I20260709 13:08:59.207577 26702 raft_consensus.cc:359] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.207773 26700 tablet_bootstrap.cc:492] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:59.208110 26702 raft_consensus.cc:385] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.208338 26700 ts_tablet_manager.cc:1403] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.003s
I20260709 13:08:59.208406 26702 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.209225 26702 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.211745 26702 ts_tablet_manager.cc:1434] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:59.213075 26702 tablet_bootstrap.cc:492] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:59.212080 26700 raft_consensus.cc:359] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.218359 26700 raft_consensus.cc:385] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.218665 26700 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.219401 26700 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.221611 26700 ts_tablet_manager.cc:1434] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:08:59.222640 26700 tablet_bootstrap.cc:492] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:59.225327 26702 tablet_bootstrap.cc:654] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.228688 26700 tablet_bootstrap.cc:654] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.243608 26702 tablet_bootstrap.cc:492] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:59.244232 26702 ts_tablet_manager.cc:1403] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 13:08:59.247798 26702 raft_consensus.cc:359] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.248817 26702 raft_consensus.cc:385] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.249166 26702 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.251173 26702 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.252112 26700 tablet_bootstrap.cc:492] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:59.252554 26700 ts_tablet_manager.cc:1403] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.012s
I20260709 13:08:59.253619 26702 ts_tablet_manager.cc:1434] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:08:59.254716 26702 tablet_bootstrap.cc:492] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:59.255637 26700 raft_consensus.cc:359] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.256294 26700 raft_consensus.cc:385] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.256541 26700 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.257193 26700 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.259424 26700 ts_tablet_manager.cc:1434] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:08:59.260686 26700 tablet_bootstrap.cc:492] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:59.269659 26700 tablet_bootstrap.cc:654] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.270709 26744 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.271341 26744 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.274709 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:08:59.276212 26476 leader_election.cc:343] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.276775 26702 tablet_bootstrap.cc:654] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.277201 26744 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.278160 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:59.278822 26658 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:59.281062 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.282074 26744 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:59.282510 26699 tablet_bootstrap.cc:492] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:59.282442 26744 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.282932 26744 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.283083 26699 ts_tablet_manager.cc:1403] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.184s	user 0.043s	sys 0.028s
I20260709 13:08:59.286033 26699 raft_consensus.cc:359] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.286795 26699 raft_consensus.cc:385] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.287109 26699 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.287936 26699 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.290010 26699 ts_tablet_manager.cc:1434] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:59.303651 26699 tablet_bootstrap.cc:492] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:59.307274 26744 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.312858 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:59.309675 26699 tablet_bootstrap.cc:654] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:59.314913 26476 leader_election.cc:343] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.323333 26702 tablet_bootstrap.cc:492] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:59.324043 26702 ts_tablet_manager.cc:1403] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.009s
I20260709 13:08:59.324178 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:59.325045 26658 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.327663 26702 raft_consensus.cc:359] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.328658 26702 raft_consensus.cc:385] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.328927 26702 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.329506 26702 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.331898 26702 ts_tablet_manager.cc:1434] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:59.333011 26702 tablet_bootstrap.cc:492] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:59.337687 26744 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.339532 26702 tablet_bootstrap.cc:654] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.340392 26658 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:59.342578 26744 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.343791 26700 tablet_bootstrap.cc:492] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:59.343233 26744 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.344269 26700 ts_tablet_manager.cc:1403] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.029s
I20260709 13:08:59.347800 26700 raft_consensus.cc:359] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.348672 26700 raft_consensus.cc:385] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.349009 26700 raft_consensus.cc:740] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.350471 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.351606 26862 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.351975 26784 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:59.352114 26862 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.352660 26784 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:08:59.353885 26784 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.354570 26862 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.355463 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:59.358789 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:59.359951 26504 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:59.350013 26700 consensus_queue.cc:260] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:59.362327 26476 leader_election.cc:343] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.364171 26700 ts_tablet_manager.cc:1434] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 13:08:59.364015 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:08:59.365453 26862 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:59.365829 26700 tablet_bootstrap.cc:492] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:59.366044 26862 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.366492 26862 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.373502 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:08:59.375572 26549 leader_election.cc:343] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.384110 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:59.385198 26655 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:08:59.389974 26474 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.395476 26922 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:59.396018 26922 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.396462 26922 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.399505 26580 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.397924 26407 catalog_manager.cc:5697] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.414842 26700 tablet_bootstrap.cc:654] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.427357 26922 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.430439 26862 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.430935 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:59.431326 26883 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.432178 26883 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.432724 26862 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.435035 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:59.435673 26504 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.435837 26883 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:08:59.439169 26476 leader_election.cc:343] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.440425 26699 tablet_bootstrap.cc:492] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:59.441078 26699 ts_tablet_manager.cc:1403] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.138s	user 0.018s	sys 0.072s
I20260709 13:08:59.441212 26700 tablet_bootstrap.cc:492] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:59.441679 26700 ts_tablet_manager.cc:1403] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.002s
I20260709 13:08:59.443282 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:59.444341 26699 raft_consensus.cc:359] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.445077 26699 raft_consensus.cc:385] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.445393 26699 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.445520 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:59.446376 26507 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:08:59.446367 26699 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.446877 26700 raft_consensus.cc:359] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.448850 26700 raft_consensus.cc:385] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.449260 26700 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.433984 26744 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.450318 26700 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.454094 26699 ts_tablet_manager.cc:1434] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:08:59.455152 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:59.456924 26699 tablet_bootstrap.cc:492] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:59.457372 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:08:59.456802 26549 leader_election.cc:343] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.461290 26875 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.461885 26730 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.462661 26730 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.463996 26699 tablet_bootstrap.cc:654] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.465152 26730 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:59.466571 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:08:59.469110 26625 leader_election.cc:343] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.474998 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:59.475764 26506 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:59.478313 26700 ts_tablet_manager.cc:1434] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 13:08:59.479028 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.480031 26841 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:59.480511 26841 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.480979 26841 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.484921 26699 tablet_bootstrap.cc:492] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:59.485491 26699 ts_tablet_manager.cc:1403] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.003s
I20260709 13:08:59.479610 26700 tablet_bootstrap.cc:492] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:59.499979 26699 raft_consensus.cc:359] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.501009 26699 raft_consensus.cc:385] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.501353 26699 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.497277 26841 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.502106 26582 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.503597 26841 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:59.504086 26504 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:59.504343 26699 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.505615 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:08:59.508744 26862 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:59.508154 26883 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:59.510497 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:59.510592 26862 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:08:59.511328 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:59.511919 26506 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.511602 26862 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:59.513833 26625 leader_election.cc:343] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.518158 26875 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:59.508147 26841 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.519960 26841 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.520818 26922 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.522511 26841 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:59.523105 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:59.529495 26699 ts_tablet_manager.cc:1434] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:08:59.528846 26658 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.527719 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:08:59.536975 26625 leader_election.cc:343] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.539130 26702 tablet_bootstrap.cc:492] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:59.539798 26702 ts_tablet_manager.cc:1403] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.207s	user 0.081s	sys 0.057s
I20260709 13:08:59.543360 26699 tablet_bootstrap.cc:492] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:08:59.526221 26875 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:08:59.540884 26506 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:59.553715 26755 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.554585 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.554426 26755 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.556349 26881 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:59.556898 26881 raft_consensus.cc:697] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:08:59.558136 26755 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.559667 26700 tablet_bootstrap.cc:654] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:59.552350 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 46855.8us
I20260709 13:08:59.565773 26881 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.565261 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:59.572893 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:59.573666 26510 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:08:59.575220 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.578588 26730 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:59.579057 26730 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.579363 26730 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.584132 26702 raft_consensus.cc:359] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.585106 26702 raft_consensus.cc:385] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.585378 26702 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.586306 26702 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.592067 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:59.589362 26658 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:08:59.603996 26702 ts_tablet_manager.cc:1434] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.002s
I20260709 13:08:59.607501 26702 tablet_bootstrap.cc:492] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:59.608242 26699 tablet_bootstrap.cc:654] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.617753 26841 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.618388 26841 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.619633 26730 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.621620 26841 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:59.622615 26474 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.622704 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:59.623373 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:59.623786 26744 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:59.624183 26506 raft_consensus.cc:2393] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:08:59.624275 26744 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:08:59.625778 26622 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.625818 26744 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.627229 26841 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.626420 26945 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.635744 26945 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.641291 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:08:59.643232 26549 leader_election.cc:343] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.643396 26407 catalog_manager.cc:5697] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.645704 26945 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.656961 26730 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:08:59.662344 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:59.646076 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:08:59.666405 26922 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.666800 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:59.666975 26922 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.667754 26507 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.668200 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:08:59.668470 26945 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.668919 26506 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:08:59.669124 26945 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:59.670840 26922 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.674078 26922 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.674139 26548 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:08:59.674624 26922 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.649716 26841 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:59.679047 26625 leader_election.cc:343] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.675293 26755 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:59.680778 26755 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.681747 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:59.682741 26922 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.684782 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:59.687212 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:59.687724 26700 tablet_bootstrap.cc:492] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:08:59.688206 26700 ts_tablet_manager.cc:1403] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.209s	user 0.017s	sys 0.006s
I20260709 13:08:59.681327 26755 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:59.690928 26474 leader_election.cc:343] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.691723 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:59.694599 26700 raft_consensus.cc:359] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.700243 26507 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:08:59.704084 26702 tablet_bootstrap.cc:654] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.708321 26700 raft_consensus.cc:385] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.709199 26700 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.715862 26700 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:08:59.718966 26474 leader_election.cc:343] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:59.708083 26476 leader_election.cc:343] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.721283 26407 catalog_manager.cc:5697] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.727519 26699 tablet_bootstrap.cc:492] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:08:59.727994 26699 ts_tablet_manager.cc:1403] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.198s	user 0.018s	sys 0.022s
I20260709 13:08:59.737142 26476 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.742175 26922 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:59.712100 26945 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:08:59.748515 26700 ts_tablet_manager.cc:1434] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.001s
W20260709 13:08:59.742784 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 44230us
W20260709 13:08:59.756866 26476 leader_election.cc:343] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.757866 26476 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.759249 26922 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:59.762020 26700 tablet_bootstrap.cc:492] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:08:59.763027 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.767639 26699 raft_consensus.cc:359] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.768687 26699 raft_consensus.cc:385] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.768864 26730 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:59.769033 26699 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.779275 26405 catalog_manager.cc:5697] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.786242 26699 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.790463 26699 ts_tablet_manager.cc:1434] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.002s
I20260709 13:08:59.801182 26922 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:59.753105 26755 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.825717 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:08:59.826364 26506 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.826720 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:08:59.829125 26699 tablet_bootstrap.cc:492] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
W20260709 13:08:59.829393 26549 leader_election.cc:343] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.830050 26755 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.833417 26506 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:08:59.834888 26548 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:08:59.836184 26755 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:59.836760 26755 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:08:59.843930 26755 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.853325 26922 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.861394 26922 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.859808 26744 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.873242 26744 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.876520 26744 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.878585 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:59.879215 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:59.881626 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:59.865046 26730 raft_consensus.cc:697] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:08:59.864370 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 94703.8us
W20260709 13:08:59.883708 26474 leader_election.cc:343] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.884713 26699 tablet_bootstrap.cc:654] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.888047 26700 tablet_bootstrap.cc:654] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:59.889240 26730 consensus_queue.cc:237] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.889139 26922 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.899967 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:08:59.900854 26659 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
W20260709 13:08:59.887329 26476 leader_election.cc:343] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:59.908381 26476 leader_election.cc:343] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:59.913353 26476 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.919600 26474 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:08:59.922154 26784 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:59.929283 26744 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:59.929553 26784 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.929754 26744 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.930089 26744 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:59.930030 26784 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.932086 26784 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.952278 26702 tablet_bootstrap.cc:492] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:08:59.952934 26702 ts_tablet_manager.cc:1403] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.346s	user 0.012s	sys 0.010s
I20260709 13:08:59.955974 26702 raft_consensus.cc:359] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.956882 26702 raft_consensus.cc:385] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:59.957193 26702 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:08:59.962051 26702 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.962522 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:08:59.967785 26702 ts_tablet_manager.cc:1434] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:08:59.969048 26702 tablet_bootstrap.cc:492] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:08:59.954402 26744 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:08:59.975978 26744 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:08:59.978528 26407 catalog_manager.cc:5697] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:59.988207 26476 consensus_peers.cc:597] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.987526 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:08:59.995373 26405 catalog_manager.cc:5697] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:59.989275 26476 leader_election.cc:343] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:00.007283 26476 leader_election.cc:343] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.025825 26699 tablet_bootstrap.cc:492] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:00.026450 26699 ts_tablet_manager.cc:1403] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.198s	user 0.019s	sys 0.028s
W20260709 13:09:00.012065 26959 log.cc:927] Time spent T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:09:00.035578 26699 raft_consensus.cc:359] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.036358 26699 raft_consensus.cc:385] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.036706 26699 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.037474 26699 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.039641 26699 ts_tablet_manager.cc:1434] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
W20260709 13:09:00.041304 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 121781us
I20260709 13:09:00.043511 26700 tablet_bootstrap.cc:492] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:00.050982 26702 tablet_bootstrap.cc:654] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.051007 26700 ts_tablet_manager.cc:1403] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.296s	user 0.018s	sys 0.046s
I20260709 13:09:00.063436 26699 tablet_bootstrap.cc:492] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:00.064172 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.064301 26700 raft_consensus.cc:359] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.064878 26700 raft_consensus.cc:385] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.065136 26700 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.065750 26700 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.066375 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:00.066934 26655 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.067955 26700 ts_tablet_manager.cc:1434] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
W20260709 13:09:00.071278 26474 leader_election.cc:343] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.073854 26474 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.074086 26730 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.074775 26730 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.074478 26700 tablet_bootstrap.cc:492] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:00.075542 26744 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:00.074514 26945 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:00.082276 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:00.077193 26730 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.095459 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.096413 26506 raft_consensus.cc:2393] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:00.106582 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.107713 26730 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.121790 26966 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:00.123729 26699 tablet_bootstrap.cc:654] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.124629 26655 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:00.130349 26862 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:00.130605 26474 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.129407 26730 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:00.132392 26476 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.132963 26966 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:00.134068 26700 tablet_bootstrap.cc:654] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:00.139549 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:00.140822 26966 raft_consensus.cc:697] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:00.141773 26966 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.143024 26702 tablet_bootstrap.cc:492] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:00.143491 26702 ts_tablet_manager.cc:1403] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.009s
I20260709 13:09:00.164867 26958 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:00.170389 26702 raft_consensus.cc:359] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.172245 26702 raft_consensus.cc:385] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.172669 26702 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.173537 26699 tablet_bootstrap.cc:492] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:00.174057 26699 ts_tablet_manager.cc:1403] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.009s
I20260709 13:09:00.173465 26702 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.175050 26583 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.176762 26699 raft_consensus.cc:359] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.178465 26699 raft_consensus.cc:385] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.178753 26699 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.179323 26702 ts_tablet_manager.cc:1434] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:09:00.180451 26702 tablet_bootstrap.cc:492] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:00.180552 26699 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.188961 26702 tablet_bootstrap.cc:654] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.189845 26958 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:00.191737 26699 ts_tablet_manager.cc:1434] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:09:00.192924 26699 tablet_bootstrap.cc:492] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:00.199030 26699 tablet_bootstrap.cc:654] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.201115 26702 tablet_bootstrap.cc:492] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:00.201764 26702 ts_tablet_manager.cc:1403] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 13:09:00.204346 26700 tablet_bootstrap.cc:492] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:00.204816 26700 ts_tablet_manager.cc:1403] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.013s
I20260709 13:09:00.205231 26702 raft_consensus.cc:359] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.207433 26700 raft_consensus.cc:359] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.209064 26702 raft_consensus.cc:385] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.209067 26700 raft_consensus.cc:385] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.212813 26700 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.213552 26700 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.215801 26700 ts_tablet_manager.cc:1434] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:00.216886 26700 tablet_bootstrap.cc:492] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:00.223570 26700 tablet_bootstrap.cc:654] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.223915 26702 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.223163 26408 catalog_manager.cc:5697] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.225400 26702 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.227602 26704 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.227851 26702 ts_tablet_manager.cc:1434] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:09:00.228271 26704 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.229281 26702 tablet_bootstrap.cc:492] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:00.234333 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.235304 26510 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:09:00.230866 26704 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:00.238564 26548 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:00.242427 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.243556 26704 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:00.243950 26704 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:00.244099 26549 leader_election.cc:343] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.244421 26704 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.255179 26967 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:00.297755 26744 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.298445 26744 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.324404 26702 tablet_bootstrap.cc:654] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.408223 26704 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.412142 26700 tablet_bootstrap.cc:492] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:00.416666 26700 ts_tablet_manager.cc:1403] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.200s	user 0.028s	sys 0.023s
I20260709 13:09:00.416800 26744 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:00.412210 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 80404.4us
I20260709 13:09:00.412160 26966 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.418655 26966 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.419431 26700 raft_consensus.cc:359] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.420063 26700 raft_consensus.cc:385] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.420346 26700 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.421105 26966 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:00.421068 26700 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.422994 26881 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.423811 26700 ts_tablet_manager.cc:1434] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:00.424086 26862 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:00.424836 26700 tablet_bootstrap.cc:492] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
W20260709 13:09:00.417423 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 56485.2us
I20260709 13:09:00.426280 26704 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:00.429621 26883 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.434135 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:00.433864 26883 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.416008 26699 tablet_bootstrap.cc:492] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:00.436522 26883 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.436794 26699 ts_tablet_manager.cc:1403] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.244s	user 0.030s	sys 0.033s
I20260709 13:09:00.423477 26881 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.438300 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:00.448217 26704 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.448906 26704 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.454186 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:00.456060 26704 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:00.458411 26476 leader_election.cc:343] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.461199 26744 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.463732 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.464148 26744 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.464712 26881 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.457273 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.468269 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.468703 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.469413 26509 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:00.468000 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:00.470054 26699 raft_consensus.cc:359] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.470813 26508 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.470786 26699 raft_consensus.cc:385] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.472486 26699 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
W20260709 13:09:00.474149 26548 leader_election.cc:343] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.476760 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.487568 26510 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:00.489600 26744 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:00.479606 26699 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:00.494822 26549 leader_election.cc:343] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.502499 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:00.480525 26702 tablet_bootstrap.cc:492] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:00.461827 26730 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:09:00.504256 26702 ts_tablet_manager.cc:1403] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.275s	user 0.015s	sys 0.031s
I20260709 13:09:00.484552 26700 tablet_bootstrap.cc:654] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:00.485553 26474 leader_election.cc:343] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.494995 26699 ts_tablet_manager.cc:1434] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.003s
I20260709 13:09:00.509852 26699 tablet_bootstrap.cc:492] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:00.480487 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:09:00.514825 26625 leader_election.cc:343] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.515072 26881 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:00.515151 26622 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:00.515679 26881 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.516093 26881 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.517584 26958 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:00.518018 26958 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.518368 26958 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.495586 26508 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:00.495647 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:00.497073 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.502199 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:00.523164 26476 leader_election.cc:343] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:00.524281 26474 leader_election.cc:343] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.527159 26702 raft_consensus.cc:359] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.527880 26702 raft_consensus.cc:385] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.528195 26702 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.527971 26474 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.528993 26702 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.530328 26548 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:00.530941 26966 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:00.531243 26702 ts_tablet_manager.cc:1434] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:09:00.531605 26945 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:00.532073 26945 raft_consensus.cc:697] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:00.532295 26702 tablet_bootstrap.cc:492] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:00.532585 26881 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.532922 26945 consensus_queue.cc:237] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.533592 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.530570 26699 tablet_bootstrap.cc:654] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.528966 26958 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:00.538664 26549 leader_election.cc:343] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.539399 26549 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:09:00.542011 26625 leader_election.cc:343] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.543073 26967 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:00.541023 26474 leader_election.cc:343] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.544145 26958 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.526697 26476 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.554378 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:09:00.555757 26625 leader_election.cc:343] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:00.556552 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 61042.8us
I20260709 13:09:00.557708 26966 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:00.565816 26476 leader_election.cc:343] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.566641 26476 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.568240 26966 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:00.568351 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:00.569072 26509 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.570206 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:00.570775 26506 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:00.577687 26625 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:00.577625 26476 consensus_peers.cc:597] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:00.579587 26506 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:00.580937 26622 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.581310 26881 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.581632 26509 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:00.583097 26881 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:00.583617 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:00.583933 26881 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:09:00.585516 26625 leader_election.cc:343] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.586674 26881 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.588656 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.590929 26702 tablet_bootstrap.cc:654] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.592000 26957 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:00.587940 26730 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.592727 26957 raft_consensus.cc:697] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:00.594991 26730 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.595582 26957 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.602347 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.603778 26506 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:00.603825 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:00.605865 26625 leader_election.cc:343] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.606572 26622 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.597342 26730 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.607270 26958 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:00.608997 26958 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.613327 26958 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.632485 26700 tablet_bootstrap.cc:492] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:00.633170 26700 ts_tablet_manager.cc:1403] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.209s	user 0.020s	sys 0.014s
I20260709 13:09:00.636790 26699 tablet_bootstrap.cc:492] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:00.637262 26699 ts_tablet_manager.cc:1403] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.003s
I20260709 13:09:00.641340 26407 catalog_manager.cc:5697] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.643611 26699 raft_consensus.cc:359] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.647904 26699 raft_consensus.cc:385] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.646855 26958 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.645365 26700 raft_consensus.cc:359] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.648945 26700 raft_consensus.cc:385] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.649277 26700 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.648164 26699 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.650233 26700 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.650852 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:00.650694 26699 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.651409 26507 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.652760 26699 ts_tablet_manager.cc:1434] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:00.653391 26700 ts_tablet_manager.cc:1434] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:00.656167 26699 tablet_bootstrap.cc:492] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:00.665165 26700 tablet_bootstrap.cc:492] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:00.669420 26958 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.671680 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:09:00.673668 26625 leader_election.cc:343] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.677603 26507 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:00.679351 26622 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.677517 26922 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:00.680776 26702 tablet_bootstrap.cc:492] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:00.681353 26730 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:00.681876 26730 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:00.682109 26702 ts_tablet_manager.cc:1403] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.013s
I20260709 13:09:00.682647 26730 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.684376 26405 catalog_manager.cc:5697] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.686084 26405 catalog_manager.cc:5697] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.687851 26700 tablet_bootstrap.cc:654] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.694571 26702 raft_consensus.cc:359] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.695488 26702 raft_consensus.cc:385] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.695770 26702 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.698349 26699 tablet_bootstrap.cc:654] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.698336 26702 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.703442 26702 ts_tablet_manager.cc:1434] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:09:00.710496 26702 tablet_bootstrap.cc:492] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:00.730113 26699 tablet_bootstrap.cc:492] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:00.730626 26699 ts_tablet_manager.cc:1403] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.000s
I20260709 13:09:00.721284 26405 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.734619 26700 tablet_bootstrap.cc:492] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:00.735100 26700 ts_tablet_manager.cc:1403] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.014s
I20260709 13:09:00.735919 26699 raft_consensus.cc:359] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.736596 26699 raft_consensus.cc:385] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.736863 26699 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.737483 26699 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.738034 26702 tablet_bootstrap.cc:654] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.749893 26945 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.754379 26945 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.756543 26945 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:00.761381 26700 raft_consensus.cc:359] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.762153 26700 raft_consensus.cc:385] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.762423 26700 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.763032 26700 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.765100 26700 ts_tablet_manager.cc:1434] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:09:00.738943 26699 ts_tablet_manager.cc:1434] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:00.761719 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.767277 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.770233 26699 tablet_bootstrap.cc:492] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:00.771129 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:00.774192 26700 tablet_bootstrap.cc:492] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:00.775127 26945 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:00.776651 26702 tablet_bootstrap.cc:492] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:00.777110 26702 ts_tablet_manager.cc:1403] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.005s
I20260709 13:09:00.779639 26744 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.780187 26744 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.785363 26700 tablet_bootstrap.cc:654] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.779681 26702 raft_consensus.cc:359] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.788563 26702 raft_consensus.cc:385] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.788805 26702 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.789453 26702 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.790159 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:00.790402 26744 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:00.791623 26476 leader_election.cc:343] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.792580 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.793143 26699 tablet_bootstrap.cc:654] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:00.794215 26474 leader_election.cc:343] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.794634 26474 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.797108 26702 ts_tablet_manager.cc:1434] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:00.795740 26744 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:00.802305 26702 tablet_bootstrap.cc:492] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:00.799505 26700 tablet_bootstrap.cc:492] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:00.806277 26700 ts_tablet_manager.cc:1403] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:09:00.807359 26702 tablet_bootstrap.cc:654] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.809718 26700 raft_consensus.cc:359] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.810608 26700 raft_consensus.cc:385] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.810982 26700 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.812009 26700 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.814111 26700 ts_tablet_manager.cc:1434] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:00.819849 26702 tablet_bootstrap.cc:492] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:00.820338 26702 ts_tablet_manager.cc:1403] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:09:00.820869 26699 tablet_bootstrap.cc:492] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:00.821321 26699 ts_tablet_manager.cc:1403] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 13:09:00.822867 26702 raft_consensus.cc:359] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.823585 26702 raft_consensus.cc:385] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.823879 26702 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.823879 26700 tablet_bootstrap.cc:492] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:00.824594 26702 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.827374 26699 raft_consensus.cc:359] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.831406 26699 raft_consensus.cc:385] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.831790 26699 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.832484 26699 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.839658 26702 ts_tablet_manager.cc:1434] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:09:00.842370 26699 ts_tablet_manager.cc:1434] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:09:00.840528 26700 tablet_bootstrap.cc:654] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.842620 26702 tablet_bootstrap.cc:492] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:00.847959 26744 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.848556 26744 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.850944 26744 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:00.852954 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.854317 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:00.854504 26474 leader_election.cc:343] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.855953 26699 tablet_bootstrap.cc:492] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
W20260709 13:09:00.855887 26476 leader_election.cc:343] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.856518 26476 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.857704 26744 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:00.863210 26958 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.864014 26958 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.866231 26958 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.868381 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.869158 26509 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:00.869792 26702 tablet_bootstrap.cc:654] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.871378 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:00.872174 26958 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:00.872841 26957 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.873463 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:00.873371 26957 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.874151 26580 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:00.875699 26957 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.872550 26958 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.877357 26958 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.880951 26699 tablet_bootstrap.cc:654] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.885702 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.886432 26509 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:00.889221 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:00.890044 26957 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:00.890436 26957 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.890802 26957 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.890450 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:00.892982 26625 leader_election.cc:343] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.897253 26700 tablet_bootstrap.cc:492] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:00.898304 26700 ts_tablet_manager.cc:1403] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.035s
I20260709 13:09:00.901526 26700 raft_consensus.cc:359] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.902360 26700 raft_consensus.cc:385] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.902678 26700 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.903427 26700 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.906271 26700 ts_tablet_manager.cc:1434] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:09:00.907274 26700 tablet_bootstrap.cc:492] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:00.909528 26957 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.912775 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:00.913425 26509 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.916040 26700 tablet_bootstrap.cc:654] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.917299 26958 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.920771 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:00.921459 26507 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.926136 26744 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.926379 26702 tablet_bootstrap.cc:492] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:00.919647 26958 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.927022 26702 ts_tablet_manager.cc:1403] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.006s
I20260709 13:09:00.927604 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:00.928150 26580 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.929816 26744 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.932217 26744 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:00.929865 26702 raft_consensus.cc:359] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.926452 26699 tablet_bootstrap.cc:492] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:00.933867 26699 ts_tablet_manager.cc:1403] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.004s
I20260709 13:09:00.934692 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.933007 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:00.937213 26474 leader_election.cc:343] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.937040 26699 raft_consensus.cc:359] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.937902 26699 raft_consensus.cc:385] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:00.938032 26476 leader_election.cc:343] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.938233 26699 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.938513 26476 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:00.939294 26744 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:00.939131 26699 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.941692 26699 ts_tablet_manager.cc:1434] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:00.942116 26702 raft_consensus.cc:385] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.942440 26702 raft_consensus.cc:740] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.942579 26945 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.943693 26702 consensus_queue.cc:260] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.943709 26945 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.946224 26945 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:00.947707 26700 tablet_bootstrap.cc:492] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:00.947971 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.948203 26700 ts_tablet_manager.cc:1403] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.001s
I20260709 13:09:00.951344 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.951381 26700 raft_consensus.cc:359] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.952521 26700 raft_consensus.cc:385] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:00.952857 26700 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:00.953004 26549 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:00.953630 26699 tablet_bootstrap.cc:492] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:00.954149 26967 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.954650 26967 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.956925 26967 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:00.959291 26507 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:00.960355 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.960744 26699 tablet_bootstrap.cc:654] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.961258 26506 raft_consensus.cc:2393] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:09:00.962222 26702 ts_tablet_manager.cc:1434] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:09:00.962272 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:00.963591 26702 tablet_bootstrap.cc:492] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:00.963862 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:00.963999 26549 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:00.964682 26704 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.964807 26730 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:00.965312 26730 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:00.966117 26730 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.974462 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:00.957414 26967 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:00.976960 26625 leader_election.cc:343] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:00.979779 26702 tablet_bootstrap.cc:654] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:00.981040 26957 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:00.984225 26583 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:00.986173 26704 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:00.990126 26700 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:00.992560 26700 ts_tablet_manager.cc:1434] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:09:00.995901 26700 tablet_bootstrap.cc:492] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:00.943202 26509 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:01.010890 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:01.013209 26881 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:01.014518 26881 raft_consensus.cc:697] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:01.015303 26881 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.018330 26700 tablet_bootstrap.cc:654] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:01.022681 26841 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.023222 26841 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.010545 26407 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:01.032440 26841 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:01.033700 26699 tablet_bootstrap.cc:492] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:01.034274 26699 ts_tablet_manager.cc:1403] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.023s
I20260709 13:09:01.038255 26699 raft_consensus.cc:359] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.039105 26699 raft_consensus.cc:385] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.039441 26699 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.040362 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:01.041221 26507 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:01.040208 26699 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.044565 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:01.045181 26702 tablet_bootstrap.cc:492] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:01.045207 26582 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:01.045837 26702 ts_tablet_manager.cc:1403] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.013s
I20260709 13:09:01.049058 26702 raft_consensus.cc:359] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.049829 26702 raft_consensus.cc:385] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.049455 26625 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:01.050141 26702 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.050731 26730 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:01.051194 26730 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.050833 26702 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.051596 26730 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.052682 26699 ts_tablet_manager.cc:1434] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.005s
I20260709 13:09:01.053948 26699 tablet_bootstrap.cc:492] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:01.054030 26700 tablet_bootstrap.cc:492] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:01.054458 26700 ts_tablet_manager.cc:1403] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.001s
I20260709 13:09:01.055158 26744 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.055745 26744 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.057281 26700 raft_consensus.cc:359] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.057862 26744 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.057999 26700 raft_consensus.cc:385] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.058355 26700 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.059350 26700 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.059547 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:01.060550 26699 tablet_bootstrap.cc:654] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:01.061196 26476 leader_election.cc:343] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.062368 26700 ts_tablet_manager.cc:1434] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:01.063232 26702 ts_tablet_manager.cc:1434] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:01.064239 26702 tablet_bootstrap.cc:492] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:01.067860 26883 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:01.068490 26549 consensus_peers.cc:597] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.063656 26700 tablet_bootstrap.cc:492] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:01.070214 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:01.073431 26702 tablet_bootstrap.cc:654] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:01.075274 26730 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.076392 26700 tablet_bootstrap.cc:654] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:01.077780 26730 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:01.078553 26945 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.087065 26744 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.099021 26744 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.101109 26744 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.098436 26945 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.103482 26945 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.104451 26407 catalog_manager.cc:5697] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:01.086905 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:09:01.087690 26474 leader_election.cc:343] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.106876 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:01.107146 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:01.107470 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:01.107673 26582 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:09:01.107164 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:00.998054 26580 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:01.090793 26702 tablet_bootstrap.cc:492] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:01.092216 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:01.109369 26784 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:01.109687 26702 ts_tablet_manager.cc:1403] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.002s
I20260709 13:09:01.087987 26699 tablet_bootstrap.cc:492] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:01.109685 26585 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.092645 26883 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:01.112138 26699 ts_tablet_manager.cc:1403] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.006s
I20260709 13:09:01.114959 26699 raft_consensus.cc:359] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.115646 26699 raft_consensus.cc:385] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.115901 26699 raft_consensus.cc:740] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.116534 26699 consensus_queue.cc:260] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.118731 26699 ts_tablet_manager.cc:1434] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:01.118769 26585 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:01.119737 26699 tablet_bootstrap.cc:492] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:01.127764 26700 tablet_bootstrap.cc:492] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:01.128281 26700 ts_tablet_manager.cc:1403] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.017s
I20260709 13:09:01.129607 26476 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:01.130697 26966 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:01.131217 26966 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.131661 26966 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.131594 26700 raft_consensus.cc:359] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.132526 26700 raft_consensus.cc:385] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.132879 26700 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.136312 26699 tablet_bootstrap.cc:654] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:01.133649 26700 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.151141 26700 ts_tablet_manager.cc:1434] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:01.152287 26700 tablet_bootstrap.cc:492] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:01.162220 26549 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:01.163533 26699 tablet_bootstrap.cc:492] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:01.164000 26699 ts_tablet_manager.cc:1403] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.003s
I20260709 13:09:01.164223 26945 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:01.170007 26585 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.173846 26700 tablet_bootstrap.cc:654] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:01.173628 26702 raft_consensus.cc:359] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.174392 26702 raft_consensus.cc:385] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.174768 26702 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.175585 26702 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.167554 26506 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.178704 26702 ts_tablet_manager.cc:1434] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:09:01.185031 26702 tablet_bootstrap.cc:492] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:01.191991 26699 raft_consensus.cc:359] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.192984 26699 raft_consensus.cc:385] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.193629 26699 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.200313 26699 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.213442 26699 ts_tablet_manager.cc:1434] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.003s
I20260709 13:09:01.220252 26699 tablet_bootstrap.cc:492] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
W20260709 13:09:01.240959 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:01.242308 26957 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.244381 26957 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.245121 26700 tablet_bootstrap.cc:492] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:01.245707 26700 ts_tablet_manager.cc:1403] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.008s
I20260709 13:09:01.235534 26755 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:09:01.261639 26700 raft_consensus.cc:359] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.262454 26700 raft_consensus.cc:385] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.262861 26700 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.286652 26700 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.288313 26699 tablet_bootstrap.cc:654] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:01.288406 26700 ts_tablet_manager.cc:1434] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.002s
I20260709 13:09:01.296458 26625 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:09:01.374809 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 78465.4us
I20260709 13:09:01.378448 26730 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.378968 26730 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.369261 26967 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.356995 26957 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:01.351312 26584 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.391177 26730 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:01.396246 26506 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:01.397454 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:01.398617 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:01.399247 26506 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:01.380290 26883 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:01.404744 26702 tablet_bootstrap.cc:654] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:01.405074 26622 leader_election.cc:343] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.406281 26700 tablet_bootstrap.cc:492] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:01.339674 26966 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.408428 26841 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:09:01.427817 26966 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.437104 27022 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.408195 26883 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:01.392474 26967 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.453043 26967 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.422986 26784 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.458323 26883 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.459652 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:01.460609 26510 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:09:01.461750 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:01.462618 26580 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.463188 26784 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.437695 27022 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.477340 26548 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:01.492478 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:01.494519 26476 leader_election.cc:343] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.495093 27021 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:01.495775 26702 tablet_bootstrap.cc:492] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:01.495705 27021 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.496353 26702 ts_tablet_manager.cc:1403] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.317s	user 0.019s	sys 0.043s
I20260709 13:09:01.496340 27021 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.500865 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:01.508219 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:01.513487 26699 tablet_bootstrap.cc:492] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:01.512251 26784 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.516737 26700 tablet_bootstrap.cc:654] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:01.518507 26702 raft_consensus.cc:359] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.518018 26699 ts_tablet_manager.cc:1403] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.301s	user 0.022s	sys 0.042s
I20260709 13:09:01.519052 26702 raft_consensus.cc:385] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.519345 26702 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.520089 26702 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.522203 26702 ts_tablet_manager.cc:1434] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:01.524555 26580 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:01.525677 26476 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:01.528517 26784 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:01.528986 26784 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:01.530262 26702 tablet_bootstrap.cc:492] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:01.529840 26784 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.530730 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:01.531345 26655 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:09:01.537492 27020 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.539077 27020 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.548895 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:01.549479 26730 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.549947 26730 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.552332 26881 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:01.552763 26881 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.553160 26881 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.555269 26841 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:01.562610 26730 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:01.564127 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:01.564893 26658 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:09:01.566051 26702 tablet_bootstrap.cc:654] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:01.566269 27014 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:09:01.570559 26625 consensus_peers.cc:597] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.571105 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 162144us
W20260709 13:09:01.572038 26625 consensus_peers.cc:597] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.577171 26625 leader_election.cc:343] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.577651 26625 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:01.578667 27022 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.579198 26841 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:01.581425 27013 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:01.585304 26699 raft_consensus.cc:359] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.585978 26699 raft_consensus.cc:385] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.586160 26699 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.588335 26700 tablet_bootstrap.cc:492] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:01.589082 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:01.588876 26700 ts_tablet_manager.cc:1403] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.201s	user 0.004s	sys 0.013s
W20260709 13:09:01.593672 26476 leader_election.cc:343] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.594714 26699 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.598049 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:01.606302 26699 ts_tablet_manager.cc:1434] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.000s
I20260709 13:09:01.608253 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:01.609632 26476 leader_election.cc:343] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.610620 26958 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:09:01.617725 27025 log.cc:927] Time spent T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.104s	user 0.004s	sys 0.000s
I20260709 13:09:01.619251 26699 tablet_bootstrap.cc:492] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:01.623948 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:01.613966 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:01.625732 26659 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.634223 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:01.622349 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:01.635090 27020 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:01.643424 26625 leader_election.cc:343] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:01.646450 26474 leader_election.cc:343] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.646862 26474 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:01.661332 26966 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:01.670229 26536 tablet.cc:2406] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:01.681444 26700 raft_consensus.cc:359] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.682113 26700 raft_consensus.cc:385] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.682371 26700 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.672984 26744 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.688381 26744 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.688830 26755 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.689344 26755 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.690663 26744 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.692596 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:01.693316 26510 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:09:01.693747 27021 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.673741 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:01.667510 26503 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
W20260709 13:09:01.725921 26474 leader_election.cc:343] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.734421 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:01.755422 26700 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.758687 26700 ts_tablet_manager.cc:1434] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.169s	user 0.005s	sys 0.005s
I20260709 13:09:01.766315 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:01.750416 27020 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:01.768062 26704 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:01.768472 26704 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.768785 26704 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.770674 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:01.772082 26700 tablet_bootstrap.cc:492] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:01.759195 26755 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.767791 26582 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:01.772831 26957 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:01.795452 26957 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.796023 26957 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.812443 26881 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.813627 26699 tablet_bootstrap.cc:654] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:01.814777 26702 tablet_bootstrap.cc:492] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:01.816030 26702 ts_tablet_manager.cc:1403] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.286s	user 0.035s	sys 0.001s
W20260709 13:09:01.825662 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 53403.1us
I20260709 13:09:01.822319 26881 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:01.843037 26704 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.848065 26704 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.850731 27043 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.851253 27043 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.853700 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:01.838949 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:01.856703 26503 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.861583 26699 tablet_bootstrap.cc:492] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:01.862860 26699 ts_tablet_manager.cc:1403] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.250s	user 0.008s	sys 0.013s
I20260709 13:09:01.849629 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:01.859160 27021 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.857285 27043 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:01.869968 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:01.872378 26957 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:01.874231 26474 leader_election.cc:343] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.874675 26957 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:01.874676 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:01.883888 27038 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:01.888760 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:01.895531 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:01.896209 26507 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.896948 26702 raft_consensus.cc:359] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.898275 26702 raft_consensus.cc:385] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.898576 26702 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.899758 26702 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.905453 26702 ts_tablet_manager.cc:1434] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.089s	user 0.003s	sys 0.003s
I20260709 13:09:01.910599 26503 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:01.911404 26699 raft_consensus.cc:359] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.912341 26699 raft_consensus.cc:385] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:01.912683 26699 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:01.913508 26699 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.915660 26659 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
W20260709 13:09:01.932299 26476 leader_election.cc:343] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:01.934894 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:01.936726 27014 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:01.937209 27014 raft_consensus.cc:697] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:01.944567 26700 tablet_bootstrap.cc:654] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:01.954298 26699 ts_tablet_manager.cc:1434] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 13:09:01.942618 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:09:01.956643 26625 consensus_peers.cc:597] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.958305 26658 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:09:01.959627 26474 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:01.958209 26508 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.961956 27027 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:01.962380 27027 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.965224 27027 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.971256 26582 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:01.938017 27014 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:01.987419 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:01.990645 26508 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:02.016183 27022 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.033420 26699 tablet_bootstrap.cc:492] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:02.042564 27022 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.023129 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:02.053642 26507 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:02.047559 27022 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:02.052820 26625 leader_election.cc:343] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.055873 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:02.056775 27043 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:02.058383 27043 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:02.022282 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:02.064002 26579 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:02.064926 26702 tablet_bootstrap.cc:492] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:02.075117 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.079071 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.084697 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:02.081986 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:02.089768 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:02.089592 26405 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.092314 26883 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:02.092737 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.092871 26883 raft_consensus.cc:697] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:02.039646 27027 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.094178 26883 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.095674 27043 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.102643 26702 tablet_bootstrap.cc:654] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:02.105980 26549 leader_election.cc:343] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:02.107157 26549 leader_election.cc:343] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.108516 26549 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:09:02.105854 26476 leader_election.cc:343] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.101985 27022 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 13:09:02.122042 26474 leader_election.cc:343] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.123426 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:02.125183 26744 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.125351 27016 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:02.139544 26700 tablet_bootstrap.cc:492] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:02.140097 26700 ts_tablet_manager.cc:1403] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.371s	user 0.029s	sys 0.026s
I20260709 13:09:02.142547 26549 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:02.152613 26862 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.169719 26967 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.170282 26967 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.172870 26967 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.153894 27027 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.187620 26699 tablet_bootstrap.cc:654] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.197682 26700 raft_consensus.cc:359] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.198892 26700 raft_consensus.cc:385] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.199532 26700 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.203613 26700 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.189980 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:02.205739 27022 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:02.208496 26702 tablet_bootstrap.cc:492] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:02.209360 26702 ts_tablet_manager.cc:1403] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.145s	user 0.010s	sys 0.018s
I20260709 13:09:02.208870 26700 ts_tablet_manager.cc:1434] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:09:02.203025 26957 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:02.220697 26702 raft_consensus.cc:359] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.209368 26653 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.225821 26702 raft_consensus.cc:385] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.226624 26702 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.226856 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:02.229969 26702 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.230269 26506 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:09:02.241076 26702 ts_tablet_manager.cc:1434] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:09:02.243287 26700 tablet_bootstrap.cc:492] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:02.243356 26548 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:09:02.257457 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99532us
I20260709 13:09:02.262575 26702 tablet_bootstrap.cc:492] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:02.265204 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:02.256393 27043 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:02.299484 26699 tablet_bootstrap.cc:492] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:02.300189 26699 ts_tablet_manager.cc:1403] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.272s	user 0.016s	sys 0.025s
I20260709 13:09:02.307056 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.286834 27043 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.295491 26653 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:02.311743 27043 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.315331 26755 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.315037 26658 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:09:02.336515 26474 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:09:02.340019 26476 leader_election.cc:343] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.338443 27022 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:02.341151 27022 raft_consensus.cc:697] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:02.342105 27022 consensus_queue.cc:237] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.346380 26700 tablet_bootstrap.cc:654] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.360380 26699 raft_consensus.cc:359] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.361222 26699 raft_consensus.cc:385] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.361505 26699 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.375892 26699 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.381877 26744 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.382097 26883 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:02.382405 26744 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.384289 26744 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.389947 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:02.391476 26474 leader_election.cc:343] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.395236 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:02.410897 26476 leader_election.cc:343] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.411803 26476 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:02.412516 26784 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.414077 27043 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.418550 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:02.419229 26505 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.420331 26699 ts_tablet_manager.cc:1434] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.001s
I20260709 13:09:02.421756 26699 tablet_bootstrap.cc:492] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:02.425143 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:02.425665 26658 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:02.437685 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:02.439795 26700 tablet_bootstrap.cc:492] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:02.443110 26700 ts_tablet_manager.cc:1403] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.214s	user 0.010s	sys 0.009s
I20260709 13:09:02.440742 26505 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:02.441882 26702 tablet_bootstrap.cc:654] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.424969 27043 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.444784 26548 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:02.444880 26658 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:02.446246 26862 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:02.449156 26862 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:02.450035 26862 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.455246 26700 raft_consensus.cc:359] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.456189 26700 raft_consensus.cc:385] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.456475 26700 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.462957 26700 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.467713 26700 ts_tablet_manager.cc:1434] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:09:02.468719 26700 tablet_bootstrap.cc:492] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:02.474336 26699 tablet_bootstrap.cc:654] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.479111 26408 catalog_manager.cc:5697] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.485414 27016 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:02.496078 26699 tablet_bootstrap.cc:492] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:02.496580 26699 ts_tablet_manager.cc:1403] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.002s
I20260709 13:09:02.499405 26699 raft_consensus.cc:359] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.500221 26699 raft_consensus.cc:385] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.500483 26699 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.505184 26700 tablet_bootstrap.cc:654] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.505297 27019 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.505873 27019 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.501050 26699 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.509905 27019 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.510100 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:02.510469 26699 ts_tablet_manager.cc:1434] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
W20260709 13:09:02.511593 26476 leader_election.cc:343] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.514566 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.515761 26699 tablet_bootstrap.cc:492] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
W20260709 13:09:02.517390 26474 leader_election.cc:343] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.517913 26474 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:02.519171 27019 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.524106 26699 tablet_bootstrap.cc:654] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.526494 26702 tablet_bootstrap.cc:492] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:02.527021 26702 ts_tablet_manager.cc:1403] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.265s	user 0.007s	sys 0.011s
I20260709 13:09:02.529451 26585 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.532546 26702 raft_consensus.cc:359] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.533596 26702 raft_consensus.cc:385] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.533877 26702 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.536554 26700 tablet_bootstrap.cc:492] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:02.537079 26700 ts_tablet_manager.cc:1403] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.001s
I20260709 13:09:02.539361 26700 raft_consensus.cc:359] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.539880 26700 raft_consensus.cc:385] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.540146 26700 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.536666 26405 catalog_manager.cc:5697] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.541042 26702 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.542089 26700 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.544394 26702 ts_tablet_manager.cc:1434] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:02.543860 26405 catalog_manager.cc:5697] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:09:02.545462 26702 tablet_bootstrap.cc:492] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:02.548588 26700 ts_tablet_manager.cc:1434] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:02.549681 26700 tablet_bootstrap.cc:492] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:02.559854 26408 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.560523 26702 tablet_bootstrap.cc:654] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.561730 26408 catalog_manager.cc:5697] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:02.564756 26700 tablet_bootstrap.cc:654] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.570536 27014 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.571113 27014 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.567561 26702 tablet_bootstrap.cc:492] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:02.573414 26702 ts_tablet_manager.cc:1403] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:09:02.575968 26702 raft_consensus.cc:359] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.576650 26702 raft_consensus.cc:385] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.576900 26702 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.579089 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:02.579427 26700 tablet_bootstrap.cc:492] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:02.579926 26700 ts_tablet_manager.cc:1403] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:09:02.580592 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:02.577486 26702 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.582190 27014 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:02.579947 26508 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:02.589910 26622 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:02.589936 26700 raft_consensus.cc:359] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.590777 26700 raft_consensus.cc:385] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.591048 26700 raft_consensus.cc:740] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.591364 26702 ts_tablet_manager.cc:1434] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:09:02.591303 26883 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.592718 26702 tablet_bootstrap.cc:492] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:02.591643 26700 consensus_queue.cc:260] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.596143 26700 ts_tablet_manager.cc:1434] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:09:02.597139 26700 tablet_bootstrap.cc:492] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:02.604089 26700 tablet_bootstrap.cc:654] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.615517 26700 tablet_bootstrap.cc:492] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:02.616024 26700 ts_tablet_manager.cc:1403] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 13:09:02.617027 27019 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.617530 27019 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.618759 26700 raft_consensus.cc:359] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.619514 27019 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.620632 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:02.622100 26474 leader_election.cc:343] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.622663 26700 raft_consensus.cc:385] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.623003 26700 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.623759 26700 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.625514 26702 tablet_bootstrap.cc:654] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.626979 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:02.626199 26700 ts_tablet_manager.cc:1434] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 13:09:02.633819 26476 leader_election.cc:343] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.634269 26700 tablet_bootstrap.cc:492] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:02.634297 26476 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:02.635874 27019 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.628425 26407 catalog_manager.cc:5697] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.632395 26883 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.617025 26699 tablet_bootstrap.cc:492] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:02.641278 26699 ts_tablet_manager.cc:1403] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.033s
I20260709 13:09:02.644104 26700 tablet_bootstrap.cc:654] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.644757 27039 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.645244 27039 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.647495 27039 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.650041 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.652629 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:02.655138 26549 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:02.656303 27043 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.657759 26699 raft_consensus.cc:359] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.658444 26699 raft_consensus.cc:385] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.658742 26699 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.659806 26702 tablet_bootstrap.cc:492] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:02.660308 26702 ts_tablet_manager.cc:1403] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.009s
I20260709 13:09:02.655040 27016 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:02.668201 26702 raft_consensus.cc:359] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.669545 26702 raft_consensus.cc:385] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.669862 26702 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.670531 26702 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.660287 26699 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.673039 26700 tablet_bootstrap.cc:492] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:02.674451 26700 ts_tablet_manager.cc:1403] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.003s
I20260709 13:09:02.674515 26699 ts_tablet_manager.cc:1434] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:09:02.676616 26699 tablet_bootstrap.cc:492] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:02.677224 26700 raft_consensus.cc:359] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.678399 26700 raft_consensus.cc:385] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.678666 26700 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.679322 26700 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.681391 26700 ts_tablet_manager.cc:1434] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:09:02.682391 26700 tablet_bootstrap.cc:492] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Bootstrap starting.
I20260709 13:09:02.682693 27043 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:02.683674 26699 tablet_bootstrap.cc:654] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.685726 27019 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.686208 27019 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.683688 26702 ts_tablet_manager.cc:1434] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:09:02.687814 26702 tablet_bootstrap.cc:492] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:02.689646 27019 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.694514 26700 tablet_bootstrap.cc:654] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.697943 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.698621 26658 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:09:02.705942 26474 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:02.707623 26784 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:02.707983 26784 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.708309 26784 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.712648 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:02.718137 27056 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:02.724216 26702 tablet_bootstrap.cc:654] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:02.731375 26476 leader_election.cc:343] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.739791 26784 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.746824 27020 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.757473 27020 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.759625 27020 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.748612 26744 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.760813 26744 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.762555 26744 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.750756 27027 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.763192 27027 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.765054 27027 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.766139 27039 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.766798 26744 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.766642 27039 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.767310 26744 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.769109 27039 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.770468 26585 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.770695 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:02.772136 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.774246 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:02.775338 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:02.777346 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:02.782711 26476 leader_election.cc:343] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:02.783757 26476 leader_election.cc:343] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:02.784559 26476 leader_election.cc:343] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:02.786257 26476 leader_election.cc:343] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.769172 26744 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.790688 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.792378 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.796335 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:02.798012 26548 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:02.799224 27039 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.800169 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.809902 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:02.810606 26658 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
W20260709 13:09:02.811895 26474 leader_election.cc:343] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.812368 26474 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:02.813405 27019 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:02.825621 26625 consensus_peers.cc:597] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:02.830292 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:09:02.831736 26476 leader_election.cc:343] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.928705 26784 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:02.933012 27039 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:02.942162 26474 leader_election.cc:343] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.942651 26474 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:02.943858 26474 leader_election.cc:343] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:02.944666 26784 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.945060 26653 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:02.946323 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 116358us
I20260709 13:09:02.950423 26700 tablet_bootstrap.cc:492] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: No bootstrap required, opened a new log
I20260709 13:09:02.950984 26700 ts_tablet_manager.cc:1403] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent bootstrapping tablet: real 0.269s	user 0.061s	sys 0.067s
I20260709 13:09:02.953387 26585 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.949102 26474 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:02.958122 26474 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:02.959843 26700 raft_consensus.cc:359] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.960812 26700 raft_consensus.cc:385] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.961176 26700 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.961845 27027 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:02.962553 27027 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:02.962006 26700 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.962929 27027 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.963361 27027 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.964874 26700 ts_tablet_manager.cc:1434] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:02.970585 27027 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.972972 27027 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:02.948441 26476 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:02.978484 27039 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:02.979100 26702 tablet_bootstrap.cc:492] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:02.979611 26702 ts_tablet_manager.cc:1403] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.292s	user 0.036s	sys 0.092s
I20260709 13:09:02.982486 26702 raft_consensus.cc:359] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.983202 26702 raft_consensus.cc:385] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.983464 26702 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.984103 26702 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:02.986268 26702 ts_tablet_manager.cc:1434] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:09:02.987047 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:02.987637 26657 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.988591 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:02.989215 26654 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.990687 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:02.994536 27020 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:02.995721 26657 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:02.997411 26654 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:02.997742 26699 tablet_bootstrap.cc:492] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:02.998150 26699 ts_tablet_manager.cc:1403] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.322s	user 0.015s	sys 0.011s
W20260709 13:09:03.002110 26476 leader_election.cc:343] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.004531 26699 raft_consensus.cc:359] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.007702 26699 raft_consensus.cc:385] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.008129 26699 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.008831 26699 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.011209 26699 ts_tablet_manager.cc:1434] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:03.012274 26699 tablet_bootstrap.cc:492] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:03.005784 26702 tablet_bootstrap.cc:492] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:03.005985 26474 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.018381 26474 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.019135 26744 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.019183 27020 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.019780 26744 raft_consensus.cc:697] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:03.019826 27020 raft_consensus.cc:697] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:03.020787 26744 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.021396 27020 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.032383 27056 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.032902 27056 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.036543 27056 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:03.036875 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:03.038204 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:03.039777 26504 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:09:03.041549 26548 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:03.042577 27056 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.043062 27056 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.043489 27056 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:03.050505 26549 leader_election.cc:343] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.056855 27056 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.059841 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:03.060456 26504 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.071744 26504 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:03.074277 26702 tablet_bootstrap.cc:654] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.080093 26548 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:03.085878 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:03.084815 26862 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.087441 26862 raft_consensus.cc:697] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:03.088243 26862 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:03.090273 26549 leader_election.cc:343] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.081316 27056 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:03.096732 26408 catalog_manager.cc:5697] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.098097 26408 catalog_manager.cc:5697] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.157881 26699 tablet_bootstrap.cc:654] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.157881 26406 catalog_manager.cc:5697] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.175696 26702 tablet_bootstrap.cc:492] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:03.176185 26702 ts_tablet_manager.cc:1403] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.171s	user 0.014s	sys 0.006s
I20260709 13:09:03.187175 26702 raft_consensus.cc:359] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.187901 26702 raft_consensus.cc:385] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.188158 26702 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.188293 26699 tablet_bootstrap.cc:492] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:03.188755 26702 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.193181 26702 ts_tablet_manager.cc:1434] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:09:03.188730 26699 ts_tablet_manager.cc:1403] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.177s	user 0.009s	sys 0.009s
I20260709 13:09:03.198120 26699 raft_consensus.cc:359] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.199007 26702 tablet_bootstrap.cc:492] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:03.205102 27014 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.205718 27014 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.207307 26702 tablet_bootstrap.cc:654] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.208297 27014 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:03.212697 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:03.214551 26625 leader_election.cc:343] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.222405 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:03.223377 26508 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:03.228583 26622 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.230778 26730 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.231287 26730 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.231720 26730 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.244052 26699 raft_consensus.cc:385] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.244541 26699 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.245405 26699 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.248574 26699 ts_tablet_manager.cc:1434] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:09:03.250149 26730 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.251936 26699 tablet_bootstrap.cc:492] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:03.259752 26702 tablet_bootstrap.cc:492] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:03.262302 26702 ts_tablet_manager.cc:1403] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.064s	user 0.031s	sys 0.014s
I20260709 13:09:03.264964 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:03.265844 26508 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.266548 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:03.261760 26699 tablet_bootstrap.cc:654] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:03.268567 26625 leader_election.cc:343] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.269100 26730 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:03.269330 26702 raft_consensus.cc:359] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.270402 26702 raft_consensus.cc:385] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.270840 26702 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.273458 26508 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:03.273664 26702 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.274904 26622 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.276906 27014 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.277407 27014 raft_consensus.cc:697] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:03.281000 27014 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.282611 26702 ts_tablet_manager.cc:1434] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:09:03.283780 26702 tablet_bootstrap.cc:492] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:03.291468 26699 tablet_bootstrap.cc:492] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:03.293033 26699 ts_tablet_manager.cc:1403] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.005s
I20260709 13:09:03.293198 26702 tablet_bootstrap.cc:654] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.295823 26699 raft_consensus.cc:359] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.298391 26699 raft_consensus.cc:385] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.298708 26699 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.299366 26699 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.305850 26702 tablet_bootstrap.cc:492] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:03.306499 26702 ts_tablet_manager.cc:1403] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.002s
I20260709 13:09:03.308457 26730 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.310130 26702 raft_consensus.cc:359] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.311383 26702 raft_consensus.cc:385] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.311868 26702 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.308966 26730 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.312899 26702 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.314103 26699 ts_tablet_manager.cc:1434] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
I20260709 13:09:03.315330 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:03.315915 26702 ts_tablet_manager.cc:1434] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
W20260709 13:09:03.316663 26625 leader_election.cc:343] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.317689 26702 tablet_bootstrap.cc:492] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:03.320188 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:03.321064 26508 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:03.322952 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.323573 26730 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:03.324265 27017 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.324666 27017 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.325002 27017 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.323719 26699 tablet_bootstrap.cc:492] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:03.327167 26702 tablet_bootstrap.cc:654] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.327823 27097 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.328341 27097 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.330744 27097 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:03.331492 26699 tablet_bootstrap.cc:654] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.331809 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:03.333233 26625 leader_election.cc:343] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.335763 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:03.336488 27020 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.336589 26508 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:03.337083 27020 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.338174 26622 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.339129 27097 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.339593 27097 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.340022 27097 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.340525 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:03.342444 26474 leader_election.cc:343] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.344425 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:03.340024 27020 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:03.346122 26476 leader_election.cc:343] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.346582 26476 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.348035 26699 tablet_bootstrap.cc:492] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:03.348534 26699 ts_tablet_manager.cc:1403] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.009s
I20260709 13:09:03.349714 27020 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:03.352411 26699 raft_consensus.cc:359] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.353170 26699 raft_consensus.cc:385] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.353628 26699 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.354620 26699 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.357963 27097 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.359951 27097 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:03.361027 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:03.360880 27017 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:03.362707 26625 leader_election.cc:343] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.363363 27017 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:03.364310 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:09:03.370373 26625 leader_election.cc:343] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.370560 26699 ts_tablet_manager.cc:1434] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:09:03.374097 26702 tablet_bootstrap.cc:492] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:03.374629 26702 ts_tablet_manager.cc:1403] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.006s
I20260709 13:09:03.379076 26699 tablet_bootstrap.cc:492] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:03.377450 26702 raft_consensus.cc:359] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.381008 26702 raft_consensus.cc:385] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.381314 26702 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.382117 26702 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.384358 26702 ts_tablet_manager.cc:1434] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:03.384682 26405 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.389793 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:03.390594 26501 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.399562 26501 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:03.403352 26862 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.403932 26862 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.405139 26622 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.411217 27017 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.407196 26862 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:03.411764 27017 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:03.407471 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:03.412967 27017 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.408775 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:03.415042 26654 raft_consensus.cc:2393] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 1: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:03.416751 26549 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:03.385600 26702 tablet_bootstrap.cc:492] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:03.425954 26862 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.429005 26405 catalog_manager.cc:5697] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.434535 26862 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:03.409478 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:03.410120 26699 tablet_bootstrap.cc:654] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.441735 26508 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.443248 26702 tablet_bootstrap.cc:654] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.456003 26699 tablet_bootstrap.cc:492] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:03.456574 26699 ts_tablet_manager.cc:1403] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.009s
I20260709 13:09:03.459550 26699 raft_consensus.cc:359] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.460372 26699 raft_consensus.cc:385] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.460732 26699 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.461488 26699 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.469955 26699 ts_tablet_manager.cc:1434] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:09:03.469847 27014 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.466614 26508 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:03.473026 27014 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.477029 27014 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:03.478776 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:03.480216 26625 leader_election.cc:343] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.472640 26699 tablet_bootstrap.cc:492] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:03.483052 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.488683 27014 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.489326 26699 tablet_bootstrap.cc:654] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.512843 26699 tablet_bootstrap.cc:492] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:03.513705 27014 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:03.514132 27039 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.514617 27039 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.515230 26699 ts_tablet_manager.cc:1403] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.001s
I20260709 13:09:03.514775 27014 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.517741 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:03.518435 26505 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:09:03.519739 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:03.520648 27056 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.521057 27056 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.521432 27056 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.526120 26585 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.533979 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:03.534387 27020 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:03.535009 26504 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:03.536332 27039 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:03.538203 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.540055 26730 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:03.540447 26730 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.540788 26730 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.518453 26699 raft_consensus.cc:359] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.546785 26699 raft_consensus.cc:385] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.547145 26699 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.548461 26699 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.571396 26744 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:03.580060 26730 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.583911 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:03.584532 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:03.585278 26505 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:03.585824 26625 leader_election.cc:343] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.596303 26730 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:03.604892 26583 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.608299 27056 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.609521 26702 tablet_bootstrap.cc:492] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:03.609997 26702 ts_tablet_manager.cc:1403] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.225s	user 0.009s	sys 0.026s
I20260709 13:09:03.611357 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:03.611987 26501 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.618391 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:03.619103 26653 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
I20260709 13:09:03.620882 26501 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:03.622088 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:03.622677 26405 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.624969 26862 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.625115 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:03.625490 26862 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:03.625818 26653 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.626322 26862 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.614243 27056 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:03.634091 26744 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:03.647346 26699 ts_tablet_manager.cc:1434] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.132s	user 0.014s	sys 0.013s
I20260709 13:09:03.595721 26505 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:03.650820 26702 raft_consensus.cc:359] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.654213 26702 raft_consensus.cc:385] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.654529 26702 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.655205 26702 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.655468 26699 tablet_bootstrap.cc:492] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:03.657881 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.663331 26702 ts_tablet_manager.cc:1434] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.002s
I20260709 13:09:03.667665 26744 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:03.687639 26657 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.698936 26730 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:03.699628 26730 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:03.693733 26653 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:03.700578 26730 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.701589 26702 tablet_bootstrap.cc:492] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
W20260709 13:09:03.722801 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:03.751883 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 56355.1us
W20260709 13:09:03.777714 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 80329.7us
I20260709 13:09:03.788458 26699 tablet_bootstrap.cc:654] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.834380 26744 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.834928 26744 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.844177 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:03.845952 26744 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:03.848446 26476 leader_election.cc:343] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.885912 26699 tablet_bootstrap.cc:492] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:03.886441 26699 ts_tablet_manager.cc:1403] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.231s	user 0.013s	sys 0.002s
W20260709 13:09:03.884298 26625 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.887259 27039 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:03.914330 27118 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:09:03.891875 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:03.883073 27119 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:09:03.920534 26702 tablet_bootstrap.cc:654] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:03.925922 26474 leader_election.cc:343] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:03.928884 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:03.930697 26699 raft_consensus.cc:359] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.931388 26699 raft_consensus.cc:385] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.931651 26699 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.932273 26699 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.937053 26699 ts_tablet_manager.cc:1434] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.001s
I20260709 13:09:03.916097 27039 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:03.978861 27039 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:03.979482 26581 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:03.975587 27027 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:03.926610 27110 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.058s
W20260709 13:09:03.986390 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 51069us
W20260709 13:09:03.985589 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 52886.4us
I20260709 13:09:03.989444 26699 tablet_bootstrap.cc:492] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:03.992727 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:04.070168 27097 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.071532 27097 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:04.217896 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:04.230206 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 153572us
I20260709 13:09:04.236511 26408 catalog_manager.cc:5697] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.234308 26405 catalog_manager.cc:5697] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.242645 27097 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:04.251334 26699 tablet_bootstrap.cc:654] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:04.292698 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:09:04.302502 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 79574.7us
W20260709 13:09:04.322050 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 67073.6us
I20260709 13:09:04.323177 26548 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:04.313824 27111 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.324463 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:04.328711 26702 tablet_bootstrap.cc:492] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:04.329340 26702 ts_tablet_manager.cc:1403] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.635s	user 0.025s	sys 0.006s
I20260709 13:09:04.307538 26508 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:04.325093 27111 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:04.342680 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 79099.1us
I20260709 13:09:04.351008 26702 raft_consensus.cc:359] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:04.351970 26702 raft_consensus.cc:385] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.352447 26702 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.353334 26702 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:04.360843 26702 ts_tablet_manager.cc:1434] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:09:04.362982 26702 tablet_bootstrap.cc:492] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:04.381914 27111 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:04.352169 27130 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:04.391443 27019 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.412241 26699 tablet_bootstrap.cc:492] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:04.414749 26699 ts_tablet_manager.cc:1403] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.430s	user 0.011s	sys 0.009s
I20260709 13:09:04.423503 26730 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:04.425602 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:04.406075 27125 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:09:04.400370 27019 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:04.428583 27137 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:04.425406 27097 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:09:04.452346 27019 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:04.453182 27137 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:04.463768 27137 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.466779 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:09:04.518579 26625 consensus_peers.cc:597] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.467715 26504 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 0.
W20260709 13:09:04.544590 26625 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.544788 26699 raft_consensus.cc:359] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:04.545586 26699 raft_consensus.cc:385] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.545938 26699 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
W20260709 13:09:04.547071 26625 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.546561 26699 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:04.482820 27139 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
W20260709 13:09:04.554126 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 71197.3us
I20260709 13:09:04.559298 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:04.561347 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:04.568395 26699 ts_tablet_manager.cc:1434] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.153s	user 0.008s	sys 0.000s
I20260709 13:09:04.630162 26744 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.635496 26702 tablet_bootstrap.cc:654] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:04.630896 26744 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:04.692353 26744 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:04.693848 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 150357us
I20260709 13:09:04.571156 27056 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.121s
I20260709 13:09:04.732506 27137 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:04.762147 26699 tablet_bootstrap.cc:492] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:04.769124 27137 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:04.776546 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 63450.3us
I20260709 13:09:04.800304 26548 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:04.801623 27119 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:04.802016 27119 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.802335 27119 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.822602 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:04.831410 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:09:04.838749 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 162636us
W20260709 13:09:04.856316 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 48974us
I20260709 13:09:04.859365 27119 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:04.884765 26549 leader_election.cc:343] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:04.929160 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 84828.9us
W20260709 13:09:04.930007 26474 leader_election.cc:343] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.934607 26699 tablet_bootstrap.cc:654] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:04.935863 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 78684.8us
I20260709 13:09:04.929005 27027 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.950809 26652 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:04.951793 26702 tablet_bootstrap.cc:492] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:04.954443 27155 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:04.966095 26702 ts_tablet_manager.cc:1403] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.603s	user 0.013s	sys 0.008s
I20260709 13:09:04.926337 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:04.968408 26476 leader_election.cc:343] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.982883 27133 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.983695 27133 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:04.986596 27133 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:04.967222 27016 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.967499 27027 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:05.003235 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 72376.6us
I20260709 13:09:05.003738 27119 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:05.049289 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:04.998206 27016 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:05.052035 26474 leader_election.cc:343] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.084127 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:05.085052 26508 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.047797 27146 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.095479 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:05.096491 26652 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 0.
I20260709 13:09:05.098981 27016 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:05.100275 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:05.101769 26625 leader_election.cc:343] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.133677 26702 raft_consensus.cc:359] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:05.132125 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 157994us
I20260709 13:09:05.135265 26474 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:05.135344 26476 leader_election.cc:343] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.135375 26702 raft_consensus.cc:385] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.136933 26702 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.136628 26476 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:05.137816 26702 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.149636 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:05.147059 27153 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.150848 27153 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.151305 27153 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.152520 27161 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.156141 26702 ts_tablet_manager.cc:1434] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.189s	user 0.008s	sys 0.000s
I20260709 13:09:05.131721 27146 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.165628 26699 tablet_bootstrap.cc:492] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:05.166307 26699 ts_tablet_manager.cc:1403] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.404s	user 0.034s	sys 0.040s
I20260709 13:09:05.174794 27027 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:05.246043 26702 tablet_bootstrap.cc:492] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:05.251319 26883 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.252122 26883 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.264611 26508 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:05.270531 26883 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:05.275137 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:05.278555 26699 raft_consensus.cc:359] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.279726 26699 raft_consensus.cc:385] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.280146 26699 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.281245 26548 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:05.281991 26699 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.291479 26699 ts_tablet_manager.cc:1434] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.125s	user 0.009s	sys 0.000s
I20260709 13:09:05.286197 27131 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.300884 27131 raft_consensus.cc:697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:05.301883 27131 consensus_queue.cc:237] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.298684 27166 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:05.308249 27166 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.344322 26702 tablet_bootstrap.cc:654] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.350250 27166 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:05.365296 27153 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.410249 27153 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:05.410395 27120 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.412405 27120 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.494011 27154 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:05.494782 27154 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.498070 27166 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:05.498725 27166 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.502642 27154 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:05.512414 27120 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:05.518450 26702 tablet_bootstrap.cc:492] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:05.535126 26699 tablet_bootstrap.cc:492] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:05.518836 27166 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:05.539587 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:05.543210 26583 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.535307 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:05.526522 27146 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:05.558176 26699 tablet_bootstrap.cc:654] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.559768 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:05.560585 26507 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:05.560654 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:05.561575 26509 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 1: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:05.563975 27146 consensus_queue.cc:1059] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:05.566042 27140 raft_consensus.cc:3055] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:05.566404 27140 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:05.567255 27140 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.568538 27140 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:05.571601 26405 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34762 (request call id 94) took 1702 ms. Trace:
I20260709 13:09:05.572870 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:05.574610 26407 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34738 (request call id 91) took 1227 ms. Trace:
I20260709 13:09:05.575074 26407 rpcz_store.cc:276] 0709 13:09:04.350619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.351604 (+   985us) service_pool.cc:224] Handling call
0709 13:09:05.574544 (+1222940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":646846,"reported_tablets":1}
I20260709 13:09:05.518983 26702 ts_tablet_manager.cc:1403] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.273s	user 0.004s	sys 0.029s
I20260709 13:09:05.572043 26405 rpcz_store.cc:276] 0709 13:09:03.873855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.874587 (+   732us) service_pool.cc:224] Handling call
0709 13:09:05.571501 (+1696914us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:04.485448 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:04.565696 (+ 80248us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:04.565730 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:09:04.565748 (+    18us) tablet.cc:662] Decoding operations
0709 13:09:04.566137 (+   389us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:04.566188 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:04.566214 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:04.566382 (+   168us) tablet.cc:701] Row locks acquired
0709 13:09:04.566401 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:09:04.566535 (+   134us) write_op.cc:270] Start()
0709 13:09:04.566637 (+   102us) write_op.cc:276] Timestamp: P: 1783602544566493 usec, L: 0
0709 13:09:04.566659 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:09:04.776817 (+210158us) log.cc:844] Serialized 543 byte log entry
0709 13:09:04.891769 (+114952us) op_driver.cc:464] REPLICATION: finished
0709 13:09:04.892379 (+   610us) write_op.cc:301] APPLY: starting
0709 13:09:04.892539 (+   160us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:04.892680 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:04.921313 (+ 28633us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:04.921583 (+   270us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:04.921752 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:04.921807 (+    55us) write_op.cc:312] APPLY: finished
0709 13:09:04.922014 (+   207us) log.cc:844] Serialized 22 byte log entry
0709 13:09:04.922205 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:04.922277 (+    72us) write_op.cc:454] Released schema lock
0709 13:09:04.922312 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:04.922633 (+   321us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:04.922665 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":780089,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":398,"apply.run_cpu_time_us":1907,"apply.run_wall_time_us":30214,"mutex_wait_us":512,"num_ops":1,"prepare.queue_time_us":238729,"prepare.run_cpu_time_us":23306,"prepare.run_wall_time_us":295677,"replication_time_us":324947}]]}
I20260709 13:09:05.583988 26408 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34748 (request call id 100) took 1691 ms. Trace:
I20260709 13:09:05.587531 26579 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.589169 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:05.589690 27130 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:05.589897 26654 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.590198 27130 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.592413 27130 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:05.597187 26654 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:05.597882 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:05.600517 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:05.584661 26408 rpcz_store.cc:276] 0709 13:09:03.892490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.892612 (+   122us) service_pool.cc:224] Handling call
0709 13:09:05.583892 (+1691280us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:04.309644 (+     0us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882981f0ac 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f8829839455 00007f883035e16c
0709 13:09:04.399341 (+ 89697us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:04.419607 (+ 20266us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:04.419643 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:09:04.419660 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:04.419986 (+   326us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:04.420057 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:04.420088 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:04.420252 (+   164us) tablet.cc:701] Row locks acquired
0709 13:09:04.420268 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:09:04.420389 (+   121us) write_op.cc:270] Start()
0709 13:09:04.420574 (+   185us) write_op.cc:276] Timestamp: P: 1783602544420355 usec, L: 0
0709 13:09:04.420593 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:09:04.433500 (+ 12907us) log.cc:844] Serialized 543 byte log entry
0709 13:09:04.534710 (+101210us) op_driver.cc:464] REPLICATION: finished
0709 13:09:04.717729 (+183019us) write_op.cc:301] APPLY: starting
0709 13:09:04.717812 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:04.717930 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:04.717955 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:04.718221 (+   266us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:04.718393 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:04.718441 (+    48us) write_op.cc:312] APPLY: finished
0709 13:09:04.718642 (+   201us) log.cc:844] Serialized 22 byte log entry
0709 13:09:04.718819 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:04.718889 (+    70us) write_op.cc:454] Released schema lock
0709 13:09:04.719031 (+   142us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:04.719396 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:04.719425 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":160079,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":182692,"apply.run_cpu_time_us":1647,"apply.run_wall_time_us":1648,"num_ops":1,"prepare.queue_time_us":146645,"prepare.run_cpu_time_us":3071,"prepare.run_wall_time_us":57362,"replication_time_us":113652,"spinlock_wait_cycles":19682688,"thread_start_us":126406,"threads_started":2}]]}
I20260709 13:09:05.606774 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:05.607448 26659 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.618355 26659 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:05.622068 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:05.623278 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:05.523557 27133 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:05.625531 27133 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.628520 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:05.643839 26474 leader_election.cc:343] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.627977 26702 raft_consensus.cc:359] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.655275 26702 raft_consensus.cc:385] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.655539 26702 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.656584 26474 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:05.657539 26699 tablet_bootstrap.cc:492] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:05.658018 26699 ts_tablet_manager.cc:1403] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.123s	user 0.030s	sys 0.020s
I20260709 13:09:05.632179 27133 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:05.665992 26702 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.669806 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:05.673804 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:05.674005 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:05.675295 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:05.662737 27020 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:05.682870 26476 leader_election.cc:343] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.683533 26476 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:05.688822 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:05.691262 27020 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:05.692183 27020 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.692905 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:05.693753 26549 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:05.695102 26476 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:05.696635 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:05.711769 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:05.716084 26702 ts_tablet_manager.cc:1434] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.137s	user 0.005s	sys 0.009s
I20260709 13:09:05.720213 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:05.678351 27016 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.724880 26549 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:05.728259 26549 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:05.730997 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:05.700897 27154 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.736521 26702 tablet_bootstrap.cc:492] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:05.729907 27140 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.739176 26699 raft_consensus.cc:359] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.724426 27153 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.742085 26699 raft_consensus.cc:385] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:05.744047 26476 leader_election.cc:343] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.744190 26699 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.744529 26476 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:05.746945 27168 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.745271 26699 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:05.742798 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 66384.8us
I20260709 13:09:05.750627 27181 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.744437 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:05.755816 26476 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:05.760499 27120 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.760577 27148 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.761404 27027 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.761541 26699 ts_tablet_manager.cc:1434] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.000s
I20260709 13:09:05.763605 26699 tablet_bootstrap.cc:492] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:05.777271 27140 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:05.794276 26622 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:05.796726 26702 tablet_bootstrap.cc:654] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.796916 27017 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.798092 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:05.797474 26577 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:05.802651 26456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:05.804049 27016 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.805395 27187 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.813328 27187 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.836139 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:05.839774 26702 tablet_bootstrap.cc:492] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:05.840219 26702 ts_tablet_manager.cc:1403] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.009s
I20260709 13:09:05.844221 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:05.834525 27187 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:05.817772 27181 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:09:05.855775 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:05.857123 26474 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:05.856426 26625 leader_election.cc:343] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.858614 27168 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.859720 26702 raft_consensus.cc:359] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.860242 26702 raft_consensus.cc:385] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.860476 26702 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.867626 26702 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.869935 26702 ts_tablet_manager.cc:1434] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 13:09:05.871170 26702 tablet_bootstrap.cc:492] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Bootstrap starting.
I20260709 13:09:05.873148 26577 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:05.879071 26502 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:05.882195 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:05.884488 27192 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.886669 27192 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.887149 27192 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.886670 26699 tablet_bootstrap.cc:654] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.905661 26407 catalog_manager.cc:5697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:05.909906 26702 tablet_bootstrap.cc:654] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.922216 26702 tablet_bootstrap.cc:492] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: No bootstrap required, opened a new log
I20260709 13:09:05.922127 27192 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.922732 26702 ts_tablet_manager.cc:1403] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.005s
I20260709 13:09:05.924716 26699 tablet_bootstrap.cc:492] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:05.925220 26699 ts_tablet_manager.cc:1403] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.002s
I20260709 13:09:05.925158 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:05.925853 26505 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.927969 26699 raft_consensus.cc:359] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.928797 26699 raft_consensus.cc:385] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.929112 26699 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.934818 26699 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.936014 26702 raft_consensus.cc:359] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.936718 26702 raft_consensus.cc:385] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.936986 26702 raft_consensus.cc:740] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.937767 26702 consensus_queue.cc:260] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.937363 26699 ts_tablet_manager.cc:1434] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 13:09:05.940929 26702 ts_tablet_manager.cc:1434] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:05.940871 26699 tablet_bootstrap.cc:492] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:05.940078 26505 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:05.942948 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:05.943675 27017 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.944092 27192 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:05.944166 27017 raft_consensus.cc:697] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:05.944221 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:05.945235 27017 consensus_queue.cc:237] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:05.949036 26625 leader_election.cc:343] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.951341 26699 tablet_bootstrap.cc:654] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.961328 26699 tablet_bootstrap.cc:492] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:05.961833 26699 ts_tablet_manager.cc:1403] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.001s
I20260709 13:09:05.964461 26699 raft_consensus.cc:359] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.965149 26699 raft_consensus.cc:385] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.965425 26699 raft_consensus.cc:740] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.966182 26699 consensus_queue.cc:260] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:05.970232 26699 ts_tablet_manager.cc:1434] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:05.971239 26699 tablet_bootstrap.cc:492] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:05.995179 26699 tablet_bootstrap.cc:654] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.000808 26408 catalog_manager.cc:5697] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 0 to 1, leader changed from <none> to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.015170 26699 tablet_bootstrap.cc:492] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:06.015703 26699 ts_tablet_manager.cc:1403] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.008s
I20260709 13:09:06.018186 26699 raft_consensus.cc:359] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.018838 26699 raft_consensus.cc:385] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.019101 26699 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.019688 26699 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.021708 26699 ts_tablet_manager.cc:1434] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:06.022611 26699 tablet_bootstrap.cc:492] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:06.029214 26699 tablet_bootstrap.cc:654] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.040539 27017 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.041082 27017 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.043111 27017 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:06.045269 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:06.045161 26408 catalog_manager.cc:5697] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.045950 26502 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:06.051483 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:06.053306 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:09:06.073455 26625 leader_election.cc:343] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.075670 27186 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.076282 27186 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.076740 27186 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.086812 27130 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.091813 27130 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.096112 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:06.099027 26699 tablet_bootstrap.cc:492] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:06.100347 26699 ts_tablet_manager.cc:1403] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.078s	user 0.030s	sys 0.041s
I20260709 13:09:06.099737 27186 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.100692 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:06.102178 26549 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:06.103049 26699 raft_consensus.cc:359] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.103739 26699 raft_consensus.cc:385] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.103964 27181 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.109975 27130 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:06.114244 27186 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:06.104001 26699 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.117362 26699 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:06.119926 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 46543.8us
I20260709 13:09:06.121806 26699 ts_tablet_manager.cc:1434] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:06.134141 26699 tablet_bootstrap.cc:492] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7: Bootstrap starting.
I20260709 13:09:06.137082 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:06.126785 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:06.131594 26577 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.146003 26502 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:06.149488 26625 leader_election.cc:343] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.160432 26699 tablet_bootstrap.cc:654] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.182282 26502 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:06.184197 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:06.185042 27040 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.185504 27040 raft_consensus.cc:697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:06.187009 27040 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.195632 27185 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.196228 27185 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.200067 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:06.200754 26501 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:06.204425 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:06.204869 27185 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:06.205284 27017 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.206087 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:06.205700 27017 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.207161 26577 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 0.
I20260709 13:09:06.207576 27017 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.215152 27017 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.217322 27017 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:06.218611 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:06.219285 26577 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.219261 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:06.220042 26501 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.219758 26405 catalog_manager.cc:5697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.222410 26699 tablet_bootstrap.cc:492] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7: No bootstrap required, opened a new log
I20260709 13:09:06.228343 26699 ts_tablet_manager.cc:1403] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7: Time spent bootstrapping tablet: real 0.094s	user 0.028s	sys 0.009s
I20260709 13:09:06.228003 26577 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:06.230822 26501 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:06.232059 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:06.233405 27017 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.234570 27017 raft_consensus.cc:697] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:06.234714 26699 raft_consensus.cc:359] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.235482 26699 raft_consensus.cc:385] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.235828 26699 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.235523 27017 consensus_queue.cc:237] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.236500 26699 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.245718 26699 ts_tablet_manager.cc:1434] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:09:06.254813 27149 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:06.251720 26408 catalog_manager.cc:5697] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 0 to 1, leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.292794 26744 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:06.296814 27120 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.297391 27120 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.304395 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:06.309924 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:06.311466 26549 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:06.314287 27130 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.309762 27120 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:06.400722 26585 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.409245 27040 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:06.424852 27017 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.477982 27130 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.478721 27130 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.481109 27130 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:06.482906 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:06.490119 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:06.490825 26508 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 1: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:09:06.491806 26548 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:06.493429 27120 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.504313 26580 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.514457 27120 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.711470 27185 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.737066 27185 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:06.810310 27016 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:06.820242 27017 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.830322 26744 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:06.831418 26744 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.835582 26744 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:06.836283 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:06.837080 26585 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:06.839058 26476 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:06.840451 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:06.840939 26744 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:06.841277 26744 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:06.843562 26744 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:06.841287 26659 raft_consensus.cc:2393] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 2: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:09:06.874547 26744 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.888588 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:06.892808 26744 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:06.896075 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:06.897194 26651 raft_consensus.cc:2393] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 2: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:09:06.899519 26580 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:06.904788 26476 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:06.907543 26744 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:06.923135 26744 raft_consensus.cc:697] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:06.923982 26744 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:06.988543 26405 catalog_manager.cc:5697] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.346585 26580 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:07.347997 27221 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:07.369161 26651 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:07.376724 27222 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:08.263700 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:08.275166 27232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.275661 27231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.278860 27234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:08.281526 25395 server_base.cc:1061] running on GCE node
I20260709 13:09:08.282816 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:08.283075 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:08.283275 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602548283254 us; error 0 us; skew 500 ppm
I20260709 13:09:08.283880 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:08.287678 25395 webserver.cc:533] Webserver started at http://127.24.204.196:46869/ using document root <none> and password file <none>
I20260709 13:09:08.288300 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:08.288560 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:08.289052 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:08.290711 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-3-root/instance:
uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-qv7r"
I20260709 13:09:08.305871 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.014s	user 0.010s	sys 0.003s
I20260709 13:09:08.314568 27239 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.315553 25395 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:09:08.315902 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-3-root
uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-qv7r"
I20260709 13:09:08.316272 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:08.369292 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:08.370960 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:08.372776 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:08.375844 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:08.376044 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.376360 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:08.376542 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.482016 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.196:45899
I20260709 13:09:08.482502 27302 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.196:45899 every 8 connection(s)
I20260709 13:09:08.541074 25395 auto_leader_rebalancer-test.cc:384] add a tserver: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:08.546639 27303 heartbeater.cc:344] Connected to a master server at 127.24.204.254:32835
I20260709 13:09:08.547173 27303 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:08.548056 27303 heartbeater.cc:507] Master 127.24.204.254:32835 requested a full tablet report, sending...
I20260709 13:09:08.550237 26408 ts_manager.cc:194] Registered new tserver with Master: b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:08.551971 26408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48166
I20260709 13:09:09.240816 26655 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:09.260720 26585 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:09.261696 26502 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:09.262503 27016 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:09.265643 27016 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:09.287811 27185 raft_consensus.cc:2955] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.298388 26585 raft_consensus.cc:2955] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.308282 26502 raft_consensus.cc:2955] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
W20260709 13:09:09.323769 26622 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f3c8f39cbe14359a810de00ced87a46. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.361528 26408 catalog_manager.cc:5697] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.363541 26501 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:09.381985 26655 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:09.383930 27222 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:09.389914 26585 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:09.392771 27222 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:09:09.439105 27309 raft_consensus.cc:2955] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
W20260709 13:09:09.447449 26473 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41780cfc14f24065b0d12741153c5b15. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.446892 26657 raft_consensus.cc:2955] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.466195 26578 raft_consensus.cc:2955] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.495042 26657 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:09.512223 26406 catalog_manager.cc:5697] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:09.516530 26622 consensus_peers.cc:597] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ecc61d0190444bea318620b6a278926. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.517673 26578 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:09.528880 26501 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:09.542174 27185 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:09.543416 27244 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:09.555325 27303 heartbeater.cc:499] Master 127.24.204.254:32835 was elected leader, sending a full tablet report...
I20260709 13:09:09.568102 27310 raft_consensus.cc:2955] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.572458 26501 raft_consensus.cc:2955] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.578799 26578 raft_consensus.cc:2955] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.591130 26406 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.603632 26657 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
W20260709 13:09:09.618278 26622 consensus_peers.cc:597] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6d05596fdb0401faeb202a1f8740d44. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.630373 26580 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:09.632647 27244 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:09.633143 26501 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:09.635619 27244 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:09.647959 27185 raft_consensus.cc:2955] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.649617 26578 raft_consensus.cc:2955] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.659828 26501 raft_consensus.cc:2955] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.670943 26406 catalog_manager.cc:5697] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:09.894505 27334 ts_tablet_manager.cc:933] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:09.906507 27334 tablet_copy_client.cc:323] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:09.946342 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 8f3c8f39cbe14359a810de00ced87a46 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:09.947063 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 8f3c8f39cbe14359a810de00ced87a46 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-8f3c8f39cbe14359a810de00ced87a46
I20260709 13:09:09.960606 27338 ts_tablet_manager.cc:933] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:09.965157 26669 tablet_copy_source_session.cc:215] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:09.969672 27334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3c8f39cbe14359a810de00ced87a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.969206 27338 tablet_copy_client.cc:323] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:10.079602 27340 ts_tablet_manager.cc:933] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:09:10.110700 27334 tablet_copy_client.cc:806] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:10.111548 27334 tablet_copy_client.cc:670] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:10.148264 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 9ecc61d0190444bea318620b6a278926 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:10.155567 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 9ecc61d0190444bea318620b6a278926 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-9ecc61d0190444bea318620b6a278926
I20260709 13:09:10.222689 27340 tablet_copy_client.cc:323] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:09:10.243673 27342 ts_tablet_manager.cc:933] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:10.246439 27334 tablet_copy_client.cc:538] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:09:10.237835 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 86408.3us
I20260709 13:09:10.262722 26669 tablet_copy_source_session.cc:215] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:09:10.265825 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 86963.1us
I20260709 13:09:10.269232 27338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecc61d0190444bea318620b6a278926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.335253 27342 tablet_copy_client.cc:323] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:10.372540 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet f6d05596fdb0401faeb202a1f8740d44 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:10.373118 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet f6d05596fdb0401faeb202a1f8740d44 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-f6d05596fdb0401faeb202a1f8740d44
I20260709 13:09:10.373644 27334 tablet_bootstrap.cc:492] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:10.381672 26669 tablet_copy_source_session.cc:215] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:10.391137 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet 41780cfc14f24065b0d12741153c5b15 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:09:10.391782 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet 41780cfc14f24065b0d12741153c5b15 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-41780cfc14f24065b0d12741153c5b15
I20260709 13:09:10.389511 27342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d05596fdb0401faeb202a1f8740d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.397661 27338 tablet_copy_client.cc:806] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:10.401899 27338 tablet_copy_client.cc:670] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:10.415266 27338 tablet_copy_client.cc:538] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:10.428769 27338 tablet_bootstrap.cc:492] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:10.447425 27342 tablet_copy_client.cc:806] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:10.427913 26520 tablet_copy_source_session.cc:215] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:10.450075 27342 tablet_copy_client.cc:670] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:10.456561 27340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41780cfc14f24065b0d12741153c5b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.464155 27342 tablet_copy_client.cc:538] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:10.485051 27342 tablet_bootstrap.cc:492] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:10.487052 27340 tablet_copy_client.cc:806] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:10.487715 27340 tablet_copy_client.cc:670] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:10.490621 27334 tablet_bootstrap.cc:492] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:10.498379 27340 tablet_copy_client.cc:538] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:10.498764 27334 tablet_bootstrap.cc:492] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:10.499665 27334 ts_tablet_manager.cc:1403] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.126s	user 0.024s	sys 0.006s
I20260709 13:09:10.503608 27334 raft_consensus.cc:359] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:10.508643 27340 tablet_bootstrap.cc:492] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:10.512482 27334 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:10.511554 27338 tablet_bootstrap.cc:492] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:10.517750 27338 tablet_bootstrap.cc:492] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:10.518656 27338 ts_tablet_manager.cc:1403] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.090s	user 0.028s	sys 0.017s
I20260709 13:09:10.516255 27334 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:10.526659 27338 raft_consensus.cc:359] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:10.534230 27338 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:10.534884 27338 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:10.612279 27334 ts_tablet_manager.cc:1434] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.112s	user 0.012s	sys 0.009s
I20260709 13:09:10.615536 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-8f3c8f39cbe14359a810de00ced87a46 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:10.616272 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-8f3c8f39cbe14359a810de00ced87a46 on tablet 8f3c8f39cbe14359a810de00ced87a46 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:10.647974 27342 tablet_bootstrap.cc:492] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:10.652592 27342 tablet_bootstrap.cc:492] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:10.654345 27342 ts_tablet_manager.cc:1403] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.170s	user 0.024s	sys 0.011s
I20260709 13:09:10.659840 27342 raft_consensus.cc:359] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:10.663335 27342 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:10.651258 27340 tablet_bootstrap.cc:492] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:10.664554 27342 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:10.665925 27340 tablet_bootstrap.cc:492] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:10.667358 27340 ts_tablet_manager.cc:1403] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.159s	user 0.032s	sys 0.017s
I20260709 13:09:10.670499 27338 ts_tablet_manager.cc:1434] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.151s	user 0.012s	sys 0.020s
I20260709 13:09:10.670733 27342 ts_tablet_manager.cc:1434] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:09:10.670450 27340 raft_consensus.cc:359] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:10.672360 27340 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:10.672978 27340 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:10.673282 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-9ecc61d0190444bea318620b6a278926 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:10.673818 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-9ecc61d0190444bea318620b6a278926 on tablet 9ecc61d0190444bea318620b6a278926 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:10.674795 27340 ts_tablet_manager.cc:1434] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:09:10.675683 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-f6d05596fdb0401faeb202a1f8740d44 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:10.676121 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-f6d05596fdb0401faeb202a1f8740d44 on tablet f6d05596fdb0401faeb202a1f8740d44 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:10.676468 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-41780cfc14f24065b0d12741153c5b15 received from {username='slave'} at 127.0.0.1:55308
I20260709 13:09:10.676931 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-41780cfc14f24065b0d12741153c5b15 on tablet 41780cfc14f24065b0d12741153c5b15 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:10.716504 27277 raft_consensus.cc:1217] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:10.829492 27277 raft_consensus.cc:1217] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:09:11.019053 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 93776us
W20260709 13:09:11.020493 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 92962.1us
I20260709 13:09:11.021808 27277 raft_consensus.cc:1217] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:09:11.050383 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 47967.2us
I20260709 13:09:11.158073 27016 raft_consensus.cc:1064] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:11.164077 27016 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:11.182760 27277 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.184762 26577 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.185396 27244 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:11.186396 26501 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.188499 27016 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:11.191190 27344 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:11.231024 27277 raft_consensus.cc:2955] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.232093 27344 raft_consensus.cc:2955] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.243888 27276 raft_consensus.cc:1217] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:11.264286 26501 raft_consensus.cc:2955] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.268201 27185 raft_consensus.cc:1064] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:11.271263 27185 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:11.275825 26578 raft_consensus.cc:2955] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.291666 26406 catalog_manager.cc:5697] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:11.356580 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 51942.5us
I20260709 13:09:11.362608 27277 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.371534 26578 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.374532 26506 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.394096 27377 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:11.397444 27185 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:11.403242 27377 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:11.481329 26657 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:11.484797 27016 raft_consensus.cc:2955] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.504873 27277 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:11.504906 26501 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:11.507771 27369 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:11.506808 26506 raft_consensus.cc:2955] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.507329 27277 raft_consensus.cc:2955] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.517136 27375 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:11.522373 26577 raft_consensus.cc:2955] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.536377 26407 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.539393 27185 raft_consensus.cc:2955] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.560144 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f3c8f39cbe14359a810de00ced87a46 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:11.580150 26501 raft_consensus.cc:2955] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.590170 27277 raft_consensus.cc:2955] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.598003 26407 catalog_manager.cc:5697] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.613539 27309 raft_consensus.cc:1064] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:11.613945 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f3c8f39cbe14359a810de00ced87a46 with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:11.616633 27309 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:11.621421 26655 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:11.627765 27016 raft_consensus.cc:1064] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:11.638392 27016 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:11.642207 27276 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:11.643002 26577 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:11.644554 27369 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:11.646245 27344 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:11.657605 27375 raft_consensus.cc:2955] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.664623 27276 raft_consensus.cc:2955] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.679065 26577 raft_consensus.cc:2955] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:11.690646 27277 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.690876 27278 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.692766 27361 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:11.693238 26655 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.696043 26579 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.697718 27309 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:11.699187 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ecc61d0190444bea318620b6a278926 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:11.700732 27309 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:11.702831 26579 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.707264 26501 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:11.690809 27381 tablet_replica.cc:333] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:11.719969 26407 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.714437 27375 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:09:11.732546 27369 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:11.734124 27016 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:11.836190 27381 raft_consensus.cc:2243] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:11.837150 27381 raft_consensus.cc:2272] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:11.853233 27381 ts_tablet_manager.cc:1916] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:09:11.897758 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 67927.8us
I20260709 13:09:11.902469 26585 raft_consensus.cc:2955] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:11.992411 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 83068.3us
I20260709 13:09:11.913954 27278 raft_consensus.cc:2955] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:12.022136 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 112563us
I20260709 13:09:12.006708 27309 raft_consensus.cc:2955] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:12.010552 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 94851.5us
I20260709 13:09:12.031036 27381 ts_tablet_manager.cc:1929] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:12.033479 27381 log.cc:1199] T 8f3c8f39cbe14359a810de00ced87a46 P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/8f3c8f39cbe14359a810de00ced87a46
I20260709 13:09:12.039897 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet 8f3c8f39cbe14359a810de00ced87a46 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:12.044474 27376 raft_consensus.cc:2955] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.058516 26509 raft_consensus.cc:2955] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.079021 26404 catalog_manager.cc:5697] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.079258 27278 raft_consensus.cc:2955] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.096516 26655 raft_consensus.cc:2955] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.110288 26576 raft_consensus.cc:2955] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.121744 26408 catalog_manager.cc:5697] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.135293 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ecc61d0190444bea318620b6a278926 with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:12.178859 27394 tablet_replica.cc:333] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:09:12.183318 26509 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:12.190111 27278 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:12.191694 27389 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:12.192463 26655 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:12.194797 27394 raft_consensus.cc:2243] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.201287 27393 raft_consensus.cc:2955] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.202755 27394 raft_consensus.cc:2272] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.203208 26578 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:12.203037 27278 raft_consensus.cc:2955] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.204753 27344 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:12.206749 27394 ts_tablet_manager.cc:1916] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:12.206811 27276 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:12.209812 27344 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:12.213805 27377 raft_consensus.cc:2955] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.217343 26408 catalog_manager.cc:5697] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.221006 26576 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:12.221715 26585 raft_consensus.cc:2955] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.222962 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 41780cfc14f24065b0d12741153c5b15 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:12.229434 27309 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:12.239617 26578 raft_consensus.cc:2955] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.243114 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 41780cfc14f24065b0d12741153c5b15 with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:12.259716 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6d05596fdb0401faeb202a1f8740d44 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:12.265143 27394 ts_tablet_manager.cc:1929] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:12.265708 27394 log.cc:1199] T 9ecc61d0190444bea318620b6a278926 P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/9ecc61d0190444bea318620b6a278926
I20260709 13:09:12.267779 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet 9ecc61d0190444bea318620b6a278926 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:12.270998 26404 catalog_manager.cc:5697] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.273903 27278 raft_consensus.cc:2955] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:12.279198 27395 tablet_replica.cc:333] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:09:12.294421 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet f6d05596fdb0401faeb202a1f8740d44 with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:12.303089 27394 tablet_replica.cc:333] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:09:12.304291 27394 raft_consensus.cc:2243] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.305076 27394 raft_consensus.cc:2272] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.313262 27395 raft_consensus.cc:2243] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:12.314178 27395 raft_consensus.cc:2272] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:12.318528 27395 ts_tablet_manager.cc:1916] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:12.323262 27394 ts_tablet_manager.cc:1916] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:12.340757 27394 ts_tablet_manager.cc:1929] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:12.341184 27394 log.cc:1199] T f6d05596fdb0401faeb202a1f8740d44 P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/f6d05596fdb0401faeb202a1f8740d44
I20260709 13:09:12.343272 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet f6d05596fdb0401faeb202a1f8740d44 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:12.346225 27395 ts_tablet_manager.cc:1929] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:12.347417 27395 log.cc:1199] T 41780cfc14f24065b0d12741153c5b15 P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/41780cfc14f24065b0d12741153c5b15
I20260709 13:09:12.349056 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 41780cfc14f24065b0d12741153c5b15 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:13.437546 26585 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:13.447593 26655 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:13.449831 27351 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.480760 26509 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:13.482563 27401 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.486645 27351 raft_consensus.cc:2955] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.495838 26655 raft_consensus.cc:2955] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
W20260709 13:09:13.499823 26548 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b74cbdc379342d4832425ebe52bbac5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.506901 26509 raft_consensus.cc:2955] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.519107 26407 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.525820 26655 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:13.582213 26578 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:13.583465 26622 consensus_peers.cc:597] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66cd76ef163447878430c4633d13a427. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.584282 27344 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.588532 26509 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:13.590037 27344 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:13.610095 27369 raft_consensus.cc:2955] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.616909 26578 raft_consensus.cc:2955] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.628635 26501 raft_consensus.cc:2955] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.632862 26659 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:13.654839 26407 catalog_manager.cc:5697] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.669301 26585 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:13.670739 26501 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:13.671288 27415 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.672740 27369 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:13.675449 26622 consensus_peers.cc:597] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32c8792823e44557bace909d8b20d9eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.681257 27344 raft_consensus.cc:2955] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.682938 26585 raft_consensus.cc:2955] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.690105 26501 raft_consensus.cc:2955] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.699074 26509 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:13.702607 26407 catalog_manager.cc:5697] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:13.707465 26473 consensus_peers.cc:597] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71037b41f3ef4e33946b5099bf7adb3d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.708437 26659 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:13.709393 26585 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:13.710067 27309 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.710948 27397 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:13.725466 27397 raft_consensus.cc:2955] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.728917 26578 raft_consensus.cc:2955] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.750275 26659 raft_consensus.cc:2955] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.757771 26404 catalog_manager.cc:5697] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:13.994918 27422 ts_tablet_manager.cc:933] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:13.996436 27422 tablet_copy_client.cc:323] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.194:33025
I20260709 13:09:14.015316 26595 tablet_copy_service.cc:140] P ef2886777a8f45e69e213b02a22ecec7: Received BeginTabletCopySession request for tablet 9b74cbdc379342d4832425ebe52bbac5 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39940)
I20260709 13:09:14.015946 26595 tablet_copy_service.cc:161] P ef2886777a8f45e69e213b02a22ecec7: Beginning new tablet copy session on tablet 9b74cbdc379342d4832425ebe52bbac5 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39940: session id = b1f40e8672c549d3b4be7862ac07b7e2-9b74cbdc379342d4832425ebe52bbac5
I20260709 13:09:14.023268 26595 tablet_copy_source_session.cc:215] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:14.031438 27422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b74cbdc379342d4832425ebe52bbac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:14.034271 27426 ts_tablet_manager.cc:933] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:14.038261 27426 tablet_copy_client.cc:323] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:14.039728 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 66cd76ef163447878430c4633d13a427 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:14.040297 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 66cd76ef163447878430c4633d13a427 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-66cd76ef163447878430c4633d13a427
I20260709 13:09:14.047603 26669 tablet_copy_source_session.cc:215] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:14.051452 27426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cd76ef163447878430c4633d13a427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:14.055773 27422 tablet_copy_client.cc:806] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:14.056818 27422 tablet_copy_client.cc:670] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:14.060916 27422 tablet_copy_client.cc:538] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:14.070075 27422 tablet_bootstrap.cc:492] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:14.070487 27426 tablet_copy_client.cc:806] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:14.071118 27426 tablet_copy_client.cc:670] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:14.079052 27426 tablet_copy_client.cc:538] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:14.091964 27426 tablet_bootstrap.cc:492] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:14.126199 27422 tablet_bootstrap.cc:492] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:14.127475 27422 tablet_bootstrap.cc:492] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:14.128472 27422 ts_tablet_manager.cc:1403] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.016s
I20260709 13:09:14.132576 27422 raft_consensus.cc:359] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:14.133628 27422 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:14.134402 27422 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:14.147413 27426 tablet_bootstrap.cc:492] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:14.148584 27426 tablet_bootstrap.cc:492] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:14.149300 27426 ts_tablet_manager.cc:1403] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.014s
I20260709 13:09:14.155862 27426 raft_consensus.cc:359] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:14.157395 27426 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:14.158115 27426 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:14.160845 27422 ts_tablet_manager.cc:1434] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.012s
I20260709 13:09:14.166222 26595 tablet_copy_service.cc:342] P ef2886777a8f45e69e213b02a22ecec7: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-9b74cbdc379342d4832425ebe52bbac5 received from {username='slave'} at 127.0.0.1:39940
I20260709 13:09:14.166376 27426 ts_tablet_manager.cc:1434] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:14.166752 26595 tablet_copy_service.cc:434] P ef2886777a8f45e69e213b02a22ecec7: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-9b74cbdc379342d4832425ebe52bbac5 on tablet 9b74cbdc379342d4832425ebe52bbac5 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:14.168440 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-66cd76ef163447878430c4633d13a427 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:14.168897 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-66cd76ef163447878430c4633d13a427 on tablet 66cd76ef163447878430c4633d13a427 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:14.241549 27426 ts_tablet_manager.cc:933] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:09:14.249017 27426 tablet_copy_client.cc:323] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:09:14.250852 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet 71037b41f3ef4e33946b5099bf7adb3d from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:09:14.251464 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet 71037b41f3ef4e33946b5099bf7adb3d from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-71037b41f3ef4e33946b5099bf7adb3d
I20260709 13:09:14.259516 26520 tablet_copy_source_session.cc:215] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:14.263182 27426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71037b41f3ef4e33946b5099bf7adb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:14.279583 27422 ts_tablet_manager.cc:933] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:14.280476 27426 tablet_copy_client.cc:806] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:14.281180 27426 tablet_copy_client.cc:670] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:14.282037 27422 tablet_copy_client.cc:323] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:14.284468 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 32c8792823e44557bace909d8b20d9eb from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:14.284984 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 32c8792823e44557bace909d8b20d9eb from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-32c8792823e44557bace909d8b20d9eb
I20260709 13:09:14.285377 27426 tablet_copy_client.cc:538] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:14.292755 26669 tablet_copy_source_session.cc:215] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:14.296105 27422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c8792823e44557bace909d8b20d9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:14.297055 27426 tablet_bootstrap.cc:492] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:14.313637 27422 tablet_copy_client.cc:806] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:14.314491 27422 tablet_copy_client.cc:670] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:14.318827 27422 tablet_copy_client.cc:538] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:14.322685 27426 tablet_bootstrap.cc:492] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:14.323688 27426 tablet_bootstrap.cc:492] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:14.324407 27426 ts_tablet_manager.cc:1403] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.003s
I20260709 13:09:14.327526 27426 raft_consensus.cc:359] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:14.328405 27426 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:14.328624 27422 tablet_bootstrap.cc:492] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:14.329107 27426 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:14.331670 27426 ts_tablet_manager.cc:1434] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:14.334571 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-71037b41f3ef4e33946b5099bf7adb3d received from {username='slave'} at 127.0.0.1:55308
I20260709 13:09:14.334993 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-71037b41f3ef4e33946b5099bf7adb3d on tablet 71037b41f3ef4e33946b5099bf7adb3d with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:14.353521 27422 tablet_bootstrap.cc:492] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:14.354513 27422 tablet_bootstrap.cc:492] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:14.355214 27422 ts_tablet_manager.cc:1403] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.001s
I20260709 13:09:14.358091 27422 raft_consensus.cc:359] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:14.358901 27422 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:14.359536 27422 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:14.362241 27422 ts_tablet_manager.cc:1434] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:14.363956 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-32c8792823e44557bace909d8b20d9eb received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:14.364370 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-32c8792823e44557bace909d8b20d9eb on tablet 32c8792823e44557bace909d8b20d9eb with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:14.516736 27278 raft_consensus.cc:1217] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:14.611481 27278 raft_consensus.cc:1217] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:14.725771 27276 raft_consensus.cc:1217] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:14.817730 27276 raft_consensus.cc:1217] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:14.954443 27410 raft_consensus.cc:1064] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:14.956734 27410 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:14.962868 26659 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:14.964419 27276 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:14.966764 27362 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:14.967506 26502 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:14.968747 27362 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:14.969710 27412 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:15.002125 27412 raft_consensus.cc:2955] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.008147 27276 raft_consensus.cc:2955] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.005620 26509 raft_consensus.cc:2955] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.020900 26659 raft_consensus.cc:2955] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.036154 26404 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.070050 27344 raft_consensus.cc:1064] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:15.072315 27344 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:15.080636 26576 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:15.080636 26502 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:15.083554 27276 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:15.083905 27369 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:15.085278 27377 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:15.094549 27377 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:15.121622 26578 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:15.130616 27377 raft_consensus.cc:2955] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.136519 27278 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:15.134634 26576 raft_consensus.cc:2955] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.138168 27410 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:15.142755 26509 raft_consensus.cc:2955] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.136088 27276 raft_consensus.cc:2955] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.145483 27440 raft_consensus.cc:2955] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.152977 26406 catalog_manager.cc:5697] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.156258 26506 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:15.157539 27412 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:15.165120 27278 raft_consensus.cc:2955] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.178012 26395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b74cbdc379342d4832425ebe52bbac5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:15.192714 27344 raft_consensus.cc:1064] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:15.195007 26407 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.199762 27344 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:15.202091 26506 raft_consensus.cc:2955] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.212441 26651 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:15.226264 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b74cbdc379342d4832425ebe52bbac5 with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:15.241438 27278 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:15.252259 26506 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:15.254055 27451 tablet_replica.cc:333] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:09:15.256560 27451 raft_consensus.cc:2243] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.257308 27451 raft_consensus.cc:2272] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.266943 27451 ts_tablet_manager.cc:1916] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:15.269362 27415 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:15.274425 26576 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:15.276158 27415 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:15.280999 27369 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:15.283175 27451 ts_tablet_manager.cc:1929] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:15.283692 27451 log.cc:1199] T 9b74cbdc379342d4832425ebe52bbac5 P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/9b74cbdc379342d4832425ebe52bbac5
I20260709 13:09:15.285403 27276 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:15.287060 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 9b74cbdc379342d4832425ebe52bbac5 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:15.285403 26506 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:15.292104 27415 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:15.295826 27344 raft_consensus.cc:2955] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.300308 27369 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:15.307567 26502 raft_consensus.cc:2955] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.313616 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66cd76ef163447878430c4633d13a427 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:15.320911 27278 raft_consensus.cc:2955] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.326833 26407 catalog_manager.cc:5697] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.326226 27449 raft_consensus.cc:2955] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.340255 26506 raft_consensus.cc:2955] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.342403 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet 66cd76ef163447878430c4633d13a427 with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:15.367404 27457 tablet_replica.cc:333] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:15.369051 27457 raft_consensus.cc:2243] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.371703 27457 raft_consensus.cc:2272] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.372105 26406 catalog_manager.cc:5697] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.378340 27457 ts_tablet_manager.cc:1916] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:15.387401 26578 raft_consensus.cc:2955] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.395808 27457 ts_tablet_manager.cc:1929] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:15.396251 27457 log.cc:1199] T 66cd76ef163447878430c4633d13a427 P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/66cd76ef163447878430c4633d13a427
I20260709 13:09:15.397825 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet 66cd76ef163447878430c4633d13a427 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:15.402990 27276 raft_consensus.cc:2955] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.408303 27397 raft_consensus.cc:1064] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:15.413120 27397 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:15.442672 27276 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:15.444264 26578 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:15.445776 27396 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:15.447968 26651 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:15.451649 26659 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:15.456532 27435 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:15.457217 27276 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:15.458730 27415 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:15.461141 26576 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:15.466128 27449 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:15.467444 27396 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:15.467990 27449 raft_consensus.cc:2955] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.472546 27277 raft_consensus.cc:2955] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.505043 26578 raft_consensus.cc:2955] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.513255 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 32c8792823e44557bace909d8b20d9eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:15.534618 26408 catalog_manager.cc:5697] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.550523 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet 32c8792823e44557bace909d8b20d9eb with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:15.598243 27462 tablet_replica.cc:333] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:09:15.606235 27462 raft_consensus.cc:2243] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.607108 27462 raft_consensus.cc:2272] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.610702 27435 raft_consensus.cc:2955] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.617400 26576 raft_consensus.cc:2955] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.620204 27462 ts_tablet_manager.cc:1916] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:15.619073 27277 raft_consensus.cc:2955] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.624502 26651 raft_consensus.cc:2955] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.634524 26406 catalog_manager.cc:5697] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.654352 26506 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:15.666190 27462 ts_tablet_manager.cc:1929] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:15.666967 27462 log.cc:1199] T 32c8792823e44557bace909d8b20d9eb P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/32c8792823e44557bace909d8b20d9eb
I20260709 13:09:15.668759 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet 32c8792823e44557bace909d8b20d9eb (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:15.675495 27277 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:15.677235 27397 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:15.679186 26576 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:15.681401 27397 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:15.685969 27435 raft_consensus.cc:2955] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.694288 27277 raft_consensus.cc:2955] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.696727 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71037b41f3ef4e33946b5099bf7adb3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:15.696110 26576 raft_consensus.cc:2955] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:15.705873 26406 catalog_manager.cc:5697] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.717828 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 71037b41f3ef4e33946b5099bf7adb3d with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:15.718840 27451 tablet_replica.cc:333] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:09:15.719856 27451 raft_consensus.cc:2243] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.720649 27451 raft_consensus.cc:2272] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.723996 27451 ts_tablet_manager.cc:1916] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:15.737490 27451 ts_tablet_manager.cc:1929] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:15.737890 27451 log.cc:1199] T 71037b41f3ef4e33946b5099bf7adb3d P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/71037b41f3ef4e33946b5099bf7adb3d
I20260709 13:09:15.739276 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 71037b41f3ef4e33946b5099bf7adb3d (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:16.792183 26651 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:16.799269 26509 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:16.799465 26622 consensus_peers.cc:597] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0b9da52e1c04100a4d56d1cfce9e2a2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.800590 27465 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:16.802214 26578 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:16.803325 27465 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:16.809201 27415 raft_consensus.cc:2955] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:16.812844 26509 raft_consensus.cc:2955] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:16.836089 26408 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.841972 26651 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:16.860432 26576 raft_consensus.cc:2955] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:16.872435 26578 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:16.873256 26622 consensus_peers.cc:597] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81721f0402d24cbfb7f52e0ba164247b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.874177 27456 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:16.875025 26509 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:16.880309 27467 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:16.893386 27456 raft_consensus.cc:2955] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:16.896205 26509 raft_consensus.cc:2955] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:16.913062 26576 raft_consensus.cc:2955] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:16.929821 26578 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:16.940521 26407 catalog_manager.cc:5697] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
W20260709 13:09:16.960368 26548 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a78e2d37ffa144e9ae8e64979146f436. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:16.963529 26657 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:16.963860 26501 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:16.969352 27412 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:16.975759 27470 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:16.984751 27470 raft_consensus.cc:2955] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:16.990105 26657 raft_consensus.cc:2955] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:17.000855 26501 raft_consensus.cc:2955] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:17.003870 26509 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:17.010512 26406 catalog_manager.cc:5697] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:17.013610 26473 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0f9b412be4742fc99eac55c24c89cf8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.016692 26657 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:17.017011 26576 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:17.019850 27469 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:17.020741 27463 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:17.034003 27469 raft_consensus.cc:2955] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:17.035275 26655 raft_consensus.cc:2955] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:17.038100 26576 raft_consensus.cc:2955] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:17.057634 26406 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.294164 27487 ts_tablet_manager.cc:933] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:17.296185 27487 tablet_copy_client.cc:323] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:17.297899 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet b0b9da52e1c04100a4d56d1cfce9e2a2 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:17.298398 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet b0b9da52e1c04100a4d56d1cfce9e2a2 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-b0b9da52e1c04100a4d56d1cfce9e2a2
I20260709 13:09:17.305894 26669 tablet_copy_source_session.cc:215] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:17.308931 27487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b9da52e1c04100a4d56d1cfce9e2a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:17.310377 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08001ea900 after lost signal to thread 25398
W20260709 13:09:17.311434 26439 debug-util.cc:398] Leaking SignalData structure 0x7b0800035e60 after lost signal to thread 26442
W20260709 13:09:17.312574 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08001a21a0 after lost signal to thread 26534
W20260709 13:09:17.313639 26439 debug-util.cc:398] Leaking SignalData structure 0x7b0800312060 after lost signal to thread 26609
W20260709 13:09:17.314649 26439 debug-util.cc:398] Leaking SignalData structure 0x7b0800313a40 after lost signal to thread 26683
W20260709 13:09:17.315694 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080029af40 after lost signal to thread 27302
W20260709 13:09:17.316164 26439 debug-util.cc:398] Leaking SignalData structure 0x7b0800307ee0 after lost signal to thread 27445
I20260709 13:09:17.324721 27487 tablet_copy_client.cc:806] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:17.325333 27487 tablet_copy_client.cc:670] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:17.339838 27487 tablet_copy_client.cc:538] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:17.350099 27487 tablet_bootstrap.cc:492] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:17.358533 27489 ts_tablet_manager.cc:933] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:17.370380 27489 tablet_copy_client.cc:323] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:17.372421 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 81721f0402d24cbfb7f52e0ba164247b from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:17.373070 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 81721f0402d24cbfb7f52e0ba164247b from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-81721f0402d24cbfb7f52e0ba164247b
I20260709 13:09:17.389237 26669 tablet_copy_source_session.cc:215] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:17.393498 27489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81721f0402d24cbfb7f52e0ba164247b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:17.398155 27487 tablet_bootstrap.cc:492] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:17.399875 27487 tablet_bootstrap.cc:492] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:17.400601 27487 ts_tablet_manager.cc:1403] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.013s
I20260709 13:09:17.403895 27487 raft_consensus.cc:359] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:17.404767 27487 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:17.405476 27487 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:17.414793 27489 tablet_copy_client.cc:806] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:17.415499 27489 tablet_copy_client.cc:670] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:17.420356 27489 tablet_copy_client.cc:538] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:17.426878 27487 ts_tablet_manager.cc:1434] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 13:09:17.430721 27493 ts_tablet_manager.cc:933] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:17.432086 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-b0b9da52e1c04100a4d56d1cfce9e2a2 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:17.432544 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-b0b9da52e1c04100a4d56d1cfce9e2a2 on tablet b0b9da52e1c04100a4d56d1cfce9e2a2 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:17.444334 27489 tablet_bootstrap.cc:492] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:17.444732 27493 tablet_copy_client.cc:323] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.194:33025
I20260709 13:09:17.447100 26595 tablet_copy_service.cc:140] P ef2886777a8f45e69e213b02a22ecec7: Received BeginTabletCopySession request for tablet a78e2d37ffa144e9ae8e64979146f436 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39940)
I20260709 13:09:17.447850 26595 tablet_copy_service.cc:161] P ef2886777a8f45e69e213b02a22ecec7: Beginning new tablet copy session on tablet a78e2d37ffa144e9ae8e64979146f436 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39940: session id = b1f40e8672c549d3b4be7862ac07b7e2-a78e2d37ffa144e9ae8e64979146f436
I20260709 13:09:17.480310 27489 tablet_bootstrap.cc:492] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:17.483275 27489 tablet_bootstrap.cc:492] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:17.484048 27489 ts_tablet_manager.cc:1403] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.040s	user 0.027s	sys 0.005s
I20260709 13:09:17.487202 27489 raft_consensus.cc:359] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:17.488559 27489 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:17.489276 27489 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:17.494129 26595 tablet_copy_source_session.cc:215] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:17.496266 27487 ts_tablet_manager.cc:933] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:09:17.497694 27493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78e2d37ffa144e9ae8e64979146f436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:17.498872 27489 ts_tablet_manager.cc:1434] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.004s
I20260709 13:09:17.508793 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-81721f0402d24cbfb7f52e0ba164247b received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:17.509280 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-81721f0402d24cbfb7f52e0ba164247b on tablet 81721f0402d24cbfb7f52e0ba164247b with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:17.525173 27493 tablet_copy_client.cc:806] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:17.526857 27493 tablet_copy_client.cc:670] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:17.529754 27487 tablet_copy_client.cc:323] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:09:17.536119 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet b0f9b412be4742fc99eac55c24c89cf8 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:09:17.536693 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet b0f9b412be4742fc99eac55c24c89cf8 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-b0f9b412be4742fc99eac55c24c89cf8
I20260709 13:09:17.544656 26520 tablet_copy_source_session.cc:215] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:17.553884 27487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f9b412be4742fc99eac55c24c89cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:17.555758 27493 tablet_copy_client.cc:538] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:17.603471 27493 tablet_bootstrap.cc:492] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:17.622239 27487 tablet_copy_client.cc:806] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:17.622972 27487 tablet_copy_client.cc:670] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:17.627014 27487 tablet_copy_client.cc:538] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:17.637522 27487 tablet_bootstrap.cc:492] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:17.673264 27493 tablet_bootstrap.cc:492] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:17.674467 27493 tablet_bootstrap.cc:492] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:17.675889 27493 ts_tablet_manager.cc:1403] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.016s
I20260709 13:09:17.679239 27493 raft_consensus.cc:359] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:17.680228 27493 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:17.681012 27493 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:17.692092 27487 tablet_bootstrap.cc:492] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:17.693137 27487 tablet_bootstrap.cc:492] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:17.694121 27487 ts_tablet_manager.cc:1403] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.010s
I20260709 13:09:17.699564 27493 ts_tablet_manager.cc:1434] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:17.700680 27487 raft_consensus.cc:359] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:17.702136 27487 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:17.702827 27487 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:17.704641 27487 ts_tablet_manager.cc:1434] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:17.706411 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-b0f9b412be4742fc99eac55c24c89cf8 received from {username='slave'} at 127.0.0.1:55308
I20260709 13:09:17.706801 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-b0f9b412be4742fc99eac55c24c89cf8 on tablet b0f9b412be4742fc99eac55c24c89cf8 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:17.718927 26595 tablet_copy_service.cc:342] P ef2886777a8f45e69e213b02a22ecec7: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-a78e2d37ffa144e9ae8e64979146f436 received from {username='slave'} at 127.0.0.1:39940
I20260709 13:09:17.719331 26595 tablet_copy_service.cc:434] P ef2886777a8f45e69e213b02a22ecec7: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-a78e2d37ffa144e9ae8e64979146f436 on tablet a78e2d37ffa144e9ae8e64979146f436 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:17.767089 27277 raft_consensus.cc:1217] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:17.867461 27277 raft_consensus.cc:1217] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:17.981966 27277 raft_consensus.cc:1217] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:18.071463 27277 raft_consensus.cc:1217] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:18.311702 27456 raft_consensus.cc:1064] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:18.313899 27456 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:18.326773 26578 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.328137 27277 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.328521 26509 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.329319 27456 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:18.330731 27415 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:18.331419 27466 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:18.414547 27468 raft_consensus.cc:1064] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:18.417783 27468 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:18.424136 27456 raft_consensus.cc:2955] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.458029 27397 raft_consensus.cc:1064] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:18.464534 26578 raft_consensus.cc:2955] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.460772 27397 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:18.472889 26580 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:09:18.476470 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 43544.3us
I20260709 13:09:18.478529 27277 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.481880 26501 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.484563 27507 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:18.484086 26501 raft_consensus.cc:2955] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.501276 26408 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.505393 27277 raft_consensus.cc:2955] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.530952 27510 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:18.548259 27508 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:18.572177 27278 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.574218 27463 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:18.605811 26576 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.609318 27469 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:18.623371 27499 raft_consensus.cc:1064] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:18.626451 27499 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:18.631654 27415 raft_consensus.cc:2955] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.635766 27469 raft_consensus.cc:2955] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.643404 27276 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.644585 26655 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.646271 26577 raft_consensus.cc:2955] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.646996 27470 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:18.650089 27470 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:18.660200 27277 raft_consensus.cc:2955] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.666500 26501 raft_consensus.cc:2955] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.668238 26506 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.670667 27278 raft_consensus.cc:2955] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.684175 27470 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:18.709235 26659 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:18.732313 27500 raft_consensus.cc:2955] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.734053 26509 raft_consensus.cc:2955] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.739097 27463 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:18.740309 26576 raft_consensus.cc:2955] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.752811 26403 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.742820 27276 raft_consensus.cc:2955] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.754722 26403 catalog_manager.cc:5697] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.790149 26657 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:18.807639 26651 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:18.768709 26655 raft_consensus.cc:2955] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.813443 27276 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:18.817166 26405 catalog_manager.cc:5697] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.825186 26576 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:18.827529 27519 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:18.828532 27276 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:18.829581 27518 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:18.830075 26659 raft_consensus.cc:2955] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.830961 26509 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:18.836431 27518 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:18.842597 27510 raft_consensus.cc:2955] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.846776 26580 raft_consensus.cc:2955] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.849489 27277 raft_consensus.cc:2955] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.842763 27519 raft_consensus.cc:2955] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.857123 27276 raft_consensus.cc:2955] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.869592 27456 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:18.882241 26578 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:18.886370 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 81721f0402d24cbfb7f52e0ba164247b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:18.893672 26509 raft_consensus.cc:2955] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.899184 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b0b9da52e1c04100a4d56d1cfce9e2a2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:18.900063 26401 catalog_manager.cc:5697] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.906795 26502 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:18.907727 27276 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:18.917115 26401 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.918895 27499 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:18.938992 27470 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:18.945354 27499 raft_consensus.cc:2955] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:18.947361 27276 raft_consensus.cc:2955] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:19.000748 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 207771us
I20260709 13:09:19.006182 26395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a78e2d37ffa144e9ae8e64979146f436 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:19.044795 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet 81721f0402d24cbfb7f52e0ba164247b with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:19.054034 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet b0b9da52e1c04100a4d56d1cfce9e2a2 with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:19.083923 27534 tablet_replica.cc:333] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:19.088263 27534 raft_consensus.cc:2243] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.111114 27535 tablet_replica.cc:333] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
W20260709 13:09:19.112056 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 80938.5us
I20260709 13:09:19.126822 26401 catalog_manager.cc:5697] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:19.143146 26502 raft_consensus.cc:2955] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:19.145854 27534 raft_consensus.cc:2272] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.181129 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet a78e2d37ffa144e9ae8e64979146f436 with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:19.187703 27534 ts_tablet_manager.cc:1916] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:09:19.231249 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 69914.9us
I20260709 13:09:19.246945 27534 ts_tablet_manager.cc:1929] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:19.247767 27534 log.cc:1199] T b0b9da52e1c04100a4d56d1cfce9e2a2 P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/b0b9da52e1c04100a4d56d1cfce9e2a2
I20260709 13:09:19.265017 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet b0b9da52e1c04100a4d56d1cfce9e2a2 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:19.301259 27540 tablet_replica.cc:333] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:09:19.305948 27535 raft_consensus.cc:2243] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.307060 27535 raft_consensus.cc:2272] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.312795 27535 ts_tablet_manager.cc:1916] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:19.349447 27540 raft_consensus.cc:2243] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.350651 27540 raft_consensus.cc:2272] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.355268 27535 ts_tablet_manager.cc:1929] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:19.355927 27535 log.cc:1199] T 81721f0402d24cbfb7f52e0ba164247b P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/81721f0402d24cbfb7f52e0ba164247b
I20260709 13:09:19.356040 27540 ts_tablet_manager.cc:1916] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:19.364877 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet 81721f0402d24cbfb7f52e0ba164247b (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:19.371097 26501 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:19.382162 26655 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:19.384754 27276 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:19.386938 27536 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:19.393353 27536 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:19.402704 27397 raft_consensus.cc:2955] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:19.406870 27540 ts_tablet_manager.cc:1929] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:19.407569 27540 log.cc:1199] T a78e2d37ffa144e9ae8e64979146f436 P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/a78e2d37ffa144e9ae8e64979146f436
I20260709 13:09:19.407075 27277 raft_consensus.cc:2955] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:19.409265 26655 raft_consensus.cc:2955] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:19.417232 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet a78e2d37ffa144e9ae8e64979146f436 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:19.440433 26401 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:19.446550 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b0f9b412be4742fc99eac55c24c89cf8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:19.488463 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet b0f9b412be4742fc99eac55c24c89cf8 with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:19.489449 27534 tablet_replica.cc:333] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:19.490573 27534 raft_consensus.cc:2243] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.491526 27534 raft_consensus.cc:2272] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.498449 27534 ts_tablet_manager.cc:1916] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:19.527781 27534 ts_tablet_manager.cc:1929] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:19.528369 27534 log.cc:1199] T b0f9b412be4742fc99eac55c24c89cf8 P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/b0f9b412be4742fc99eac55c24c89cf8
I20260709 13:09:19.530413 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet b0f9b412be4742fc99eac55c24c89cf8 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:20.617002 26655 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:20.634590 26502 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:20.636385 26622 consensus_peers.cc:597] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b5c3addfbab45deb9fc008aee1b7ea5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.636152 26585 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:20.637414 27468 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:20.638732 27520 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:20.652922 27468 raft_consensus.cc:2955] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:20.664220 26502 raft_consensus.cc:2955] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:20.679111 26585 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:20.684795 26576 raft_consensus.cc:2955] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:20.732244 26401 catalog_manager.cc:5697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.760541 26509 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:20.760738 26548 consensus_peers.cc:597] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ce4b86f29b4456dba024f24f29091e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.765208 26659 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:20.767531 27500 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:20.768988 27539 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:20.801482 27500 raft_consensus.cc:2955] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:20.806818 26659 raft_consensus.cc:2955] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:20.815021 26502 raft_consensus.cc:2955] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:20.854534 26659 consensus_queue.cc:237] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:20.900326 26402 catalog_manager.cc:5697] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:20.904667 26576 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:20.909122 27456 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:20.911226 26502 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:20.915334 26622 consensus_peers.cc:597] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffb5488a21bd418b96b52a8ab8a2e669. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.917188 27456 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:20.931746 27554 raft_consensus.cc:2955] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:20.943260 26509 raft_consensus.cc:2955] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:20.958413 26502 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:20.952383 26585 raft_consensus.cc:2955] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:20.970636 26403 catalog_manager.cc:5697] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.048322 26576 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:21.049209 26655 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:21.051011 26473 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93a535a53cf0452f96a49f9aa849777a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.051781 27397 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.053741 27397 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.064566 27536 raft_consensus.cc:2955] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:21.067895 26576 raft_consensus.cc:2955] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:21.072114 26655 raft_consensus.cc:2955] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:21.091655 26402 catalog_manager.cc:5697] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.150619 27561 ts_tablet_manager.cc:933] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:21.152931 27561 tablet_copy_client.cc:323] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:21.154909 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 5b5c3addfbab45deb9fc008aee1b7ea5 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:21.155450 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 5b5c3addfbab45deb9fc008aee1b7ea5 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-5b5c3addfbab45deb9fc008aee1b7ea5
I20260709 13:09:21.162904 26669 tablet_copy_source_session.cc:215] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:21.166908 27561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5c3addfbab45deb9fc008aee1b7ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.208041 27561 tablet_copy_client.cc:806] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:21.208837 27561 tablet_copy_client.cc:670] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:21.234921 27561 tablet_copy_client.cc:538] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:21.249729 27561 tablet_bootstrap.cc:492] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:21.316138 27564 ts_tablet_manager.cc:933] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:21.334903 27561 tablet_bootstrap.cc:492] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:21.338584 27561 tablet_bootstrap.cc:492] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:21.339922 27561 ts_tablet_manager.cc:1403] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.090s	user 0.025s	sys 0.031s
I20260709 13:09:21.349340 27566 ts_tablet_manager.cc:933] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:21.352188 27561 raft_consensus.cc:359] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:21.355350 27561 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:21.356249 27561 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:21.436026 27564 tablet_copy_client.cc:323] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.194:33025
W20260709 13:09:21.501120 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 81725.8us
I20260709 13:09:21.512075 27566 tablet_copy_client.cc:323] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:21.514065 27561 ts_tablet_manager.cc:1434] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.174s	user 0.011s	sys 0.033s
W20260709 13:09:22.260380 27561 ts_tablet_manager.cc:1467] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Tablet startup took 920ms
W20260709 13:09:22.192802 26473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.007s
W20260709 13:09:22.262207 26473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.000s	sys 0.007s
W20260709 13:09:22.260671 27561 ts_tablet_manager.cc:1469] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Trace:
0709 13:09:21.135672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.135840 (+   168us) service_pool.cc:224] Handling call
0709 13:09:21.150956 (+ 15116us) ts_tablet_manager.cc:934] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
0709 13:09:21.165285 (+ 14329us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:21.179462 (+ 14177us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:21.179599 (+   137us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:21.206901 (+ 27302us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:21.207217 (+   316us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:21.207539 (+   322us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:21.207610 (+    71us) inbound_call.cc:177] Queueing success response
0709 13:09:21.249295 (+ 41685us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:09:21.340517 (+ 91222us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:09:21.341229 (+   712us) tablet_replica.cc:261] Starting instrumentation
0709 13:09:21.347349 (+  6120us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":276,"raft.queue_time_us":147028,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":151,"tablet-copy.queue_time_us":13986,"tablet-download-pool.queue_time_us":187,"tablet-download-pool.run_cpu_time_us":1355,"tablet-download-pool.run_wall_time_us":11688,"thread_start_us":169192,"threads_started":3}
I20260709 13:09:22.347250 27569 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:22.347771 27569 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:22.350358 27569 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:22.356056 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:22.351953 27578 ts_tablet_manager.cc:933] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
W20260709 13:09:22.357327 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 56421.1us
I20260709 13:09:22.435525 27578 tablet_copy_client.cc:323] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:09:22.420153 27580 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:22.446058 27580 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:22.450242 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:22.453176 27587 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:22.454077 27587 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:22.467303 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet ffb5488a21bd418b96b52a8ab8a2e669 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:22.468127 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet ffb5488a21bd418b96b52a8ab8a2e669 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-ffb5488a21bd418b96b52a8ab8a2e669
I20260709 13:09:22.488063 27589 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:22.488806 27589 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:22.491230 27587 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:22.499897 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:22.494367 27580 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:22.502208 26668 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-5b5c3addfbab45deb9fc008aee1b7ea5 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:22.502835 26668 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-5b5c3addfbab45deb9fc008aee1b7ea5 on tablet 5b5c3addfbab45deb9fc008aee1b7ea5 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:22.506301 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet 93a535a53cf0452f96a49f9aa849777a from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:09:22.506906 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet 93a535a53cf0452f96a49f9aa849777a from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-93a535a53cf0452f96a49f9aa849777a
I20260709 13:09:22.508455 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:22.509092 26580 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:22.510501 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:22.513653 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:22.500471 26669 tablet_copy_source_session.cc:215] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:22.516265 27589 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:22.520633 26520 tablet_copy_source_session.cc:215] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:22.530294 27578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a535a53cf0452f96a49f9aa849777a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.538352 26595 tablet_copy_service.cc:140] P ef2886777a8f45e69e213b02a22ecec7: Received BeginTabletCopySession request for tablet 5ce4b86f29b4456dba024f24f29091e4 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39940)
I20260709 13:09:22.539009 26595 tablet_copy_service.cc:161] P ef2886777a8f45e69e213b02a22ecec7: Beginning new tablet copy session on tablet 5ce4b86f29b4456dba024f24f29091e4 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39940: session id = b1f40e8672c549d3b4be7862ac07b7e2-5ce4b86f29b4456dba024f24f29091e4
I20260709 13:09:22.559754 27566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffb5488a21bd418b96b52a8ab8a2e669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.560093 27276 raft_consensus.cc:1217] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:09:22.565725 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 76596.4us
I20260709 13:09:22.569365 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:22.576340 26595 tablet_copy_source_session.cc:215] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:09:22.617151 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 64567.5us
I20260709 13:09:22.619782 26549 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:22.621987 27564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce4b86f29b4456dba024f24f29091e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.623322 26549 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:22.628151 27566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46398 (request call id 160) took 1300 ms. Trace:
I20260709 13:09:22.628644 27566 rpcz_store.cc:276] 0709 13:09:21.328078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.328229 (+   151us) service_pool.cc:224] Handling call
0709 13:09:21.352762 (+ 24533us) ts_tablet_manager.cc:934] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
0709 13:09:22.549232 (+1196470us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:22.613708 (+ 64476us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:22.613815 (+   107us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:22.627434 (+ 13619us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:22.627705 (+   271us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:22.628016 (+   311us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:22.628068 (+    52us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":470,"tablet-copy.queue_time_us":20405,"thread_start_us":179029,"threads_started":2}
I20260709 13:09:22.630053 27566 tablet_copy_client.cc:806] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:22.630239 27597 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.630584 27566 tablet_copy_client.cc:670] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:22.631553 27598 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.641517 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:22.641677 26476 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:22.643476 27397 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.643884 27397 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:22.644261 27397 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.652653 27578 tablet_copy_client.cc:806] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:22.653513 27578 tablet_copy_client.cc:670] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:22.661773 26549 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:22.662684 27598 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.673938 27578 tablet_copy_client.cc:538] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:22.676962 27564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:34964 (request call id 37) took 1408 ms. Trace:
I20260709 13:09:22.687314 27397 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:22.677469 27564 rpcz_store.cc:276] 0709 13:09:21.268811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.269292 (+   481us) service_pool.cc:224] Handling call
0709 13:09:21.316806 (+ 47514us) ts_tablet_manager.cc:934] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
0709 13:09:22.620782 (+1303976us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:22.636734 (+ 15952us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:22.636847 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:22.676227 (+ 39380us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:22.676533 (+   306us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:22.676833 (+   300us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:22.676898 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":324,"tablet-copy.queue_time_us":46187,"thread_start_us":165232,"threads_started":2}
I20260709 13:09:22.694334 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:22.695446 27564 tablet_copy_client.cc:806] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:22.695326 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:22.696914 27564 tablet_copy_client.cc:670] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:22.690040 27566 tablet_copy_client.cc:538] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:22.702157 26476 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:22.703325 27582 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.703555 27397 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:22.709689 27564 tablet_copy_client.cc:538] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:22.712182 27578 tablet_bootstrap.cc:492] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:22.732712 27564 tablet_bootstrap.cc:492] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:22.745970 27566 tablet_bootstrap.cc:492] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:22.788146 26501 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:22.811247 27574 raft_consensus.cc:1064] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:22.814603 27574 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:22.858464 27570 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:22.859875 27576 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:22.860571 27576 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:22.861707 27576 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:22.863983 27576 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.937336 27397 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:22.937983 27397 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:22.940127 27397 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:22.941959 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:22.942986 27564 tablet_bootstrap.cc:492] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.950104 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:22.951483 26474 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:22.953145 27397 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.987361 27397 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:22.988044 27397 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:22.992064 27397 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:22.999773 26581 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.001885 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:23.024555 27277 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.025105 27584 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:23.025871 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:23.031526 26506 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.044835 27584 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:09:23.045017 26476 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:23.082652 27397 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.044744 27564 tablet_bootstrap.cc:492] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
W20260709 13:09:23.170555 27604 log.cc:927] Time spent T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.082s	user 0.002s	sys 0.004s
I20260709 13:09:23.182094 27564 ts_tablet_manager.cc:1403] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.450s	user 0.024s	sys 0.014s
W20260709 13:09:23.183727 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 104790us
I20260709 13:09:23.184898 27566 tablet_bootstrap.cc:492] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:23.182258 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 139342us
W20260709 13:09:23.197554 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 112979us
I20260709 13:09:23.209460 27595 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:23.185416 27564 raft_consensus.cc:359] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:23.227347 27564 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:23.228166 27564 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:23.230681 27566 tablet_bootstrap.cc:492] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:23.252656 27564 ts_tablet_manager.cc:1434] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.001s
I20260709 13:09:23.262296 27566 ts_tablet_manager.cc:1403] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.517s	user 0.031s	sys 0.028s
I20260709 13:09:23.265595 27592 raft_consensus.cc:2955] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.269212 27277 raft_consensus.cc:2955] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.294118 26403 catalog_manager.cc:5697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.299204 26595 tablet_copy_service.cc:342] P ef2886777a8f45e69e213b02a22ecec7: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-5ce4b86f29b4456dba024f24f29091e4 received from {username='slave'} at 127.0.0.1:39940
I20260709 13:09:23.299702 26595 tablet_copy_service.cc:434] P ef2886777a8f45e69e213b02a22ecec7: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-5ce4b86f29b4456dba024f24f29091e4 on tablet 5ce4b86f29b4456dba024f24f29091e4 with peer b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:09:23.301771 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08001acd80 after lost signal to thread 25398
W20260709 13:09:23.303071 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08001dac40 after lost signal to thread 26442
W20260709 13:09:23.304435 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800336060 after lost signal to thread 26534
W20260709 13:09:23.306077 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9180 after lost signal to thread 26609
W20260709 13:09:23.307382 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002513e0 after lost signal to thread 26683
W20260709 13:09:23.308704 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800315e20 after lost signal to thread 27302
I20260709 13:09:23.288514 27566 raft_consensus.cc:359] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:23.322093 27566 raft_consensus.cc:740] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:23.306334 26581 raft_consensus.cc:2955] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.326660 27566 consensus_queue.cc:260] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:23.330796 27566 ts_tablet_manager.cc:1434] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.002s
I20260709 13:09:23.331686 26509 raft_consensus.cc:2955] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.350715 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-ffb5488a21bd418b96b52a8ab8a2e669 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:23.351207 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-ffb5488a21bd418b96b52a8ab8a2e669 on tablet ffb5488a21bd418b96b52a8ab8a2e669 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:23.323624 27578 tablet_bootstrap.cc:492] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:23.355597 27578 tablet_bootstrap.cc:492] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:23.356374 27578 ts_tablet_manager.cc:1403] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.644s	user 0.033s	sys 0.001s
I20260709 13:09:23.372829 27578 raft_consensus.cc:359] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:23.374135 27578 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:23.382663 27277 raft_consensus.cc:1217] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:23.374845 27578 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:23.396945 27578 ts_tablet_manager.cc:1434] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:09:23.399201 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-93a535a53cf0452f96a49f9aa849777a received from {username='slave'} at 127.0.0.1:55308
I20260709 13:09:23.399698 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-93a535a53cf0452f96a49f9aa849777a on tablet 93a535a53cf0452f96a49f9aa849777a with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:23.444545 26657 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:23.459923 27277 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:23.471668 27595 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:23.482895 26576 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:23.495501 27592 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:23.502372 27575 raft_consensus.cc:2955] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.537592 26580 raft_consensus.cc:2955] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.516165 27277 raft_consensus.cc:2955] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.588721 27275 raft_consensus.cc:1217] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:23.591650 26402 catalog_manager.cc:5697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.615839 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b5c3addfbab45deb9fc008aee1b7ea5 with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:23.648587 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b5c3addfbab45deb9fc008aee1b7ea5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:23.739262 27615 tablet_replica.cc:333] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:09:23.740615 27615 raft_consensus.cc:2243] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.767789 27615 raft_consensus.cc:2272] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.794413 27595 raft_consensus.cc:1064] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:23.798785 27595 consensus_queue.cc:237] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:23.802557 27615 ts_tablet_manager.cc:1916] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:23.832024 27277 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.836229 26580 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.836104 27586 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:23.839207 27575 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:23.853236 26501 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.855484 27595 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:23.874334 27586 raft_consensus.cc:2955] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.877821 27275 raft_consensus.cc:1217] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:23.880162 26501 raft_consensus.cc:2955] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.872524 27615 ts_tablet_manager.cc:1929] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:23.899246 27615 log.cc:1199] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/5b5c3addfbab45deb9fc008aee1b7ea5
I20260709 13:09:23.908068 26580 raft_consensus.cc:2955] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.920275 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet 5b5c3addfbab45deb9fc008aee1b7ea5 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:23.893916 27275 raft_consensus.cc:2955] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.927618 26401 catalog_manager.cc:5697] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.954190 26652 consensus_queue.cc:237] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:23.974620 27277 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:23.976047 27575 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:23.977479 26501 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:23.979104 27595 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:23.982982 27575 raft_consensus.cc:2955] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.989658 26501 raft_consensus.cc:2955] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:23.997172 27277 raft_consensus.cc:2955] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.023293 26402 catalog_manager.cc:5697] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.030867 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ffb5488a21bd418b96b52a8ab8a2e669 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:24.064234 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet ffb5488a21bd418b96b52a8ab8a2e669 with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:24.072186 27596 raft_consensus.cc:1064] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:24.099221 27620 tablet_replica.cc:333] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:24.102615 27596 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:24.106328 27620 raft_consensus.cc:2243] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:24.107597 27620 raft_consensus.cc:2272] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:24.117830 27620 ts_tablet_manager.cc:1916] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:24.128739 27277 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:24.130566 27585 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:24.136103 26657 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:24.139176 27599 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.149628 26506 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:24.153491 27585 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.153623 27620 ts_tablet_manager.cc:1929] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:24.154470 27620 log.cc:1199] T ffb5488a21bd418b96b52a8ab8a2e669 P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/ffb5488a21bd418b96b52a8ab8a2e669
I20260709 13:09:24.161098 27599 raft_consensus.cc:2955] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.162140 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet ffb5488a21bd418b96b52a8ab8a2e669 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:24.172124 26652 raft_consensus.cc:2955] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.175248 26506 raft_consensus.cc:2955] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.206372 27277 raft_consensus.cc:2955] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.212527 26402 catalog_manager.cc:5697] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.244169 26582 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:24.266212 26501 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:24.267711 27599 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:24.268273 27580 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:24.268594 27599 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:24.270699 27599 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:24.273487 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:24.274327 26652 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:24.276197 26549 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:24.281704 27585 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:24.282238 27585 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:24.273653 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:24.282666 27585 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.283166 26501 raft_consensus.cc:2393] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 2: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:24.291965 27277 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:24.298552 27599 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:24.299274 27585 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:24.300974 27596 raft_consensus.cc:2955] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.303323 26506 raft_consensus.cc:2955] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.310292 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:24.310570 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:24.311393 26501 raft_consensus.cc:2393] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 2: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:24.313119 27277 raft_consensus.cc:2955] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.319308 26395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ce4b86f29b4456dba024f24f29091e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:24.321197 26657 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:24.326217 26549 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:24.327165 27580 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.327654 27580 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:24.328598 27580 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:24.334470 26403 catalog_manager.cc:5697] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.321841 27585 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:24.384133 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce4b86f29b4456dba024f24f29091e4 with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:24.398530 26401 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.421051 27626 tablet_replica.cc:333] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:09:24.428617 27572 raft_consensus.cc:1064] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:24.431162 27572 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:24.518787 27626 raft_consensus.cc:2243] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:24.519547 27626 raft_consensus.cc:2272] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:24.520498 27275 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:24.522234 27397 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.523303 27626 ts_tablet_manager.cc:1916] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:24.526244 27397 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.526732 27397 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:24.530668 27397 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:24.529534 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:24.533908 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:24.534657 26652 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:24.537614 26474 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:24.538666 27397 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:24.539040 27397 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.539561 27397 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.550305 26652 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:24.551368 26582 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:24.552887 27572 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.553714 27577 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.555099 27397 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:24.558180 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:24.563737 27397 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:24.564481 27626 ts_tablet_manager.cc:1929] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:24.565372 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:24.567571 26657 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.573735 27626 log.cc:1199] T 5ce4b86f29b4456dba024f24f29091e4 P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/5ce4b86f29b4456dba024f24f29091e4
I20260709 13:09:24.575819 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 5ce4b86f29b4456dba024f24f29091e4 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:24.587978 27577 raft_consensus.cc:2955] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.606827 26652 raft_consensus.cc:2955] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.616976 26581 raft_consensus.cc:2955] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.641084 26657 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:24.643960 26474 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:24.645069 27572 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:24.646304 27572 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:24.647382 27572 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:24.660729 27275 raft_consensus.cc:2955] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.683728 26401 catalog_manager.cc:5697] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.708505 26401 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 3, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.740227 26506 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:24.754544 26581 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:24.754979 27275 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:24.755954 27572 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:24.763178 27631 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:24.780427 27577 raft_consensus.cc:2955] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.792841 26581 raft_consensus.cc:2955] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.798951 27277 raft_consensus.cc:2955] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.826385 26403 catalog_manager.cc:5697] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:24.832103 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 93a535a53cf0452f96a49f9aa849777a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:24.841141 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 93a535a53cf0452f96a49f9aa849777a with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:24.842411 27626 tablet_replica.cc:333] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:09:24.843528 27626 raft_consensus.cc:2243] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:24.844391 27626 raft_consensus.cc:2272] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:24.847909 27626 ts_tablet_manager.cc:1916] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:24.865263 27626 ts_tablet_manager.cc:1929] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:24.865769 27626 log.cc:1199] T 93a535a53cf0452f96a49f9aa849777a P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/93a535a53cf0452f96a49f9aa849777a
I20260709 13:09:24.867884 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 93a535a53cf0452f96a49f9aa849777a (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:24.932157 26506 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:24.935614 26657 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:24.938485 27599 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:24.941308 27599 consensus_queue.cc:1243] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:24.941795 27580 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:24.944651 27585 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:24.945031 27585 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:24.946020 27585 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:24.948413 27585 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.103075 26582 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:09:25.103507 26582 pending_rounds.cc:85] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 1
I20260709 13:09:25.103830 26582 pending_rounds.cc:107] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:25.104112 26582 raft_consensus.cc:2889] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:25.105350 27631 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.118232 26652 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:25.123582 27397 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.940007 26581 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
W20260709 13:09:25.946640 26548 consensus_peers.cc:597] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa6a5d55926746d28b7b8b8862f40c10. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.947242 26657 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:25.948498 26501 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:25.948746 27585 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.949924 27634 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.957471 27634 raft_consensus.cc:2955] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:25.962903 26657 raft_consensus.cc:2955] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:25.970762 26501 raft_consensus.cc:2955] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:25.993976 26501 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:25.996680 26403 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
W20260709 13:09:26.000735 26473 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 203b3a179cc240e6ac8beb1d95728111. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:26.002223 26657 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:26.003696 27397 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:26.011163 27577 raft_consensus.cc:2955] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:26.028775 26582 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:26.026048 26652 raft_consensus.cc:2955] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:26.037137 27631 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:26.053259 26501 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:26.053296 26581 raft_consensus.cc:2955] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
W20260709 13:09:26.087647 26473 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b1aac0e4d18474e899d9c60448999fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:26.087860 26652 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:26.089650 27577 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:26.090652 26581 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:26.092020 27577 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:26.107551 27397 raft_consensus.cc:2955] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:26.110594 26657 raft_consensus.cc:2955] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:26.126494 26403 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.142588 26582 raft_consensus.cc:2955] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:26.149219 26657 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:26.154970 26401 catalog_manager.cc:5697] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
W20260709 13:09:26.188566 26622 consensus_peers.cc:597] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fcf073468e44507a058097dedeaa5df. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:26.191525 26501 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:26.193329 27595 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:26.195108 26582 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:26.196498 27576 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:26.279439 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 55592us
I20260709 13:09:26.292352 27639 raft_consensus.cc:2955] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:26.304462 26501 raft_consensus.cc:2955] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:26.306797 26580 raft_consensus.cc:2955] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:26.335362 26402 catalog_manager.cc:5697] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:26.364646 27654 ts_tablet_manager.cc:933] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:26.369756 27654 tablet_copy_client.cc:323] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.194:33025
I20260709 13:09:26.374543 26595 tablet_copy_service.cc:140] P ef2886777a8f45e69e213b02a22ecec7: Received BeginTabletCopySession request for tablet fa6a5d55926746d28b7b8b8862f40c10 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39940)
I20260709 13:09:26.375088 26595 tablet_copy_service.cc:161] P ef2886777a8f45e69e213b02a22ecec7: Beginning new tablet copy session on tablet fa6a5d55926746d28b7b8b8862f40c10 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39940: session id = b1f40e8672c549d3b4be7862ac07b7e2-fa6a5d55926746d28b7b8b8862f40c10
I20260709 13:09:26.385730 26595 tablet_copy_source_session.cc:215] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:26.396878 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6a5d55926746d28b7b8b8862f40c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.417111 27654 tablet_copy_client.cc:806] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:26.417801 27654 tablet_copy_client.cc:670] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:26.422396 27654 tablet_copy_client.cc:538] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:26.436269 27654 tablet_bootstrap.cc:492] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:26.451327 27656 ts_tablet_manager.cc:933] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:09:26.460453 27656 tablet_copy_client.cc:323] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:09:26.462944 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet 203b3a179cc240e6ac8beb1d95728111 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:09:26.463493 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet 203b3a179cc240e6ac8beb1d95728111 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-203b3a179cc240e6ac8beb1d95728111
I20260709 13:09:26.471136 26520 tablet_copy_source_session.cc:215] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:26.475661 27656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203b3a179cc240e6ac8beb1d95728111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.489535 27654 tablet_bootstrap.cc:492] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.490648 27654 tablet_bootstrap.cc:492] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:26.491446 27654 ts_tablet_manager.cc:1403] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.005s
I20260709 13:09:26.494555 27654 raft_consensus.cc:359] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:26.495471 27654 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:26.497069 27654 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:26.502357 27656 tablet_copy_client.cc:806] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:26.503000 27656 tablet_copy_client.cc:670] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:26.508541 27656 tablet_copy_client.cc:538] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:26.511149 27654 ts_tablet_manager.cc:1434] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:09:26.515324 26595 tablet_copy_service.cc:342] P ef2886777a8f45e69e213b02a22ecec7: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-fa6a5d55926746d28b7b8b8862f40c10 received from {username='slave'} at 127.0.0.1:39940
I20260709 13:09:26.515802 26595 tablet_copy_service.cc:434] P ef2886777a8f45e69e213b02a22ecec7: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-fa6a5d55926746d28b7b8b8862f40c10 on tablet fa6a5d55926746d28b7b8b8862f40c10 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:26.520890 27656 tablet_bootstrap.cc:492] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:26.558893 27656 tablet_bootstrap.cc:492] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.561951 27656 tablet_bootstrap.cc:492] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:26.562704 27656 ts_tablet_manager.cc:1403] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.042s	user 0.028s	sys 0.001s
I20260709 13:09:26.575780 27656 raft_consensus.cc:359] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:26.576632 27656 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:26.577317 27656 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:26.583024 27656 ts_tablet_manager.cc:1434] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:26.584703 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-203b3a179cc240e6ac8beb1d95728111 received from {username='slave'} at 127.0.0.1:55308
I20260709 13:09:26.585210 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-203b3a179cc240e6ac8beb1d95728111 on tablet 203b3a179cc240e6ac8beb1d95728111 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:26.636044 27656 ts_tablet_manager.cc:933] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:09:26.639673 27656 tablet_copy_client.cc:323] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:09:26.641371 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet 9b1aac0e4d18474e899d9c60448999fc from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:09:26.641978 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet 9b1aac0e4d18474e899d9c60448999fc from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-9b1aac0e4d18474e899d9c60448999fc
I20260709 13:09:26.650194 27654 ts_tablet_manager.cc:933] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:26.653887 26520 tablet_copy_source_session.cc:215] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:26.664731 27656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b1aac0e4d18474e899d9c60448999fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.675590 27654 tablet_copy_client.cc:323] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:26.677753 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 1fcf073468e44507a058097dedeaa5df from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:26.678365 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 1fcf073468e44507a058097dedeaa5df from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-1fcf073468e44507a058097dedeaa5df
I20260709 13:09:26.690835 27656 tablet_copy_client.cc:806] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:26.692715 27656 tablet_copy_client.cc:670] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:26.696871 27656 tablet_copy_client.cc:538] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:26.708837 27656 tablet_bootstrap.cc:492] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:26.847656 27277 raft_consensus.cc:1217] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:09:26.864534 26669 tablet_copy_source_session.cc:215] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:26.868446 27654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcf073468e44507a058097dedeaa5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.959486 27277 raft_consensus.cc:1217] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:09:27.041107 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 60803.7us
W20260709 13:09:27.051529 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 79967.6us
W20260709 13:09:27.117249 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 49555.5us
I20260709 13:09:27.139153 27656 tablet_bootstrap.cc:492] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.140206 27656 tablet_bootstrap.cc:492] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:27.140970 27656 ts_tablet_manager.cc:1403] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.432s	user 0.149s	sys 0.210s
I20260709 13:09:27.145803 27656 raft_consensus.cc:359] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:27.146858 27656 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:27.147593 27656 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:27.150192 27656 ts_tablet_manager.cc:1434] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:09:27.179924 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-9b1aac0e4d18474e899d9c60448999fc received from {username='slave'} at 127.0.0.1:55308
I20260709 13:09:27.180471 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-9b1aac0e4d18474e899d9c60448999fc on tablet 9b1aac0e4d18474e899d9c60448999fc with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:27.193845 27654 tablet_copy_client.cc:806] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:27.196614 27654 tablet_copy_client.cc:670] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
W20260709 13:09:27.211352 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 48947us
I20260709 13:09:27.279314 27397 raft_consensus.cc:1064] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
W20260709 13:09:27.281462 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 115690us
I20260709 13:09:27.282109 27397 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:27.300189 27277 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:27.300468 26659 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:27.302219 27631 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.304193 27631 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.314721 26582 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:27.333115 27577 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:27.364719 27631 raft_consensus.cc:2955] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.375265 27277 raft_consensus.cc:2955] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.395402 26652 raft_consensus.cc:2955] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.403829 26402 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.441439 27654 tablet_copy_client.cc:538] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:27.454494 26580 raft_consensus.cc:2955] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.457175 27654 tablet_bootstrap.cc:492] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:27.483748 26506 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:27.492717 27275 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:27.495136 27577 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:27.504850 27668 raft_consensus.cc:2955] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.513468 27667 raft_consensus.cc:1064] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:27.516752 27667 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:27.519481 27277 raft_consensus.cc:2955] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.527590 26652 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:27.531600 27577 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:27.544667 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 203b3a179cc240e6ac8beb1d95728111 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:27.546082 26401 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.544534 26652 raft_consensus.cc:2955] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.580384 27277 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:27.581161 27654 tablet_bootstrap.cc:492] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.584057 27585 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:27.588549 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet 203b3a179cc240e6ac8beb1d95728111 with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:27.598353 26657 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:27.599922 27585 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.604096 26506 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:27.605585 27585 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.609287 27681 tablet_replica.cc:333] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:27.610663 27681 raft_consensus.cc:2243] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.611476 27681 raft_consensus.cc:2272] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.638792 27654 tablet_bootstrap.cc:492] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:27.653815 27654 ts_tablet_manager.cc:1403] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.197s	user 0.026s	sys 0.008s
I20260709 13:09:27.662983 27654 raft_consensus.cc:359] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:27.663954 27654 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:27.664618 27681 ts_tablet_manager.cc:1916] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:27.664620 27654 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:27.673157 27665 raft_consensus.cc:2955] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.684772 27654 ts_tablet_manager.cc:1434] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:09:27.686977 27275 raft_consensus.cc:1217] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:27.693967 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-1fcf073468e44507a058097dedeaa5df received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:27.694398 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-1fcf073468e44507a058097dedeaa5df on tablet 1fcf073468e44507a058097dedeaa5df with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:27.704875 27275 raft_consensus.cc:2955] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.720798 26659 raft_consensus.cc:2955] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.734790 27277 raft_consensus.cc:1217] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:27.748780 26401 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.777441 26506 raft_consensus.cc:2955] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.780346 26579 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:27.818221 26659 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:27.821094 27665 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:27.830907 27277 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:27.836330 27665 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.843638 27664 raft_consensus.cc:2955] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.854035 26657 raft_consensus.cc:2955] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.897853 27681 ts_tablet_manager.cc:1929] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:09:27.901233 26395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa6a5d55926746d28b7b8b8862f40c10 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:27.911707 27275 raft_consensus.cc:2955] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.917124 26401 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:27.941744 27681 log.cc:1199] T 203b3a179cc240e6ac8beb1d95728111 P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/203b3a179cc240e6ac8beb1d95728111
I20260709 13:09:27.945652 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet 203b3a179cc240e6ac8beb1d95728111 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:27.946359 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet fa6a5d55926746d28b7b8b8862f40c10 with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:28.033715 27685 tablet_replica.cc:333] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:09:28.036334 27685 raft_consensus.cc:2243] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:28.041630 27685 raft_consensus.cc:2272] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:28.049017 27685 ts_tablet_manager.cc:1916] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:28.066221 27685 ts_tablet_manager.cc:1929] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:28.066651 27685 log.cc:1199] T fa6a5d55926746d28b7b8b8862f40c10 P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/fa6a5d55926746d28b7b8b8862f40c10
I20260709 13:09:28.068677 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet fa6a5d55926746d28b7b8b8862f40c10 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:28.156195 27639 raft_consensus.cc:1064] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:28.159082 27639 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:28.198572 27275 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:28.201017 26580 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:28.201676 27669 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:28.203626 26506 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:28.204101 27670 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:28.206265 27639 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:28.240293 27577 raft_consensus.cc:1064] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:28.242662 27577 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:28.268200 27277 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:28.276167 27668 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:28.282928 26580 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:28.286114 26652 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:28.288908 27631 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:28.370213 27691 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:28.378597 27576 raft_consensus.cc:2955] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.388772 27668 raft_consensus.cc:2955] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.399315 27275 raft_consensus.cc:2955] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.403347 26579 raft_consensus.cc:2955] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.414350 26403 catalog_manager.cc:5697] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.431840 26402 catalog_manager.cc:5697] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.434114 26580 raft_consensus.cc:2955] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.440024 26509 raft_consensus.cc:2955] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.475605 27277 raft_consensus.cc:2955] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.520296 26654 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:28.481052 26508 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:28.538170 27278 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:28.547300 27275 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:28.547596 27631 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:28.551100 27669 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:28.554198 26579 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:28.557901 27668 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:28.560252 27691 raft_consensus.cc:2955] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.574420 26579 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:28.576689 26582 raft_consensus.cc:2955] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.580587 27277 raft_consensus.cc:2955] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.601033 27669 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:28.611869 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:28.616093 27695 raft_consensus.cc:2955] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.629352 26582 raft_consensus.cc:2955] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.629818 26405 catalog_manager.cc:5697] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.636379 27276 raft_consensus.cc:2955] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.675531 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b1aac0e4d18474e899d9c60448999fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:28.686468 26402 catalog_manager.cc:5697] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:28.688676 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1fcf073468e44507a058097dedeaa5df with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:28.697904 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b1aac0e4d18474e899d9c60448999fc with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:28.719425 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fcf073468e44507a058097dedeaa5df with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:28.754004 27697 tablet_replica.cc:333] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:09:28.755141 27697 raft_consensus.cc:2243] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:28.755677 27697 pending_rounds.cc:70] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: Trying to abort 1 pending ops.
I20260709 13:09:28.761189 27698 tablet_replica.cc:333] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:09:28.755965 27697 pending_rounds.cc:77] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636119516422144 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "9b1aac0e4d18474e899d9c60448999fc" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } } }
I20260709 13:09:28.762027 27697 raft_consensus.cc:2917] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:09:28.762598 27697 raft_consensus.cc:2889] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:09:28.763028 27697 raft_consensus.cc:2272] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:28.762316 27698 raft_consensus.cc:2243] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:28.769693 27698 raft_consensus.cc:2272] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:28.771612 27697 ts_tablet_manager.cc:1916] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:28.773779 27698 ts_tablet_manager.cc:1916] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:28.791550 27697 ts_tablet_manager.cc:1929] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:28.792116 27697 log.cc:1199] T 9b1aac0e4d18474e899d9c60448999fc P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/9b1aac0e4d18474e899d9c60448999fc
I20260709 13:09:28.795895 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 9b1aac0e4d18474e899d9c60448999fc (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:28.823833 27698 ts_tablet_manager.cc:1929] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:28.824440 27698 log.cc:1199] T 1fcf073468e44507a058097dedeaa5df P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/1fcf073468e44507a058097dedeaa5df
I20260709 13:09:28.826745 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet 1fcf073468e44507a058097dedeaa5df (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:28.848059 26654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:28.848944 26654 raft_consensus.cc:606] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:28.855130 26654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:28.856040 26654 raft_consensus.cc:606] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:28.860479 26654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:28.861037 26654 raft_consensus.cc:606] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:28.864611 26654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:28.865427 26654 raft_consensus.cc:606] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:28.892560 26509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:28.893975 26509 raft_consensus.cc:606] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:28.897176 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:28.897760 26652 raft_consensus.cc:606] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:28.898983 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:28.900712 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:28.951280 27592 raft_consensus.cc:993] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:28.951817 27670 raft_consensus.cc:1081] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:28.953698 27276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:09:28.954309 27276 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.954667 27276 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.960649 27276 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:28.964457 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:28.965062 26580 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.965359 27276 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:28.967518 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:28.970279 26654 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:28.970647 26654 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:28.971493 26654 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:28.972733 26580 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:28.972888 26654 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.974238 27243 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:28.975247 27659 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:28.977869 27659 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:28.978909 27659 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:28.981835 26654 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:28.991395 26405 catalog_manager.cc:5697] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.026021 27592 raft_consensus.cc:993] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:29.026669 27592 raft_consensus.cc:1081] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:29.028121 26580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:29.028621 26580 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.028899 26580 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.034093 26580 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:29.035984 26580 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:29.037027 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:29.037066 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:29.037680 26501 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.038275 26654 raft_consensus.cc:3055] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.038702 26654 raft_consensus.cc:740] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:29.042223 26654 consensus_queue.cc:260] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:29.043516 26654 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.045368 26501 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:29.046842 26548 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:29.047802 27667 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.048292 27667 raft_consensus.cc:697] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:29.049191 27667 consensus_queue.cc:237] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:29.050345 26654 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:29.064817 26405 catalog_manager.cc:5697] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.083370 27592 raft_consensus.cc:993] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:29.083870 27592 raft_consensus.cc:1081] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:29.089393 27276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:09:29.089968 27276 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.090261 27276 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.102303 27694 raft_consensus.cc:993] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:29.102363 27276 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:29.102877 27670 raft_consensus.cc:1081] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:29.104997 27276 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:29.105912 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:29.106710 26654 raft_consensus.cc:3055] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.106671 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:29.107312 27276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:09:29.107383 26654 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:29.107659 26582 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.108134 27276 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.108537 27276 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.108378 26654 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:29.109622 26654 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.117554 26654 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:29.116437 27276 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:29.118877 27241 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:09:29.120112 27659 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.120566 27659 raft_consensus.cc:697] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:29.121392 27659 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:29.123062 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:29.123673 26580 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.125267 27276 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:29.129742 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:29.130398 26654 raft_consensus.cc:3055] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.130739 26654 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:29.131991 26580 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:29.131686 26654 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:29.133108 27243 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:29.134073 27702 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.135190 26582 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:29.135187 26654 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.141418 26405 catalog_manager.cc:5697] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.162086 26654 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:29.164261 27702 raft_consensus.cc:697] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:29.165241 27702 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:29.225116 26405 catalog_manager.cc:5697] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.289748 27576 raft_consensus.cc:993] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:29.293450 27669 raft_consensus.cc:1081] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:29.298882 27276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:09:29.299908 27276 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.300438 27276 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.358266 27276 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:29.364167 27276 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:29.364373 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:29.366150 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:29.367086 26654 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.367430 26654 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:29.368592 26654 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:29.366195 26501 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.379525 26654 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.448290 27708 raft_consensus.cc:993] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:29.449150 27631 raft_consensus.cc:1081] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:29.452126 26509 raft_consensus.cc:1275] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.454428 27667 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:29.476312 26501 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:29.477303 26508 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:29.480139 26579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:09:29.481029 26579 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.481608 26579 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:29.498037 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 44873.5us
I20260709 13:09:29.505080 26581 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:29.480229 26654 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:29.511961 27702 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:29.518647 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:29.525897 27702 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.528038 27702 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:29.529664 27702 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:29.541430 26654 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:29.543102 27707 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:29.543938 26579 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:29.546726 26579 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:29.551857 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:29.552616 26508 raft_consensus.cc:3055] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:29.552923 26508 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:29.553747 26508 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:29.555107 26508 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.565022 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:29.566799 26652 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.575987 26652 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:29.577400 26549 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:29.583014 27665 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:29.583662 27665 raft_consensus.cc:697] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:29.586504 26652 raft_consensus.cc:1275] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:29.588505 27711 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:29.584795 27665 consensus_queue.cc:237] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:29.600611 26401 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.604801 26580 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:29.612775 26508 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:29.614295 26654 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:29.627501 27702 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:29.638715 27707 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:29.631594 26405 catalog_manager.cc:5697] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.660512 26581 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:29.663098 27707 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:29.672724 26657 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:29.674222 27707 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:29.847536 26654 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:29.858865 26580 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:29.861197 27592 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:29.861631 26502 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:29.864971 27592 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:29.866194 26622 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cb26f1d881541f898a5a148f7f74144. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:29.870167 27576 raft_consensus.cc:2955] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:29.873297 26580 raft_consensus.cc:2955] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:29.888572 26502 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:29.894148 26508 raft_consensus.cc:2955] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:29.895560 26405 catalog_manager.cc:5697] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.902058 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:29.912286 26654 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:29.913674 26473 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6daa7e0062a14868b29dc1a9144f41c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:29.914140 27691 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:29.915323 26580 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:29.926744 27691 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:29.944576 27691 raft_consensus.cc:2955] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:29.950553 26581 raft_consensus.cc:2955] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:29.952283 26654 raft_consensus.cc:2955] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:29.975572 26654 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:29.977757 26405 catalog_manager.cc:5697] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.977098 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:30.010839 26501 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:30.010840 26580 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:30.012985 27576 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:30.015928 26622 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f79cbcb2b1924d9c9e584d9a32e92bfa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.023182 27576 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:30.021368 26501 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:30.026623 27711 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:30.039841 27576 raft_consensus.cc:2955] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:30.044010 26502 raft_consensus.cc:2955] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:30.054483 26654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:30.055627 26654 raft_consensus.cc:606] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:30.068126 26657 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:30.071691 27710 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:30.071939 26654 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:30.079550 26579 raft_consensus.cc:2955] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:30.091194 26401 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.096019 26652 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:30.100033 27707 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:30.138561 26508 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:30.140277 27702 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:30.158429 26579 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:30.160671 27694 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:30.173672 26501 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:30.177045 26622 consensus_peers.cc:597] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15ce1ae648ca45aba8c6efb73a35ae9e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.182544 27576 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:30.302713 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 113479us
I20260709 13:09:30.361703 26579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:30.362498 26579 raft_consensus.cc:606] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:30.414774 26657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:30.418128 26657 raft_consensus.cc:606] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:30.454289 27592 raft_consensus.cc:2955] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:30.504433 26659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "731b96cedb5749df893a1de699717183"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:30.505115 26659 raft_consensus.cc:606] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:30.552831 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ecc61d0190444bea318620b6a278926"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:30.556142 26652 raft_consensus.cc:606] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:30.563341 26579 raft_consensus.cc:2955] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:30.613161 26654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:30.613783 26654 raft_consensus.cc:606] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:30.621449 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:30.623581 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:30.625833 27665 raft_consensus.cc:993] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:30.626358 27665 raft_consensus.cc:1081] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:30.639192 27763 ts_tablet_manager.cc:933] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:30.640383 27695 raft_consensus.cc:993] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:30.641073 27695 raft_consensus.cc:1081] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:30.666029 27277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:34964
I20260709 13:09:30.666663 27277 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.667006 27277 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.667560 27760 raft_consensus.cc:993] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:30.668077 27760 raft_consensus.cc:1081] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:30.711642 27766 ts_tablet_manager.cc:933] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:30.721886 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 59283.7us
I20260709 13:09:30.731276 27592 raft_consensus.cc:993] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:30.738365 27576 raft_consensus.cc:1081] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:30.740559 27765 ts_tablet_manager.cc:933] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:09:30.740479 27766 tablet_copy_client.cc:323] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:30.739217 27277 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:30.742401 26401 catalog_manager.cc:5697] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:30.745690 27277 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:30.747259 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 79884.9us
I20260709 13:09:30.765388 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:30.766073 26501 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.734190 27763 tablet_copy_client.cc:323] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:30.774893 26585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "731b96cedb5749df893a1de699717183"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:30.775612 26585 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.776019 26585 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.776250 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:30.776891 26581 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.777194 26581 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:30.778071 26581 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:30.779398 26581 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.786317 26585 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:30.796404 26501 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:30.798406 26508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59084
I20260709 13:09:30.799101 26508 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.799577 26508 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.817006 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:30.818395 26506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59084
I20260709 13:09:30.819101 26506 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.819562 26506 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.820700 26585 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:30.817694 26501 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.825584 27240 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:30.844476 27707 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.845017 27707 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:30.850514 27707 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:30.851146 27762 raft_consensus.cc:993] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:30.851785 27762 raft_consensus.cc:1081] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:30.855413 26508 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:30.860344 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:30.861136 26585 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.865293 26508 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:30.867962 26501 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:30.871613 26581 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:30.876763 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:30.877600 27665 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.878126 27665 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:30.879065 27665 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:30.866166 26506 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
W20260709 13:09:30.883728 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 55179.7us
I20260709 13:09:30.889462 26585 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
W20260709 13:09:30.891216 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 49441us
I20260709 13:09:30.891949 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet f79cbcb2b1924d9c9e584d9a32e92bfa from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:30.892542 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet f79cbcb2b1924d9c9e584d9a32e92bfa from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-f79cbcb2b1924d9c9e584d9a32e92bfa
I20260709 13:09:30.897028 26668 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 6cb26f1d881541f898a5a148f7f74144 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:30.897675 26668 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 6cb26f1d881541f898a5a148f7f74144 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-6cb26f1d881541f898a5a148f7f74144
I20260709 13:09:30.900933 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:30.901676 26659 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.902038 26659 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:30.907831 26501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59084
I20260709 13:09:30.908459 26501 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.908869 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:30.909447 26652 raft_consensus.cc:3055] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.909768 26652 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:30.910511 26652 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:30.911818 26652 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.908883 26501 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.924953 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:30.925495 26581 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.928220 26504 raft_consensus.cc:2955] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:30.922377 26506 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:30.975072 26652 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:30.994238 27785 ts_tablet_manager.cc:933] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:30.963394 26659 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:31.002496 26501 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:31.009519 26669 tablet_copy_source_session.cc:215] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:31.016398 26581 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
W20260709 13:09:31.058295 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.063640 27766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79cbcb2b1924d9c9e584d9a32e92bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.076195 26501 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:31.098367 27694 raft_consensus.cc:993] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
W20260709 13:09:31.082499 27676 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:09:31.102264 27576 raft_consensus.cc:1081] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:31.113000 26403 catalog_manager.cc:5697] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.049353 27765 tablet_copy_client.cc:323] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:09:31.149271 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:31.160377 27278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ecc61d0190444bea318620b6a278926"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:09:31.160993 27278 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.161362 27278 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.163928 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:31.164534 26651 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:31.164860 26651 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:31.165678 26651 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:31.171746 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:31.189045 27785 tablet_copy_client.cc:323] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:31.197501 26659 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.207239 27709 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:31.207265 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet 6daa7e0062a14868b29dc1a9144f41c8 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:09:31.208077 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet 6daa7e0062a14868b29dc1a9144f41c8 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-6daa7e0062a14868b29dc1a9144f41c8
I20260709 13:09:31.214380 27709 raft_consensus.cc:697] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:31.216418 27709 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:31.213032 27278 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:31.223703 26506 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:31.224412 26520 tablet_copy_source_session.cc:215] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:31.226805 27762 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:31.229674 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 15ce1ae648ca45aba8c6efb73a35ae9e from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:31.231333 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 15ce1ae648ca45aba8c6efb73a35ae9e from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-15ce1ae648ca45aba8c6efb73a35ae9e
I20260709 13:09:31.232609 26668 tablet_copy_source_session.cc:215] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:31.264765 27763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb26f1d881541f898a5a148f7f74144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.267444 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:31.268119 26581 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:31.268678 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.272157 26585 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:31.277279 26659 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:31.278144 27278 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:31.309864 26652 raft_consensus.cc:3055] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:31.310307 26652 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:09:31.311062 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 377733us
I20260709 13:09:31.311228 26652 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:31.312867 26652 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.315948 26651 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.318763 26669 tablet_copy_source_session.cc:215] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:31.323055 26651 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:31.324144 26652 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:31.325219 26580 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:31.332875 27694 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:09:31.335656 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:31.336179 26580 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.335047 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:31.343550 26581 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:31.284291 27707 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:09:31.351207 27783 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:31.359297 27765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6daa7e0062a14868b29dc1a9144f41c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.368933 26580 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:31.372054 26651 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.377242 26502 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:31.378748 26476 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:09:31.379434 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 56245.2us
I20260709 13:09:31.379655 27773 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:31.387497 27753 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:31.390954 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:31.391659 26659 raft_consensus.cc:3055] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:31.374137 27783 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:31.392030 26659 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:31.395277 27773 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:31.395596 27243 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:09:31.396452 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 51372.2us
I20260709 13:09:31.395336 27794 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:09:31.396513 27773 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:31.404449 27783 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:31.410166 26659 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:31.418015 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 71732.9us
I20260709 13:09:31.419984 27766 tablet_copy_client.cc:806] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:31.420694 27766 tablet_copy_client.cc:670] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:31.428333 27796 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:31.429122 27796 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:31.430766 27796 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:31.500595 27766 tablet_copy_client.cc:538] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:31.510345 27785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ce1ae648ca45aba8c6efb73a35ae9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.522428 26501 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.524456 27753 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.593824 27763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46398 (request call id 331) took 1169 ms. Trace:
I20260709 13:09:31.594300 27763 rpcz_store.cc:276] 0709 13:09:30.424064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.424252 (+   188us) service_pool.cc:224] Handling call
0709 13:09:30.639597 (+215345us) ts_tablet_manager.cc:934] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
0709 13:09:31.248688 (+609091us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:31.514212 (+265524us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:31.514328 (+   116us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:31.564038 (+ 49710us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:31.564458 (+   420us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:31.589617 (+ 25159us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:31.591385 (+  1768us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":25215,"tablet-copy.queue_time_us":199797,"thread_start_us":221269,"threads_started":2}
I20260709 13:09:31.596644 27763 tablet_copy_client.cc:806] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:31.597280 27763 tablet_copy_client.cc:670] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:31.603507 26659 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.611056 27278 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:31.624879 27766 tablet_bootstrap.cc:492] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:31.625785 26401 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.630050 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:31.656320 26659 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
W20260709 13:09:31.663313 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.709718 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 91517us
I20260709 13:09:31.715122 26502 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:31.707967 27763 tablet_copy_client.cc:538] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:31.736320 26577 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:31.769793 27775 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:09:31.767738 27765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46406 (request call id 168) took 1209 ms. Trace:
I20260709 13:09:31.808871 27765 rpcz_store.cc:276] 0709 13:09:30.558311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.558441 (+   130us) service_pool.cc:224] Handling call
0709 13:09:30.741076 (+182635us) ts_tablet_manager.cc:934] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
0709 13:09:31.340208 (+599132us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:31.505393 (+165185us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:31.505537 (+   144us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:31.697257 (+191720us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:31.722443 (+ 25186us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:31.758629 (+ 36186us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:31.762938 (+  4309us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":154640,"tablet-copy.queue_time_us":174000,"thread_start_us":278308,"threads_started":2}
I20260709 13:09:31.814617 27765 tablet_copy_client.cc:806] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:31.815462 27765 tablet_copy_client.cc:670] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
W20260709 13:09:31.830077 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 75251.6us
I20260709 13:09:31.865146 27765 tablet_copy_client.cc:538] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:31.884547 26405 catalog_manager.cc:5697] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:09:31.901227 26659 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:31.902595 26580 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:31.914402 27792 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:31.919996 26580 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.917758 27796 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:31.925380 27785 tablet_copy_client.cc:806] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
W20260709 13:09:31.932806 26473 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.936307 26659 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:31.953037 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:31.949535 27763 tablet_bootstrap.cc:492] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:31.951591 27785 tablet_copy_client.cc:670] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:32.007761 27783 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
W20260709 13:09:32.040100 26473 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:32.052574 26652 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:31.989133 27775 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:09:32.066578 27785 tablet_copy_client.cc:538] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:32.054435 26405 catalog_manager.cc:5697] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.077958 26405 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.081663 26659 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:32.083725 26405 catalog_manager.cc:5697] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.099279 27759 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:09:32.111605 27778 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:32.150066 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:32.150653 26652 raft_consensus.cc:606] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:32.154457 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:32.155248 26652 raft_consensus.cc:606] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:32.162667 27765 tablet_bootstrap.cc:492] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:32.165297 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:32.166025 26652 raft_consensus.cc:606] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:32.169297 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:32.172870 26579 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:32.205792 26652 raft_consensus.cc:606] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:32.210479 27576 raft_consensus.cc:993] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:32.210973 27576 raft_consensus.cc:1081] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
W20260709 13:09:32.240618 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 59210.2us
I20260709 13:09:32.245676 27759 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:09:32.466845 27785 tablet_bootstrap.cc:492] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:32.497355 26652 raft_consensus.cc:614] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:32.527772 27275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:09:32.528451 27275 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.528831 27275 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.562737 27275 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:32.567227 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 49935.8us
I20260709 13:09:32.579782 27275 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:32.576599 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:32.647451 26577 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:32.647811 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 81358us
I20260709 13:09:32.669142 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:32.669945 26652 raft_consensus.cc:606] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:09:32.658275 27814 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:09:32.694605 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 117048us
I20260709 13:09:32.708371 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:32.709285 26652 raft_consensus.cc:3055] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:32.711279 26652 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:32.705202 27752 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.717213 27766 tablet_bootstrap.cc:492] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:32.734412 26652 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:32.751772 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 99997.3us
W20260709 13:09:32.754334 27823 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:09:32.739866 27752 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:32.762593 27752 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:32.791586 26585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:32.792313 26585 raft_consensus.cc:606] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:32.794854 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:32.819629 26577 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
W20260709 13:09:32.841066 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 181852us
I20260709 13:09:32.850116 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:32.855211 26652 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:32.860299 27833 raft_consensus.cc:993] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:32.861027 27833 raft_consensus.cc:1081] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
W20260709 13:09:32.883795 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 230706us
I20260709 13:09:32.898568 27766 tablet_bootstrap.cc:492] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:32.899420 27766 ts_tablet_manager.cc:1403] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 1.275s	user 0.028s	sys 0.008s
W20260709 13:09:32.905512 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 252779us
I20260709 13:09:32.906558 27243 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:32.933979 26652 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:32.949899 26581 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:32.951550 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 88007.9us
I20260709 13:09:32.992502 26506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59084
I20260709 13:09:32.963083 27794 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:32.993397 26506 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.001713 26506 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.016400 26506 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.031773 26506 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:33.044656 27766 raft_consensus.cc:359] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:33.045719 27766 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:33.046469 27766 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:33.025704 27794 raft_consensus.cc:697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:33.074537 27794 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:33.082795 27695 raft_consensus.cc:993] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:33.089932 27277 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Advancing to term 2
W20260709 13:09:33.094237 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.064617 27766 ts_tablet_manager.cc:1434] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.165s	user 0.006s	sys 0.005s
I20260709 13:09:33.101589 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:33.105645 26659 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:33.106072 26659 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:33.104197 27576 raft_consensus.cc:1081] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:33.114740 26580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:33.115540 26580 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.115990 26580 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.119618 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:33.120232 26659 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.121317 26659 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.137929 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:33.144409 26659 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:33.120222 26579 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.173233 26579 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:33.175130 27763 tablet_bootstrap.cc:492] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:33.176107 27763 tablet_bootstrap.cc:492] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:33.176800 27763 ts_tablet_manager.cc:1403] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 1.228s	user 0.034s	sys 0.033s
W20260709 13:09:33.182310 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 258876us
I20260709 13:09:33.182989 26580 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.194160 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:33.202910 26580 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:33.222385 27775 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:33.232692 27775 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:33.259697 27763 raft_consensus.cc:359] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:33.271944 27276 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:33.269948 27763 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
W20260709 13:09:33.271217 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 82543.1us
I20260709 13:09:33.312652 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-f79cbcb2b1924d9c9e584d9a32e92bfa received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:33.313340 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-f79cbcb2b1924d9c9e584d9a32e92bfa on tablet f79cbcb2b1924d9c9e584d9a32e92bfa with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:33.314944 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:33.319638 27825 raft_consensus.cc:993] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:33.320363 27825 raft_consensus.cc:1081] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:33.329674 27763 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:33.371622 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:33.372313 26659 raft_consensus.cc:3055] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:33.372625 26659 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:33.373281 26659 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.374496 26659 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:33.401021 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 210373us
I20260709 13:09:33.408552 27787 raft_consensus.cc:993] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:33.409132 27787 raft_consensus.cc:1081] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:33.413439 26548 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:33.339697 27775 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.421339 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:33.421895 26502 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.432529 26659 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:33.438230 26502 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:33.441972 27809 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:33.446388 27765 tablet_bootstrap.cc:492] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:33.447372 27765 tablet_bootstrap.cc:492] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:33.448010 27765 ts_tablet_manager.cc:1403] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 1.286s	user 0.030s	sys 0.014s
I20260709 13:09:33.454330 26549 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:33.473608 26653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54888
I20260709 13:09:33.492506 27763 ts_tablet_manager.cc:1434] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.315s	user 0.009s	sys 0.003s
I20260709 13:09:33.480605 27753 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:33.493602 27753 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:33.495102 27785 tablet_bootstrap.cc:492] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:33.496649 27785 tablet_bootstrap.cc:492] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:33.498302 27785 ts_tablet_manager.cc:1403] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 1.032s	user 0.026s	sys 0.012s
I20260709 13:09:33.490721 26403 catalog_manager.cc:5697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.491219 27765 raft_consensus.cc:359] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:33.492746 26653 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.494525 27753 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.513774 26653 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:33.524945 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 51379.9us
I20260709 13:09:33.512769 27765 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:33.527308 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-6cb26f1d881541f898a5a148f7f74144 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:33.533860 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-6cb26f1d881541f898a5a148f7f74144 on tablet 6cb26f1d881541f898a5a148f7f74144 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:33.536126 26503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59084
I20260709 13:09:33.536788 26503 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.537213 26503 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.632654 26503 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.634927 26503 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:33.592945 27765 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:33.644464 27765 ts_tablet_manager.cc:1434] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.196s	user 0.005s	sys 0.005s
I20260709 13:09:33.652233 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:33.652915 26656 raft_consensus.cc:3055] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:33.653245 26656 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:33.654098 26656 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.655404 26656 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.663305 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:33.663982 26577 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.665596 27785 raft_consensus.cc:359] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:33.682999 26653 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.684208 26652 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:33.729425 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:33.730161 26503 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.734916 26653 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:33.666487 27785 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:33.759174 26577 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:33.773650 26580 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:33.768935 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:33.776590 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:33.774998 26581 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:33.779632 26581 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:33.775977 27785 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:33.786325 26503 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:33.787386 26510 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:33.796588 27829 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:33.796628 26653 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:33.794915 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:33.789391 27775 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:33.808624 26581 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.809615 26581 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:33.825963 27829 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:33.826402 27785 ts_tablet_manager.cc:1434] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.327s	user 0.004s	sys 0.008s
I20260709 13:09:33.834467 26581 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
W20260709 13:09:33.838596 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43761us
I20260709 13:09:33.834069 27775 raft_consensus.cc:697] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:33.843700 27775 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.845891 27833 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:33.846625 27833 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:33.847450 27833 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:33.829473 26656 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:33.878757 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-15ce1ae648ca45aba8c6efb73a35ae9e received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:33.881856 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-15ce1ae648ca45aba8c6efb73a35ae9e on tablet 15ce1ae648ca45aba8c6efb73a35ae9e with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:33.914902 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-6daa7e0062a14868b29dc1a9144f41c8 received from {username='slave'} at 127.0.0.1:55308
I20260709 13:09:33.917807 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-6daa7e0062a14868b29dc1a9144f41c8 on tablet 6daa7e0062a14868b29dc1a9144f41c8 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:33.930485 27273 raft_consensus.cc:1217] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:33.932088 27773 raft_consensus.cc:1064] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:33.934649 27773 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:33.941424 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:33.973724 26653 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:33.977134 27709 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:09:34.007814 26577 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.044636 27709 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:34.049811 26652 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:09:34.062881 27876 log.cc:927] Time spent T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:09:34.063000 27273 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:34.055104 27773 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:09:34.075157 27709 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:34.087505 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:34.136376 27276 raft_consensus.cc:1217] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:34.140519 26510 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.146405 26585 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:34.147023 26652 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.154603 27753 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:34.167008 27709 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:09:34.164995 27746 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:09:34.235608 26502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:34.236186 26502 raft_consensus.cc:606] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:34.246287 26585 raft_consensus.cc:2955] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.248216 27775 raft_consensus.cc:2955] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.249948 27273 raft_consensus.cc:2955] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.260771 26401 catalog_manager.cc:5697] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.281876 26502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:34.282573 26502 raft_consensus.cc:606] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:34.285053 26656 raft_consensus.cc:2955] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.290341 26402 catalog_manager.cc:5697] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.293500 26657 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.294194 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:34.294740 26652 raft_consensus.cc:606] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:34.294961 27858 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.298244 26657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:34.298781 26657 raft_consensus.cc:606] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:34.304070 26580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:34.304860 26580 raft_consensus.cc:606] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:34.307050 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:34.311800 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:34.327312 27844 raft_consensus.cc:993] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:34.327836 27844 raft_consensus.cc:1081] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:34.330224 26585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:34.330825 26585 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.331385 26585 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.353281 26580 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.355635 27775 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:34.369151 26407 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.376423 26407 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 2 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.400321 26404 catalog_manager.cc:5697] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.407511 27775 raft_consensus.cc:1064] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:34.415561 27747 raft_consensus.cc:993] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:34.416041 27747 raft_consensus.cc:1081] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:34.417760 26510 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:34.418939 27276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:09:34.419467 27276 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.419767 27276 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.423866 27709 raft_consensus.cc:993] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:34.424484 27709 raft_consensus.cc:1081] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:34.427191 26502 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.433367 27844 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:34.433578 27775 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:34.435668 26656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:34.436429 26656 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.436821 26656 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.446130 27276 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:34.450093 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:34.450693 26579 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.456522 26652 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:34.456959 26585 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:34.459774 27273 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:34.460873 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:34.461433 26510 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.462971 27858 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:34.466918 27778 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:34.469264 27846 raft_consensus.cc:1064] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:34.471426 26585 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:34.473778 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:34.474483 26657 raft_consensus.cc:3055] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:34.478915 26579 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:34.479480 26577 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:34.474817 26657 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:34.486886 27844 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:34.489876 26657 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:34.473027 27846 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:34.518007 26657 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.523566 27243 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:34.473845 26656 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:34.543546 27709 raft_consensus.cc:993] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:34.543654 26510 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:34.547945 27276 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:34.554359 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:34.554996 26652 raft_consensus.cc:3055] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:34.555274 26652 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:34.556041 26652 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:34.557456 26652 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.544314 27709 raft_consensus.cc:1081] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:34.565052 26548 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:34.567519 26652 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:34.567919 26651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:34.568529 26651 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.549933 27824 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.568954 26651 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:34.569348 27824 raft_consensus.cc:697] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:34.577425 27752 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.577992 27752 raft_consensus.cc:697] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:34.578843 27752 consensus_queue.cc:237] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:34.579736 27860 raft_consensus.cc:993] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:34.580202 27860 raft_consensus.cc:1081] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:34.584244 27709 raft_consensus.cc:2955] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.589102 27275 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:34.593300 26654 raft_consensus.cc:2955] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.570317 27824 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:34.599745 26504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:09:34.600327 26504 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.600720 26504 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.606228 26652 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:34.609705 26651 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:34.610503 27775 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:34.612424 27775 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:34.615592 27276 raft_consensus.cc:2955] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.618714 26579 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:34.625752 26657 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:34.632313 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:34.632907 26501 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:34.633231 26501 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:34.633981 26501 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:34.635023 26501 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.646258 26501 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:34.656275 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:34.656932 26579 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.687331 26579 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:34.688511 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:34.683866 26404 catalog_manager.cc:5697] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.656337 26656 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:34.690467 26651 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:34.705917 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f79cbcb2b1924d9c9e584d9a32e92bfa with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:34.708774 27747 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.709383 27747 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:09:34.712494 27890 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:09:34.713845 27892 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.060s	user 0.001s	sys 0.002s
I20260709 13:09:34.713335 27747 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:34.680145 27812 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 13:09:34.725993 27891 log.cc:927] Time spent T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260709 13:09:34.731959 26504 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:34.737768 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 49337.5us
I20260709 13:09:34.756994 26579 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:34.789999 26504 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:34.778589 27776 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:09:34.794693 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:34.795398 26577 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:34.795702 26577 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:34.796452 26577 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:34.807785 26577 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.821341 26407 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.826140 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:34.826895 27276 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.860127 26577 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:34.869432 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet f79cbcb2b1924d9c9e584d9a32e92bfa with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:34.868253 26404 catalog_manager.cc:5697] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.871608 26476 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:34.880553 27778 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.883038 27812 raft_consensus.cc:1064] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:34.885916 27778 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:34.887040 27778 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:34.890893 27812 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:34.923619 27903 tablet_replica.cc:333] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:34.928608 27903 raft_consensus.cc:2243] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.929402 27903 raft_consensus.cc:2272] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.940992 26651 raft_consensus.cc:2955] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.943745 27903 ts_tablet_manager.cc:1916] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:34.927858 27759 raft_consensus.cc:2955] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.951273 26579 raft_consensus.cc:2955] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.974745 27276 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:34.975543 26404 catalog_manager.cc:5697] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 2 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:34.984613 26651 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:09:34.993085 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 313468us
I20260709 13:09:35.009402 27276 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:35.009586 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:35.010202 27273 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.011579 26502 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:35.013827 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:35.014403 26503 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:35.014686 26503 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:35.015466 26503 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:35.016789 26503 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.017611 27903 ts_tablet_manager.cc:1929] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:09:35.018030 27903 log.cc:1199] T f79cbcb2b1924d9c9e584d9a32e92bfa P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/f79cbcb2b1924d9c9e584d9a32e92bfa
I20260709 13:09:34.991498 27824 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:09:35.023149 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet f79cbcb2b1924d9c9e584d9a32e92bfa (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:35.024827 26504 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.027019 27753 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.031109 26657 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:35.032207 26579 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:35.036662 27885 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:09:35.037668 27858 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:35.054785 26405 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.098587 27275 raft_consensus.cc:2955] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:35.101145 26651 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.079603 27747 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:09:35.102715 27276 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:35.112157 27273 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:09:35.168342 27745 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:09:35.115187 26503 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:09:35.123179 27775 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:09:35.125304 27747 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:09:35.234311 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:09:35.251288 26579 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:35.268481 27846 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:35.292498 27773 raft_consensus.cc:2955] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:35.283620 27906 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:09:35.284420 27916 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:35.304296 26407 catalog_manager.cc:5697] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.313874 26654 raft_consensus.cc:2955] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:35.330554 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:35.320696 27846 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:09:35.469980 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 103443us
W20260709 13:09:35.477841 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 105915us
W20260709 13:09:35.490185 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 161539us
I20260709 13:09:35.507438 26502 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:35.511224 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 67283.4us
I20260709 13:09:35.515133 26577 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.518117 27833 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:09:35.564208 27276 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:35.519457 27846 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:35.580776 27911 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:09:35.581593 27918 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:35.630143 27923 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
W20260709 13:09:35.698678 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 210202us
W20260709 13:09:35.756137 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 55921.5us
W20260709 13:09:35.870923 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 154925us
I20260709 13:09:35.860852 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:35.918694 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 208462us
W20260709 13:09:35.924640 27940 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:09:35.960004 27776 raft_consensus.cc:2955] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:35.962476 27278 raft_consensus.cc:2955] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:35.964855 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 45186.7us
I20260709 13:09:35.970319 27277 raft_consensus.cc:2955] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:36.091305 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 112342us
W20260709 13:09:36.168109 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 246239us
W20260709 13:09:36.213676 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 247363us
I20260709 13:09:36.229728 26507 raft_consensus.cc:2955] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:36.298418 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 205864us
I20260709 13:09:36.307168 26407 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34762 (request call id 224) took 1171 ms. Trace:
W20260709 13:09:36.299374 27796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.023s	sys 0.090s
I20260709 13:09:36.338721 26407 rpcz_store.cc:276] 0709 13:09:35.128187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.128463 (+   276us) service_pool.cc:224] Handling call
0709 13:09:36.299476 (+1171013us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:35.316320 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:35.514199 (+197879us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:35.515285 (+  1086us) write_op.cc:435] Acquired schema lock
0709 13:09:35.517581 (+  2296us) tablet.cc:662] Decoding operations
0709 13:09:35.555481 (+ 37900us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:35.562511 (+  7030us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:35.567709 (+  5198us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:35.581973 (+ 14264us) tablet.cc:701] Row locks acquired
0709 13:09:35.582001 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:09:35.582142 (+   141us) write_op.cc:270] Start()
0709 13:09:35.582248 (+   106us) write_op.cc:276] Timestamp: P: 1783602575582098 usec, L: 0
0709 13:09:35.582265 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:09:35.582814 (+   549us) log.cc:844] Serialized 544 byte log entry
0709 13:09:35.584567 (+  1753us) op_driver.cc:464] REPLICATION: finished
0709 13:09:35.584922 (+   355us) write_op.cc:301] APPLY: starting
0709 13:09:35.584990 (+    68us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:35.585088 (+    98us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:35.585179 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:35.585386 (+   207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:35.585525 (+   139us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:35.585592 (+    67us) write_op.cc:312] APPLY: finished
0709 13:09:35.585774 (+   182us) log.cc:844] Serialized 23 byte log entry
0709 13:09:35.585934 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:35.586010 (+    76us) write_op.cc:454] Released schema lock
0709 13:09:35.586051 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:35.586337 (+   286us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:35.586377 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":89325,"reported_tablets":4,"spinlock_wait_cycles":19584,"child_traces":[["op",{"apply.queue_time_us":199,"apply.run_cpu_time_us":1382,"apply.run_wall_time_us":1382,"num_ops":1,"prepare.queue_time_us":143,"prepare.run_cpu_time_us":3401,"prepare.run_wall_time_us":270546,"replication_time_us":2202}]]}
W20260709 13:09:36.356810 27943 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.486s	user 0.008s	sys 0.008s
W20260709 13:09:36.462733 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 246976us
W20260709 13:09:36.402889 27796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.023s	sys 0.091s
W20260709 13:09:36.468855 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.421062 27933 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:09:36.473899 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 173784us
W20260709 13:09:36.556818 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 66500.9us
I20260709 13:09:36.578743 27924 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:09:36.579064 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 137717us
I20260709 13:09:36.579612 27924 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:36.588208 27941 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:36.588862 27941 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:36.592788 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:36.594669 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:36.576267 26510 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:36.582640 27924 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:36.612196 26585 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:09:36.615705 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 113436us
I20260709 13:09:36.575202 27933 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:36.620509 27959 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:36.621069 27959 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:36.624631 26585 raft_consensus.cc:2955] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:36.627696 27959 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:36.611233 27922 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:36.629603 27922 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:36.668494 27925 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.669132 27925 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:36.672633 27925 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:36.682925 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:36.686228 26581 raft_consensus.cc:2955] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:36.697018 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:36.692142 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:36.706105 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:36.711344 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:36.717319 27927 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.718629 26508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:36.719260 26508 raft_consensus.cc:606] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:36.719601 26508 raft_consensus.cc:614] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:36.719926 27922 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:36.722827 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:36.724304 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:36.725368 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:36.727892 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:36.728153 27933 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:36.736169 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 76536us
W20260709 13:09:36.738433 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 77761.2us
I20260709 13:09:36.743115 27272 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:09:36.738284 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 73218.6us
I20260709 13:09:36.750037 26401 catalog_manager.cc:5697] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:36.754256 26401 catalog_manager.cc:5697] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:36.780239 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 46782.2us
I20260709 13:09:36.787003 27956 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:36.801743 26651 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:09:36.802934 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 57345.9us
W20260709 13:09:36.805517 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 57051us
I20260709 13:09:36.813009 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:36.830950 27691 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:36.832299 27691 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.832734 27691 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:36.814406 27941 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:36.855795 27691 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:36.825800 27843 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:09:36.866590 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 55124.4us
W20260709 13:09:36.895370 27964 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:09:36.899623 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:36.921779 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:36.973488 27273 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
W20260709 13:09:36.924026 27962 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:36.922253 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:36.979365 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 170266us
I20260709 13:09:36.984531 26473 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:36.986549 26549 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:36.988921 27789 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.994609 27972 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:36.995129 27972 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.995500 27972 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:37.013121 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 121301us
I20260709 13:09:37.017051 26503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:37.017767 26503 raft_consensus.cc:606] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:37.022245 27691 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:37.029692 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:37.046540 27691 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:37.047075 27691 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.047082 26549 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:37.062422 26510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:37.063184 26510 raft_consensus.cc:606] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:37.055150 26549 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:37.070757 27691 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:37.071585 27861 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.075101 26510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "574d2707e806420dab53495563bd03aa"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:37.079988 26510 raft_consensus.cc:606] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:37.086143 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:37.096678 26576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:37.097309 26576 raft_consensus.cc:606] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:37.101760 27828 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.115864 27972 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:37.119391 27273 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:37.125720 26507 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:37.129208 27972 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:37.130473 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:37.134392 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:37.135273 27273 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:37.139931 27923 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:37.149778 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:37.152041 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:37.159463 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:37.163111 26404 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 3 to 4, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 4 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.167361 27276 raft_consensus.cc:2955] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.187575 27898 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:09:37.207675 27928 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:37.208107 27928 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:37.208859 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:37.210935 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:37.208940 27928 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:37.300463 27971 raft_consensus.cc:2955] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.300804 27957 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:37.282546 27950 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:09:37.353610 27273 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:09:37.470170 27277 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:37.486464 27928 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:37.514250 27924 raft_consensus.cc:993] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:37.517484 26474 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:37.500864 27946 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:37.524190 27946 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.528167 27946 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:37.501436 26659 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:37.530217 26656 raft_consensus.cc:2955] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.534595 26405 catalog_manager.cc:5697] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.494664 26473 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:37.536531 27773 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.536649 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:37.531730 27971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59074 (request call id 73) took 1348 ms. Trace:
I20260709 13:09:37.542430 26652 raft_consensus.cc:2410] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:37.546844 27971 rpcz_store.cc:276] 0709 13:09:36.183522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.191545 (+  8023us) service_pool.cc:224] Handling call
0709 13:09:36.254407 (+ 62862us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800010598. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88319031c0 00007f88318ef9d9 00007f88318ef442 00007f882ae6bc54
0709 13:09:36.347945 (+ 93538us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b2c000014c8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882b222a11 00007f882b231a0a 00007f882b231693 00007f882b231631 00007f882c964902 00007f882c9646dd 00007f882c92ff3f 00007f882c92f6b3 00007f882c9279fa 00007f88318ef4c9 00007f882ae6bc54
0709 13:09:36.575423 (+227478us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b58003ef3d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8850aa 00007f882c907447 00007f882c92470a 00007f882c92576a 00007f882c92491b 00007f882c93003c 00007f882c92f6b3 00007f882c9279fa 00007f88318ef4c9 00007f882ae6bc54
0709 13:09:36.598034 (+ 22611us) log.cc:844] Serialized 508 byte log entry
0709 13:09:36.732853 (+134819us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b1800321640. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f882c882b0b 00007f882c907b63 00007f882c92f752 00007f882c9279fa
0709 13:09:36.913050 (+180197us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54000db4a0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c89edbe 00007f882c8a9930 00007f882c8a98d8 00007f882c8a9858 00007f882c8a9813 00007f882c8a8a9c 00007f8832794626 00007f883278edd8 00007f882c8e57cb 00007f882c8e82c0
0709 13:09:37.531635 (+618585us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75888,"raft.queue_time_us":88730,"raft.run_cpu_time_us":1320,"raft.run_wall_time_us":9612,"spinlock_wait_cycles":128654848,"thread_start_us":55659,"threads_started":1,"wal-append.queue_time_us":59282}
I20260709 13:09:37.548954 27971 raft_consensus.cc:993] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:37.549762 27975 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:37.550256 27975 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:37.551348 27971 raft_consensus.cc:1081] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:37.551043 27975 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:37.552461 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:37.549310 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 57025.8us
I20260709 13:09:37.555056 26582 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:37.523468 27961 raft_consensus.cc:1081] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:37.561816 27276 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:37.563067 27897 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:37.568595 26510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:09:37.569177 26625 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:37.569233 26510 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.570031 26510 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.570479 27947 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:37.570533 27898 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:37.581859 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6cb26f1d881541f898a5a148f7f74144 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:37.586838 26507 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:37.589500 27947 raft_consensus.cc:2955] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.592149 26653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "574d2707e806420dab53495563bd03aa"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:37.592861 26653 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.593235 26653 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.599730 26653 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.587384 26510 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.605645 26510 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:37.607477 26582 raft_consensus.cc:2955] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.630450 27276 raft_consensus.cc:2955] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.609916 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:37.633922 26576 raft_consensus.cc:3055] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.634243 26576 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:37.613451 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 15ce1ae648ca45aba8c6efb73a35ae9e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:37.635174 26576 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.636307 26576 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.637974 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:37.638536 26508 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.638800 26508 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:37.639649 26508 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.640623 26508 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.616209 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:37.619040 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cb26f1d881541f898a5a148f7f74144 with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:37.619904 27971 raft_consensus.cc:993] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:37.642146 27971 raft_consensus.cc:1081] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:37.625002 27691 raft_consensus.cc:993] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:37.643112 27691 raft_consensus.cc:1081] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:37.644311 26583 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.648227 26508 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:37.650777 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:37.651712 27928 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.627269 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:37.613015 26653 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:37.652319 27928 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:37.653062 26656 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.653280 27928 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.667253 26583 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:37.667553 26576 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:37.671065 26653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:37.690116 26653 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.690513 26653 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.691598 26401 catalog_manager.cc:5697] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.671998 26654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:37.693835 26654 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.694250 26654 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.637246 26405 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 5, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 5 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.704906 26654 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.701438 26653 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.708396 27276 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:37.709898 27858 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:37.716174 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:37.716943 26579 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.717150 26583 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:37.719730 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:37.720039 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet 15ce1ae648ca45aba8c6efb73a35ae9e with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:37.720546 26507 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:37.720885 26507 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:37.721551 26507 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.722544 26507 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.724745 26579 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:37.726166 26625 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:37.726965 27947 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.727488 27947 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:37.727833 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:37.728422 26510 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.728751 26510 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:37.728505 27947 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.729485 26510 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.730201 26654 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:37.730540 26510 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.731403 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:37.731920 26579 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.727531 26653 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:37.673808 26656 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:37.742949 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:37.744081 27858 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.744597 27858 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:37.736718 26401 catalog_manager.cc:5697] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.745481 27858 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.748364 27989 tablet_replica.cc:333] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:09:37.754273 26579 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:37.755627 26625 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:37.757512 27928 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:37.758460 27928 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:37.767066 26510 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:37.766199 27928 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:37.685482 27986 tablet_replica.cc:333] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:37.769778 27986 raft_consensus.cc:2243] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.770578 27986 raft_consensus.cc:2272] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.773248 27986 ts_tablet_manager.cc:1916] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:37.774760 27858 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:37.796388 26401 catalog_manager.cc:5697] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.798015 26401 catalog_manager.cc:5697] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 2 to 3, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.793330 26507 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:37.806411 26405 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.810379 27989 raft_consensus.cc:2243] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.826038 27989 raft_consensus.cc:2272] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.829144 27989 ts_tablet_manager.cc:1916] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:37.833043 27858 raft_consensus.cc:2955] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.839666 27276 raft_consensus.cc:2955] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.849156 27989 ts_tablet_manager.cc:1929] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:37.849884 27989 log.cc:1199] T 15ce1ae648ca45aba8c6efb73a35ae9e P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/15ce1ae648ca45aba8c6efb73a35ae9e
I20260709 13:09:37.853166 26576 raft_consensus.cc:2955] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:37.853988 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet 15ce1ae648ca45aba8c6efb73a35ae9e (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:37.856707 27986 ts_tablet_manager.cc:1929] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:09:37.857249 27986 log.cc:1199] T 6cb26f1d881541f898a5a148f7f74144 P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/6cb26f1d881541f898a5a148f7f74144
I20260709 13:09:37.858840 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6daa7e0062a14868b29dc1a9144f41c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:37.859416 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet 6cb26f1d881541f898a5a148f7f74144 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:37.867440 26405 catalog_manager.cc:5697] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 1 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.892886 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 6daa7e0062a14868b29dc1a9144f41c8 with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:37.907887 27994 tablet_replica.cc:333] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:09:37.919507 27994 raft_consensus.cc:2243] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.920506 27994 raft_consensus.cc:2272] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.924823 27994 ts_tablet_manager.cc:1916] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:37.950176 27994 ts_tablet_manager.cc:1929] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:37.950799 27994 log.cc:1199] T 6daa7e0062a14868b29dc1a9144f41c8 P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/6daa7e0062a14868b29dc1a9144f41c8
I20260709 13:09:37.953066 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 6daa7e0062a14868b29dc1a9144f41c8 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:38.007751 27276 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:38.009455 27975 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:38.060081 26656 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:09:38.060482 26656 pending_rounds.cc:85] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 5
I20260709 13:09:38.060696 26656 pending_rounds.cc:107] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:09:38.060961 26656 raft_consensus.cc:2889] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:38.062769 27773 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:38.081465 26507 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.090314 27957 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.144511 26579 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.153013 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:38.158741 26654 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.160233 27975 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.168097 27957 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.210187 26576 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.215695 27773 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.245925 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:38.253410 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 57768.3us
I20260709 13:09:38.257717 26507 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.259001 27947 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:38.283339 26579 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.284806 27897 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.300925 26503 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.309908 27897 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.321710 26579 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.323089 27897 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:38.327785 26656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:38.328348 26656 raft_consensus.cc:606] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:38.345711 26656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66cd76ef163447878430c4633d13a427"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:38.346709 26656 raft_consensus.cc:606] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:38.349555 26503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:38.350171 26503 raft_consensus.cc:606] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:38.361137 26579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "731b96cedb5749df893a1de699717183"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:38.361726 26579 raft_consensus.cc:606] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:38.364914 26503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:38.365500 26503 raft_consensus.cc:606] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:38.368129 26503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:38.368798 26503 raft_consensus.cc:606] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:38.370381 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:38.372005 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:38.383610 27773 raft_consensus.cc:993] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:38.384202 27773 raft_consensus.cc:1081] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:38.385885 26656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:38.386394 26656 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.386669 26656 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.390973 26656 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.393241 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:38.393764 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:38.394330 26656 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:38.394392 26579 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.393908 26503 raft_consensus.cc:3055] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.402088 26503 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:38.403287 26579 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:38.403080 26503 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.404520 26625 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:38.404696 26503 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.405284 27897 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.405804 27897 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:38.406564 27897 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.412740 26503 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:38.416496 26401 catalog_manager.cc:5697] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.520359 27897 raft_consensus.cc:993] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:38.521207 27947 raft_consensus.cc:1081] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:38.522794 26579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:38.523401 26579 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.523838 26579 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.532785 26579 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.535156 26579 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:38.535557 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:38.536257 26503 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.541743 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:38.542362 26656 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:38.542667 26656 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:38.543350 26656 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.544484 26656 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.546190 26503 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:38.547560 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:38.548734 27745 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:38.550089 27745 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:38.551316 27745 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.552186 26656 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:38.563673 26401 catalog_manager.cc:5697] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.652004 27858 raft_consensus.cc:993] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:38.652554 27773 raft_consensus.cc:1081] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:38.657372 26576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:09:38.657946 26576 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.658296 26576 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.669466 26576 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:38.684815 26576 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:38.686527 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:38.687193 27276 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.687100 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:38.688031 26503 raft_consensus.cc:3055] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.688372 26503 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:38.689185 26503 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:38.690250 26503 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.700672 27975 raft_consensus.cc:993] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:38.701328 27918 raft_consensus.cc:1081] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:38.703181 26654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:38.703771 26654 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.704130 26654 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.704178 26503 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:38.705343 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:38.706116 27861 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.706771 27861 raft_consensus.cc:697] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:38.707618 27861 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:38.712080 26654 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.713250 27276 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:38.716483 26654 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:38.722724 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:38.724148 26507 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.724540 26507 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:38.723515 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:38.725219 26576 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.729200 27961 raft_consensus.cc:993] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:38.729672 27961 raft_consensus.cc:1081] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:38.731791 26507 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.733356 26507 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.740198 26508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "731b96cedb5749df893a1de699717183"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:09:38.740842 26508 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.741201 26508 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.743650 26401 catalog_manager.cc:5697] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:38.757753 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 82188.9us
I20260709 13:09:38.770635 26576 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:38.769297 26507 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:38.771935 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:38.776170 27897 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.776682 27897 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:38.777549 27897 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.781972 26508 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.783977 26508 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:38.785295 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:38.785928 26654 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.787847 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:38.788516 26576 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:38.788872 26576 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:38.790439 26576 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.792420 26576 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.796582 26579 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.800209 27946 raft_consensus.cc:993] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:38.800283 27897 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.800836 27957 raft_consensus.cc:1081] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:38.802603 27276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66cd76ef163447878430c4633d13a427"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:09:38.803149 27276 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.802003 26654 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:38.803462 27276 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.804545 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:38.805410 27918 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:38.805928 27918 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:38.806845 27918 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:38.807087 26401 catalog_manager.cc:5697] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.816633 27276 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:38.828166 26401 catalog_manager.cc:5697] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 3, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.829236 26576 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:38.830788 27276 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:38.831537 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:38.832132 26508 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.836585 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:38.837203 26654 raft_consensus.cc:3055] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.837508 26654 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:38.838306 26654 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:38.839453 26654 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.845908 26508 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:38.846814 26654 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:38.847062 27240 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:38.850512 28017 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.871833 26507 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.874684 27946 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.877523 28017 raft_consensus.cc:697] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:38.883936 28017 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:38.940320 26401 catalog_manager.cc:5697] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.004189 26507 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
W20260709 13:09:39.011188 26473 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63f94c193a504bc1b0601e54e3ec5f9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:39.014680 26654 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:39.015486 26582 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:39.017177 27918 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:09:39.034483 27975 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.056649 27918 raft_consensus.cc:2955] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:39.058790 26656 raft_consensus.cc:2955] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:39.067049 26507 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.069501 27961 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.077265 26654 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:39.082871 26405 catalog_manager.cc:5697] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.100744 26582 raft_consensus.cc:2955] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:39.104771 27276 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:39.106541 27961 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:39.122799 26653 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.125737 27961 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:39.167763 26622 consensus_peers.cc:597] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0edde491935742d4b076995932d10cc9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:39.173729 26579 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:39.185518 27946 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.195667 26507 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:39.200616 26582 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.209506 26654 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.212963 27897 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.213204 27957 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.213368 27918 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:39.240109 26508 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:39.243140 27861 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:39.264161 26583 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.286234 26508 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.287389 27858 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:39.293161 27957 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.323865 27897 raft_consensus.cc:2955] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:39.329497 26507 raft_consensus.cc:2955] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:39.351842 26656 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:39.353266 28021 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:39.374655 26680 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 13:09:39.403450 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.350431 26582 raft_consensus.cc:2955] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:39.523767 26508 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:39.531054 28021 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:39.549646 26583 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:39.588030 26401 catalog_manager.cc:5697] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.635628 26653 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:39.641973 26502 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:39.649844 27861 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:09:39.680958 28053 ts_tablet_manager.cc:933] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:09:39.693956 27745 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
W20260709 13:09:39.702171 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 61569.8us
I20260709 13:09:39.707733 28053 tablet_copy_client.cc:323] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
W20260709 13:09:39.739974 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 78634.4us
W20260709 13:09:39.748186 26548 consensus_peers.cc:597] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b57a114025342d2bdfb15a7bb13db93. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:39.804206 27961 raft_consensus.cc:2955] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
W20260709 13:09:39.810061 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 94921.7us
I20260709 13:09:39.815477 26656 raft_consensus.cc:2955] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:39.822749 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet 63f94c193a504bc1b0601e54e3ec5f9a from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:09:39.823496 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet 63f94c193a504bc1b0601e54e3ec5f9a from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-63f94c193a504bc1b0601e54e3ec5f9a
I20260709 13:09:39.829312 28068 ts_tablet_manager.cc:933] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:39.878577 26503 raft_consensus.cc:2955] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:39.882519 28068 tablet_copy_client.cc:323] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:39.890002 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 0edde491935742d4b076995932d10cc9 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:39.890580 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 0edde491935742d4b076995932d10cc9 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-0edde491935742d4b076995932d10cc9
I20260709 13:09:39.900918 26669 tablet_copy_source_session.cc:215] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:39.900660 26520 tablet_copy_source_session.cc:215] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:39.913590 26407 catalog_manager.cc:5697] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:39.915344 26656 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:39.916024 28053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f94c193a504bc1b0601e54e3ec5f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.923254 28068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0edde491935742d4b076995932d10cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.936411 26576 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:39.942688 26510 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:39.943773 27957 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.954383 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.958225 28057 raft_consensus.cc:2955] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:39.960152 28053 tablet_copy_client.cc:806] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:39.960170 26576 raft_consensus.cc:2955] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
W20260709 13:09:39.964839 26622 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f93f34ef8a541ecba8b1a0dc7ea5a2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:39.973483 28068 tablet_copy_client.cc:806] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:39.979938 28043 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.981343 28068 tablet_copy_client.cc:670] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:39.960927 28053 tablet_copy_client.cc:670] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:39.992012 28068 tablet_copy_client.cc:538] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:39.999986 28053 tablet_copy_client.cc:538] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:40.009977 26510 raft_consensus.cc:2955] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:40.012002 28053 tablet_bootstrap.cc:492] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:40.014050 28068 tablet_bootstrap.cc:492] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:40.035240 26401 catalog_manager.cc:5697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.060205 28053 tablet_bootstrap.cc:492] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.064182 28053 tablet_bootstrap.cc:492] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:40.064936 28068 tablet_bootstrap.cc:492] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.065047 28053 ts_tablet_manager.cc:1403] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.024s
I20260709 13:09:40.066322 28068 tablet_bootstrap.cc:492] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:40.067108 28068 ts_tablet_manager.cc:1403] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.007s
I20260709 13:09:40.071054 28068 raft_consensus.cc:359] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:40.072012 28068 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:40.072779 28068 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:40.076030 28068 ts_tablet_manager.cc:1434] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:09:40.079154 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-0edde491935742d4b076995932d10cc9 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:40.080044 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-0edde491935742d4b076995932d10cc9 on tablet 0edde491935742d4b076995932d10cc9 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:40.085500 28053 raft_consensus.cc:359] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:40.087534 28053 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:40.088302 28053 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:40.091596 28053 ts_tablet_manager.cc:1434] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:09:40.095535 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-63f94c193a504bc1b0601e54e3ec5f9a received from {username='slave'} at 127.0.0.1:55308
I20260709 13:09:40.096048 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-63f94c193a504bc1b0601e54e3ec5f9a on tablet 63f94c193a504bc1b0601e54e3ec5f9a with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:40.137676 26576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:40.138372 26576 raft_consensus.cc:606] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:40.141901 26576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:40.142619 26576 raft_consensus.cc:606] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:40.145419 26656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:40.146023 26656 raft_consensus.cc:606] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:40.150013 26503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:40.150484 26503 raft_consensus.cc:606] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:40.152650 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:40.154563 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:40.155342 28062 raft_consensus.cc:993] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:40.155977 27975 raft_consensus.cc:1081] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:40.157738 26576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:09:40.158324 26576 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.158686 26576 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.165525 26576 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:40.167586 26576 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:40.168665 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:40.168895 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:40.169360 26503 raft_consensus.cc:3055] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.169420 27276 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.169832 26503 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:40.170674 26503 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:40.172029 26503 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.179296 27277 raft_consensus.cc:1217] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:09:40.181638 27276 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:40.188748 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:40.189780 28059 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.190305 28059 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:40.190680 26503 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:40.191386 28059 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:40.196552 28053 ts_tablet_manager.cc:933] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:40.201970 28053 tablet_copy_client.cc:323] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.194:33025
I20260709 13:09:40.205899 26595 tablet_copy_service.cc:140] P ef2886777a8f45e69e213b02a22ecec7: Received BeginTabletCopySession request for tablet 4b57a114025342d2bdfb15a7bb13db93 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39940)
I20260709 13:09:40.206487 26595 tablet_copy_service.cc:161] P ef2886777a8f45e69e213b02a22ecec7: Beginning new tablet copy session on tablet 4b57a114025342d2bdfb15a7bb13db93 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39940: session id = b1f40e8672c549d3b4be7862ac07b7e2-4b57a114025342d2bdfb15a7bb13db93
I20260709 13:09:40.215104 26595 tablet_copy_source_session.cc:215] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:40.219306 28053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b57a114025342d2bdfb15a7bb13db93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.227260 26405 catalog_manager.cc:5697] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.240319 28053 tablet_copy_client.cc:806] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:40.241021 28053 tablet_copy_client.cc:670] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:40.245786 28053 tablet_copy_client.cc:538] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:40.253283 28053 tablet_bootstrap.cc:492] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:40.271905 27276 raft_consensus.cc:1217] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:40.282327 28053 tablet_bootstrap.cc:492] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.284946 28053 tablet_bootstrap.cc:492] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:40.285688 28053 ts_tablet_manager.cc:1403] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.013s
I20260709 13:09:40.291101 28053 raft_consensus.cc:359] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:40.292069 28053 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:40.292805 28053 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:40.298007 28053 ts_tablet_manager.cc:1434] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:40.300009 26595 tablet_copy_service.cc:342] P ef2886777a8f45e69e213b02a22ecec7: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-4b57a114025342d2bdfb15a7bb13db93 received from {username='slave'} at 127.0.0.1:39940
I20260709 13:09:40.300483 26595 tablet_copy_service.cc:434] P ef2886777a8f45e69e213b02a22ecec7: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-4b57a114025342d2bdfb15a7bb13db93 on tablet 4b57a114025342d2bdfb15a7bb13db93 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:40.312258 27745 raft_consensus.cc:993] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:40.312903 27861 raft_consensus.cc:1081] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:40.314594 26656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54888
I20260709 13:09:40.315176 26656 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.315529 26656 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.321183 26656 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:40.323151 26656 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:40.323602 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:40.323948 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:40.324249 26510 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.324600 26577 raft_consensus.cc:3055] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.324998 26577 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:40.325812 26577 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:40.327098 26577 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.333437 26510 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:40.334583 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:40.335587 28064 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.336104 28064 raft_consensus.cc:697] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:40.336839 26577 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:40.336905 28064 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:40.361246 26405 catalog_manager.cc:5697] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.398581 28053 ts_tablet_manager.cc:933] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:40.400275 28053 tablet_copy_client.cc:323] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:40.401954 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:40.402503 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-5f93f34ef8a541ecba8b1a0dc7ea5a2a
I20260709 13:09:40.410701 26669 tablet_copy_source_session.cc:215] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:40.414211 28053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.430927 28053 tablet_copy_client.cc:806] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:40.431586 28053 tablet_copy_client.cc:670] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:40.435433 28053 tablet_copy_client.cc:538] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:40.444763 28053 tablet_bootstrap.cc:492] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:40.465602 28053 tablet_bootstrap.cc:492] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.466502 28053 tablet_bootstrap.cc:492] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:40.467110 28053 ts_tablet_manager.cc:1403] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.001s
I20260709 13:09:40.469751 28053 raft_consensus.cc:359] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:40.470547 28053 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:40.471160 28053 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:40.473413 28053 ts_tablet_manager.cc:1434] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:40.476183 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-5f93f34ef8a541ecba8b1a0dc7ea5a2a received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:40.476634 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-5f93f34ef8a541ecba8b1a0dc7ea5a2a on tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:40.504016 27947 raft_consensus.cc:993] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:40.504633 28064 raft_consensus.cc:1081] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:40.506763 26503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59084
I20260709 13:09:40.507253 26503 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.507530 26503 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.514719 27861 raft_consensus.cc:993] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:40.515339 28059 raft_consensus.cc:1081] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:40.518366 26510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:09:40.518953 26510 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.519307 26510 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.520358 26503 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:40.527068 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:40.527701 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:40.528306 26654 raft_consensus.cc:3055] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.528538 26654 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:40.529194 26503 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:40.529280 26654 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:40.527707 27276 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.530916 26654 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.526932 26510 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:40.538309 27276 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:40.539911 26473 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:40.540894 28063 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.541417 28063 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:40.542547 28063 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:40.548370 26510 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:40.538887 26654 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:40.549834 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:40.550475 26656 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.550877 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:40.551514 26576 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.552232 26576 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:40.553110 26576 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:40.558183 26576 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.564060 26656 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:40.565637 26474 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:40.566538 27773 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.567022 27773 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:40.567818 27773 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:40.570135 26576 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:40.580318 26405 catalog_manager.cc:5697] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.581350 26510 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:40.583043 27861 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:40.601962 26405 catalog_manager.cc:5697] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.617882 27276 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:40.619796 27745 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:40.627211 27276 raft_consensus.cc:1217] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:09:40.718343 27773 raft_consensus.cc:1064] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:40.720753 27773 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:40.727798 26656 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:40.727797 27276 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:40.728191 26577 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:40.729427 27975 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:40.746567 27773 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:40.748054 28062 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:40.749485 26510 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.752291 28057 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.773520 26582 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.775242 28057 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:40.801373 26656 raft_consensus.cc:2955] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:40.801879 27975 raft_consensus.cc:2955] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:40.852654 27277 raft_consensus.cc:2955] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:40.860704 26405 catalog_manager.cc:5697] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:40.868402 27947 raft_consensus.cc:1064] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:40.885241 27947 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:40.903514 26577 raft_consensus.cc:2955] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:40.950074 27277 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:40.952103 26507 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:40.952248 27947 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:40.952692 26577 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:40.953807 28057 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:40.959352 28064 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:40.965533 27276 raft_consensus.cc:1217] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:40.976680 26510 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:40.985085 27276 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:40.987769 27975 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:40.990157 28057 raft_consensus.cc:2955] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:40.994439 27276 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:41.002835 27273 raft_consensus.cc:2955] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.005038 28092 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:41.005510 26654 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:41.007365 28092 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:41.012552 27773 raft_consensus.cc:2955] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.023770 26583 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.028321 28062 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.043100 26401 catalog_manager.cc:5697] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.060945 26510 raft_consensus.cc:2955] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.083164 26651 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:41.086530 26651 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.088440 27975 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:41.101938 28092 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.070693 26654 raft_consensus.cc:2955] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.130923 27278 raft_consensus.cc:2955] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.133224 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 63f94c193a504bc1b0601e54e3ec5f9a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:41.155544 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:41.163511 26576 raft_consensus.cc:2955] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.171547 26407 catalog_manager.cc:5697] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.203060 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet 63f94c193a504bc1b0601e54e3ec5f9a with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:41.251564 28109 tablet_replica.cc:333] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:41.251757 28088 raft_consensus.cc:1064] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:41.263144 28109 raft_consensus.cc:2243] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.267637 28109 raft_consensus.cc:2272] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.262964 28088 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:41.266072 26651 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:41.276717 27278 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:41.277447 26656 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:41.276717 27273 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:41.279515 28109 ts_tablet_manager.cc:1916] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:41.281847 28059 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:41.282500 26507 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:41.283553 28088 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:41.286795 26576 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:41.287264 28059 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:41.287071 28064 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:09:41.296907 28057 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:41.312067 27957 raft_consensus.cc:2955] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.314603 26582 raft_consensus.cc:2955] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.320277 27278 raft_consensus.cc:2955] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.325235 28109 ts_tablet_manager.cc:1929] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:09:41.325830 28109 log.cc:1199] T 63f94c193a504bc1b0601e54e3ec5f9a P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/63f94c193a504bc1b0601e54e3ec5f9a
I20260709 13:09:41.328352 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet 63f94c193a504bc1b0601e54e3ec5f9a (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:41.325114 26507 raft_consensus.cc:2955] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.320087 28088 raft_consensus.cc:2955] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.336689 26401 catalog_manager.cc:5697] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.338771 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0edde491935742d4b076995932d10cc9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:41.335282 26651 raft_consensus.cc:2955] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.354084 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet 0edde491935742d4b076995932d10cc9 with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:41.358867 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:41.378307 27278 raft_consensus.cc:2955] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.390318 27957 raft_consensus.cc:1064] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:41.388437 26404 catalog_manager.cc:5697] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.398285 28115 tablet_replica.cc:333] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:09:41.399636 28115 raft_consensus.cc:2243] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.400324 28115 raft_consensus.cc:2272] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.396600 27957 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:41.417191 28115 ts_tablet_manager.cc:1916] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:41.469710 28115 ts_tablet_manager.cc:1929] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:41.474745 26576 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:41.478148 26503 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:41.479420 27278 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:41.488008 26582 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:41.489171 27957 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:41.490459 28043 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:41.492239 28064 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:41.500300 26507 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:41.502619 28115 log.cc:1199] T 0edde491935742d4b076995932d10cc9 P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/0edde491935742d4b076995932d10cc9
I20260709 13:09:41.502797 28059 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:41.504449 27273 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:41.504920 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet 0edde491935742d4b076995932d10cc9 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:41.506974 26656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:41.507524 26656 raft_consensus.cc:606] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:41.511471 28110 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:41.519940 28043 raft_consensus.cc:2955] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.534034 28059 raft_consensus.cc:2955] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.537362 26582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:41.538120 26582 raft_consensus.cc:606] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:41.540933 28057 raft_consensus.cc:993] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:41.541728 28057 raft_consensus.cc:1081] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:41.540946 26502 raft_consensus.cc:2955] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.557628 26503 raft_consensus.cc:2955] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.563732 26507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:41.564428 26507 raft_consensus.cc:606] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:41.565928 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:41.567699 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:41.567162 27273 raft_consensus.cc:2955] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.577412 26576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:41.578104 26576 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.578519 26576 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.595031 26395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b57a114025342d2bdfb15a7bb13db93 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:41.596467 26576 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:41.600912 26576 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:41.601644 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:41.602260 26502 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.600677 26404 catalog_manager.cc:5697] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 4 to 5, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.609062 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:41.609789 26656 raft_consensus.cc:3055] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:41.610090 26656 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:41.610873 26656 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:41.612152 26656 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.613600 26582 raft_consensus.cc:2955] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.620934 26502 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:41.622242 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:41.627310 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b57a114025342d2bdfb15a7bb13db93 with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:41.629693 27278 raft_consensus.cc:2955] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.642267 26656 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:41.625669 28059 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:41.644191 28059 raft_consensus.cc:697] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:41.657161 26407 catalog_manager.cc:5697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.659451 28059 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:41.674212 28122 tablet_replica.cc:333] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:09:41.675298 28122 raft_consensus.cc:2243] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.676030 28122 raft_consensus.cc:2272] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.680229 28122 ts_tablet_manager.cc:1916] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:41.690148 26405 catalog_manager.cc:5697] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.721190 28122 ts_tablet_manager.cc:1929] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:09:41.721783 28122 log.cc:1199] T 4b57a114025342d2bdfb15a7bb13db93 P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/4b57a114025342d2bdfb15a7bb13db93
I20260709 13:09:41.724900 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 4b57a114025342d2bdfb15a7bb13db93 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:41.740299 26656 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:41.746912 27278 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:41.748323 28043 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:41.749770 26507 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:41.753427 28064 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:41.761166 28057 raft_consensus.cc:2955] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.763671 26507 raft_consensus.cc:2955] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.777473 27273 raft_consensus.cc:2955] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.783634 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:41.791837 26407 catalog_manager.cc:5697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:41.806739 27975 raft_consensus.cc:993] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:41.807441 27975 raft_consensus.cc:1081] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:41.809412 26656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:41.809979 26656 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.810335 26656 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.811829 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:41.812764 28109 tablet_replica.cc:333] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:41.813446 28109 raft_consensus.cc:2243] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.814172 28109 raft_consensus.cc:2272] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.816628 26656 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:41.817348 28109 ts_tablet_manager.cc:1916] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:41.818785 26656 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:41.820439 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:41.820996 26507 raft_consensus.cc:3055] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:41.821332 26507 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:41.821158 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:41.821969 26576 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.822250 26507 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:41.823452 26507 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.830698 26507 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:41.830998 26576 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:41.831838 26622 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:41.832708 28043 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:41.833218 28043 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:41.834124 28043 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:41.835335 28109 ts_tablet_manager.cc:1929] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:41.835880 28109 log.cc:1199] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/5f93f34ef8a541ecba8b1a0dc7ea5a2a
I20260709 13:09:41.837625 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet 5f93f34ef8a541ecba8b1a0dc7ea5a2a (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:41.845003 26407 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 2 to 3, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.035801 28059 raft_consensus.cc:993] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:42.036326 28110 raft_consensus.cc:1081] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:42.037825 26502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:09:42.038331 26502 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:42.038628 26502 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.043133 26502 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:42.044705 26502 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:42.045408 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:42.045818 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:42.046005 26576 raft_consensus.cc:3055] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:42.046352 26651 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.046330 26576 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:42.047333 26576 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:42.048480 26576 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.052860 26651 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:42.054955 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:42.055713 28063 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:42.055655 26576 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:42.056366 28063 raft_consensus.cc:697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:42.057253 28063 consensus_queue.cc:237] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:42.067876 26407 catalog_manager.cc:5697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.074957 26651 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:42.076594 28110 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:42.096329 26502 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:42.099845 28088 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:42.299486 26576 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:42.301240 28064 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:42.311441 26502 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:42.313212 28064 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:42.568755 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:42.650477 26582 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.651738 28063 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.655546 26656 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.657102 28063 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.734249 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:42.784801 26502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:42.785430 26502 raft_consensus.cc:606] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:42.790119 26582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:42.790608 26582 raft_consensus.cc:606] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:42.793179 26656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:42.793768 26656 raft_consensus.cc:606] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:42.795012 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:42.796382 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:42.878762 26656 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
W20260709 13:09:42.885630 26622 consensus_peers.cc:597] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbeed79ff32c46018128de0f6b9a3514. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.886719 26582 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:42.887302 26503 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:42.888633 28131 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.889389 28043 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:42.903577 28043 raft_consensus.cc:2955] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:42.905458 26582 raft_consensus.cc:2955] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:42.905506 26502 raft_consensus.cc:2955] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:42.921119 26405 catalog_manager.cc:5697] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.922562 26507 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:42.948194 26656 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:09:42.949180 26473 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7aaf3bb8d83488a81bc031ffda595a5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.949894 28104 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:42.950325 26576 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:42.951844 28105 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:42.978825 28104 raft_consensus.cc:2955] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:42.980780 26656 raft_consensus.cc:2955] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:42.983259 26576 raft_consensus.cc:2955] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:42.995455 26656 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:42.999289 26407 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:43.007014 26576 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:43.008667 28043 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:43.009529 26507 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:43.009601 26622 consensus_peers.cc:597] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f54605dc5ec04452908dd0efd01fbcaf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.011183 28043 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:43.018579 28064 raft_consensus.cc:2955] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:43.020164 26576 raft_consensus.cc:2955] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:43.022688 26510 raft_consensus.cc:2955] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:43.036794 26656 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:43.040906 26404 catalog_manager.cc:5697] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:43.047087 26622 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 479f20ff71c04b8ea8eea5b4f8c922ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.049850 26510 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:43.051410 28131 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:43.059173 26576 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:43.061021 28064 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:43.075205 26503 raft_consensus.cc:2955] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:43.074556 28043 raft_consensus.cc:2955] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:43.086258 26576 raft_consensus.cc:2955] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:43.094906 26407 catalog_manager.cc:5697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:43.257470 28104 raft_consensus.cc:993] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:43.258626 28063 raft_consensus.cc:1081] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:43.258795 28043 raft_consensus.cc:993] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:43.260138 28064 raft_consensus.cc:1081] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:43.261135 26654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:43.261718 26654 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:43.262068 26654 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.266605 26576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:43.267305 26576 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:43.267769 26576 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.268358 26654 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:43.270467 26654 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:43.272665 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:43.273283 26507 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:43.273626 26507 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:43.274452 26507 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:43.275581 26507 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.276866 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:43.277452 26582 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.282210 26507 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:43.283793 26622 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:43.284631 28043 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:43.285096 28043 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:43.285699 26576 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:43.287773 26582 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:43.287990 28043 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:43.289412 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:43.290026 26503 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.293347 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:43.294309 26654 raft_consensus.cc:3055] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:43.294746 26654 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:43.295800 26654 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:43.297032 26654 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.305958 28059 raft_consensus.cc:993] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:43.306499 28059 raft_consensus.cc:1081] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:43.307624 26405 catalog_manager.cc:5697] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 2 to 3, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.312958 26503 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:09:43.318981 26576 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:43.324807 26654 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:09:43.326277 26549 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:43.327013 28151 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:43.327517 28151 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:43.328749 26507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:09:43.328452 28151 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:43.329309 26507 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:43.329696 26507 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.338682 26507 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:43.341109 26507 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:43.343350 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:43.343925 27278 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.347193 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:43.347810 26582 raft_consensus.cc:3055] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:43.348143 26582 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:43.349454 26582 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:43.350975 26582 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.350999 27278 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:43.359263 26473 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:43.359009 26405 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 4, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 4 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.360342 28063 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:43.360950 28063 raft_consensus.cc:697] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:43.361972 28063 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:43.363618 26582 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:43.382503 26405 catalog_manager.cc:5697] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 3, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.403422 28155 ts_tablet_manager.cc:933] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:43.405010 28155 tablet_copy_client.cc:323] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:43.406713 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet bbeed79ff32c46018128de0f6b9a3514 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:43.407245 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet bbeed79ff32c46018128de0f6b9a3514 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-bbeed79ff32c46018128de0f6b9a3514
I20260709 13:09:43.416321 26669 tablet_copy_source_session.cc:215] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:43.420686 28155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbeed79ff32c46018128de0f6b9a3514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.434962 28155 tablet_copy_client.cc:806] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:43.435537 28155 tablet_copy_client.cc:670] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:43.440227 28155 tablet_copy_client.cc:538] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:43.447506 28155 tablet_bootstrap.cc:492] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:43.458501 28157 ts_tablet_manager.cc:933] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:43.467099 28157 tablet_copy_client.cc:323] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:43.468878 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet f54605dc5ec04452908dd0efd01fbcaf from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:43.469408 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet f54605dc5ec04452908dd0efd01fbcaf from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-f54605dc5ec04452908dd0efd01fbcaf
I20260709 13:09:43.470224 28155 tablet_bootstrap.cc:492] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.471432 28155 tablet_bootstrap.cc:492] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:43.472103 28155 ts_tablet_manager.cc:1403] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.013s
I20260709 13:09:43.476387 28155 raft_consensus.cc:359] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:43.477761 28155 raft_consensus.cc:740] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:43.478435 28155 consensus_queue.cc:260] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:43.479950 26669 tablet_copy_source_session.cc:215] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:43.481804 28155 ts_tablet_manager.cc:1434] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:09:43.484916 28157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54605dc5ec04452908dd0efd01fbcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.486222 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-bbeed79ff32c46018128de0f6b9a3514 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:43.486703 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-bbeed79ff32c46018128de0f6b9a3514 on tablet bbeed79ff32c46018128de0f6b9a3514 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:43.507277 28157 tablet_copy_client.cc:806] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:43.507855 28157 tablet_copy_client.cc:670] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:43.511379 28157 tablet_copy_client.cc:538] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:43.518939 28155 ts_tablet_manager.cc:933] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:09:43.520617 28155 tablet_copy_client.cc:323] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:09:43.520936 28157 tablet_bootstrap.cc:492] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:43.522287 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet a7aaf3bb8d83488a81bc031ffda595a5 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:09:43.522825 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet a7aaf3bb8d83488a81bc031ffda595a5 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-a7aaf3bb8d83488a81bc031ffda595a5
I20260709 13:09:43.532977 26520 tablet_copy_source_session.cc:215] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:43.536531 28155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aaf3bb8d83488a81bc031ffda595a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.550872 28157 tablet_bootstrap.cc:492] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.551852 28157 tablet_bootstrap.cc:492] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:43.552510 28157 ts_tablet_manager.cc:1403] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.008s
I20260709 13:09:43.555706 28157 raft_consensus.cc:359] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:43.556543 28157 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:43.557258 28157 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:43.559821 28157 ts_tablet_manager.cc:1434] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:43.561906 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-f54605dc5ec04452908dd0efd01fbcaf received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:43.562280 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-f54605dc5ec04452908dd0efd01fbcaf on tablet f54605dc5ec04452908dd0efd01fbcaf with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:43.563280 28155 tablet_copy_client.cc:806] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:43.564239 28155 tablet_copy_client.cc:670] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:43.568058 28155 tablet_copy_client.cc:538] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:43.577857 28155 tablet_bootstrap.cc:492] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:43.605522 28155 tablet_bootstrap.cc:492] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.606539 28155 tablet_bootstrap.cc:492] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:43.607215 28155 ts_tablet_manager.cc:1403] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.006s
I20260709 13:09:43.610172 28155 raft_consensus.cc:359] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:43.611019 28155 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:43.611650 28155 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:43.613509 28157 ts_tablet_manager.cc:933] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:43.614069 28155 ts_tablet_manager.cc:1434] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:43.615521 28157 tablet_copy_client.cc:323] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:43.616626 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-a7aaf3bb8d83488a81bc031ffda595a5 received from {username='slave'} at 127.0.0.1:55308
I20260709 13:09:43.617134 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-a7aaf3bb8d83488a81bc031ffda595a5 on tablet a7aaf3bb8d83488a81bc031ffda595a5 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:43.618181 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 479f20ff71c04b8ea8eea5b4f8c922ff from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:43.618676 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 479f20ff71c04b8ea8eea5b4f8c922ff from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-479f20ff71c04b8ea8eea5b4f8c922ff
I20260709 13:09:43.625063 26669 tablet_copy_source_session.cc:215] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:43.629055 28157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479f20ff71c04b8ea8eea5b4f8c922ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.647209 28157 tablet_copy_client.cc:806] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:43.647933 28157 tablet_copy_client.cc:670] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:43.652050 28157 tablet_copy_client.cc:538] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:43.661772 28157 tablet_bootstrap.cc:492] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:43.669180 26507 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:43.670545 28043 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:43.732235 26582 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:43.735860 28131 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:43.755664 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 56517.9us
I20260709 13:09:43.780242 28157 tablet_bootstrap.cc:492] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.781255 28157 tablet_bootstrap.cc:492] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:43.781988 28157 ts_tablet_manager.cc:1403] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.120s	user 0.047s	sys 0.031s
I20260709 13:09:43.785257 28157 raft_consensus.cc:359] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:43.786234 28157 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:43.786966 28157 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:43.792922 28157 ts_tablet_manager.cc:1434] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:43.794680 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-479f20ff71c04b8ea8eea5b4f8c922ff received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:43.795106 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-479f20ff71c04b8ea8eea5b4f8c922ff on tablet 479f20ff71c04b8ea8eea5b4f8c922ff with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:43.799573 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:43.827473 27278 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:43.828850 28063 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:43.831167 27278 raft_consensus.cc:1217] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:43.838043 26654 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:43.840489 28151 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:43.852721 26582 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:43.853272 26507 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:43.855137 28063 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:43.859262 28151 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:43.884893 27278 raft_consensus.cc:1217] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:44.078110 27276 raft_consensus.cc:1217] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:44.143013 27276 raft_consensus.cc:1217] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:09:44.202754 28043 raft_consensus.cc:1064] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:44.205876 28043 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:44.217048 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:44.247113 27276 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:44.247645 26507 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:44.248551 26582 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:44.248924 28043 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.249938 28170 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.251629 28064 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.276396 28043 raft_consensus.cc:2955] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.278439 27276 raft_consensus.cc:2955] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.287355 28043 raft_consensus.cc:1064] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:44.289768 28043 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:44.291174 26579 raft_consensus.cc:2955] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.310346 26576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:44.310966 26576 raft_consensus.cc:606] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:44.314061 26507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:44.314594 26507 raft_consensus.cc:606] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:44.319587 26651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:44.320286 26651 raft_consensus.cc:606] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:44.323295 26507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:44.323809 26507 raft_consensus.cc:606] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:44.325297 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:44.326854 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:44.280534 26503 raft_consensus.cc:2955] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.346485 28168 raft_consensus.cc:993] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:44.347384 28177 raft_consensus.cc:1081] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:44.349730 27273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46406
I20260709 13:09:44.350230 27273 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:44.350533 27273 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.339840 26405 catalog_manager.cc:5697] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.360890 27273 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:44.364713 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:44.365286 26507 raft_consensus.cc:3055] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:44.364318 27273 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:44.365391 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:44.366261 26579 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.372198 26507 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:44.373004 26507 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:44.374065 26507 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.378741 26579 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:44.383338 26503 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:44.384508 27243 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:44.384673 28043 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.385418 28135 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:44.385915 28135 raft_consensus.cc:697] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:44.386772 28135 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:44.393537 26579 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:44.393782 27273 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:44.396260 28043 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.401750 28064 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.403751 26507 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:44.425518 28063 raft_consensus.cc:993] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:44.425988 28063 raft_consensus.cc:1081] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:44.431313 26656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:44.432032 26656 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:44.432439 26656 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.441135 28088 raft_consensus.cc:993] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:44.440178 28043 raft_consensus.cc:2955] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.441633 28059 raft_consensus.cc:1081] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:44.443415 26510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:09:44.443966 26510 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:44.444303 26510 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.445763 27273 raft_consensus.cc:2955] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.444698 26507 raft_consensus.cc:2955] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.460333 26656 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:44.466243 26656 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:44.462821 26510 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:44.467252 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:44.467809 26503 raft_consensus.cc:3055] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:44.467957 26510 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:44.468125 26503 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:44.469146 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:44.468861 26503 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:44.469714 26576 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.470417 26503 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.474790 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:44.474231 26579 raft_consensus.cc:2955] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.475327 26651 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.476415 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:44.476967 26582 raft_consensus.cc:3055] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:44.477233 26582 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:44.477927 26582 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:44.478957 26582 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.484692 26651 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:44.487522 26503 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:44.488570 26622 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:44.489645 26474 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:44.490552 28131 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:44.490718 28104 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:44.491148 28131 raft_consensus.cc:697] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:44.491384 28104 raft_consensus.cc:697] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:44.492101 28131 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:44.492317 28104 consensus_queue.cc:237] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:44.494118 26576 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:44.497455 26582 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:44.515599 26656 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:44.522657 26582 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:44.523991 28170 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:44.524890 27273 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:44.526429 28170 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:44.533614 26404 catalog_manager.cc:5697] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.534482 28064 raft_consensus.cc:2955] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.542833 27273 raft_consensus.cc:2955] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.545575 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bbeed79ff32c46018128de0f6b9a3514 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:44.548334 26582 raft_consensus.cc:2955] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.556031 26402 catalog_manager.cc:5697] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.578579 26404 catalog_manager.cc:5697] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.582455 26401 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 2 to 3, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.595463 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet bbeed79ff32c46018128de0f6b9a3514 with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:44.600307 26405 catalog_manager.cc:5697] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 3, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.603231 26651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:44.603809 26651 raft_consensus.cc:606] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:09:44.606184 28064 raft_consensus.cc:993] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:44.606963 28064 raft_consensus.cc:1081] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:44.607388 26651 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:44.612816 26576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:44.613376 26576 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:44.613730 26576 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.616998 27273 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:44.618739 26651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:44.618474 28131 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:44.619163 26577 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:44.619285 26651 raft_consensus.cc:606] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:09:44.622408 26393 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for a7aaf3bb8d83488a81bc031ffda595a5 already in progress [suppressed 2 similar messages]
I20260709 13:09:44.622676 28196 tablet_replica.cc:333] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:09:44.622467 26576 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:44.622861 28131 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:44.623802 28196 raft_consensus.cc:2243] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.626142 28196 raft_consensus.cc:2272] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.632279 28196 ts_tablet_manager.cc:1916] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:44.631587 28064 raft_consensus.cc:2955] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.637473 26582 raft_consensus.cc:2955] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.638266 27273 raft_consensus.cc:2955] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.642204 26576 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:44.643582 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:44.644172 26651 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:44.644472 26651 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:44.645375 26651 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:44.646610 26651 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.649394 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:44.649986 26510 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.651530 28196 ts_tablet_manager.cc:1929] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:44.652060 28196 log.cc:1199] T bbeed79ff32c46018128de0f6b9a3514 P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/bbeed79ff32c46018128de0f6b9a3514
I20260709 13:09:44.653723 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet bbeed79ff32c46018128de0f6b9a3514 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:44.656131 26651 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:44.660271 26549 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:44.661203 28088 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:44.660969 26401 catalog_manager.cc:5697] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 3 to 4, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.661765 28088 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:44.657331 26510 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:44.662981 28088 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:44.664980 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f54605dc5ec04452908dd0efd01fbcaf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:44.665789 26651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:44.666383 26651 raft_consensus.cc:606] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:09:44.674165 26456 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:09:44.674649 26456 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for a7aaf3bb8d83488a81bc031ffda595a5 already in progress
W20260709 13:09:44.674979 26456 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for a7aaf3bb8d83488a81bc031ffda595a5 already in progress
I20260709 13:09:44.674937 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet f54605dc5ec04452908dd0efd01fbcaf with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59074
I20260709 13:09:44.678104 28196 tablet_replica.cc:333] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:09:44.679219 28196 raft_consensus.cc:2243] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.679930 28196 raft_consensus.cc:2272] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.680655 26405 catalog_manager.cc:5697] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.684131 28196 ts_tablet_manager.cc:1916] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:44.686785 28170 raft_consensus.cc:1064] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:44.697671 28170 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:44.703970 28196 ts_tablet_manager.cc:1929] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:44.705869 28196 log.cc:1199] T f54605dc5ec04452908dd0efd01fbcaf P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/f54605dc5ec04452908dd0efd01fbcaf
I20260709 13:09:44.707644 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet f54605dc5ec04452908dd0efd01fbcaf (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:44.714962 26576 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:44.715555 26503 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:44.715894 27273 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:44.717490 28131 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.718514 28170 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.719311 28043 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.741387 28131 raft_consensus.cc:2955] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.745368 26503 raft_consensus.cc:2955] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.754873 26576 raft_consensus.cc:2955] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.777724 27273 raft_consensus.cc:2955] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.796352 26405 catalog_manager.cc:5697] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.841404 26576 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:44.843153 28049 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:44.847295 26656 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:44.882524 26503 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:44.883425 26507 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:44.883934 28131 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:44.885588 28186 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:44.886225 27276 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:44.906046 26507 raft_consensus.cc:2955] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.910262 28131 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:09:44.912577 27276 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Advancing to term 3
I20260709 13:09:44.901206 28170 raft_consensus.cc:2955] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.929065 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 479f20ff71c04b8ea8eea5b4f8c922ff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:44.928921 26576 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:44.925546 27273 raft_consensus.cc:2955] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:44.932331 28131 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:44.943493 26576 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:44.945552 27276 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:44.945950 28168 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.949223 28170 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:44.967043 26502 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:44.981539 28064 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:44.987725 28064 raft_consensus.cc:993] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:44.988243 28131 raft_consensus.cc:1081] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:44.990480 26579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:44.991010 26579 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:44.991370 26579 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.021333 26405 catalog_manager.cc:5697] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 3 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 1 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.056871 26651 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:44.999836 26579 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:45.061267 28104 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:45.062426 26583 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:45.064571 26579 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:45.066368 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:45.072811 28043 consensus_queue.cc:1059] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:45.074290 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:45.087827 28043 raft_consensus.cc:1064] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:45.088219 26651 raft_consensus.cc:3055] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:45.089134 26651 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:45.090267 26651 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:45.092097 26651 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.098371 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet 479f20ff71c04b8ea8eea5b4f8c922ff with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36124
I20260709 13:09:45.108979 28217 tablet_replica.cc:333] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:09:45.112347 28217 raft_consensus.cc:2243] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.142994 26656 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:45.148366 28217 raft_consensus.cc:2272] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.149005 28088 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:45.147511 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43799.8us
I20260709 13:09:45.155226 26651 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
W20260709 13:09:45.158041 28170 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:09:45.158409 28217 ts_tablet_manager.cc:1916] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:09:45.161140 28043 raft_consensus.cc:1068] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: Unable to promote non-voter b1f40e8672c549d3b4be7862ac07b7e2: Illegal state: Replica af1b5d6d444447b7a580afb4aff33320 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:45.163563 28131 raft_consensus.cc:1064] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
W20260709 13:09:45.164645 28131 raft_consensus.cc:1068] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: Unable to promote non-voter b1f40e8672c549d3b4be7862ac07b7e2: Illegal state: Replica af1b5d6d444447b7a580afb4aff33320 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:45.171595 26510 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:45.173156 28088 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:45.174790 26549 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:45.175839 28059 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:45.176261 28059 raft_consensus.cc:697] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:45.177006 28059 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:45.194877 28217 ts_tablet_manager.cc:1929] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:45.195439 28217 log.cc:1199] T 479f20ff71c04b8ea8eea5b4f8c922ff P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/479f20ff71c04b8ea8eea5b4f8c922ff
I20260709 13:09:45.197693 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet 479f20ff71c04b8ea8eea5b4f8c922ff (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:45.202114 26402 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 4, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 4 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.327807 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:45.667196 26651 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:45.668417 28059 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:45.681798 27276 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEARNER]: Advancing to term 4
I20260709 13:09:45.683197 26510 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.688575 27276 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEARNER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:45.689994 26510 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:45.690155 28088 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:45.691347 28088 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:45.734544 28088 raft_consensus.cc:1064] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:45.737195 28088 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:45.743391 27278 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEARNER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:45.743503 26651 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:45.744549 26510 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:45.744814 28151 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:45.747048 28151 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:45.747960 28088 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:45.758894 28059 raft_consensus.cc:2955] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:45.765882 27278 raft_consensus.cc:2955] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:45.767983 26651 raft_consensus.cc:2955] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:45.771196 26510 raft_consensus.cc:2955] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:45.781026 26405 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 3 to 6, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.815415 26579 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:45.820843 27278 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:45.821319 26510 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:45.822324 28088 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:45.823122 28151 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:45.829232 28088 raft_consensus.cc:2955] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:45.830833 26510 raft_consensus.cc:2955] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:45.837291 26395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a7aaf3bb8d83488a81bc031ffda595a5 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:45.845747 26401 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 6 to 7, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 4 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.849411 27278 raft_consensus.cc:2955] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:45.855967 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet a7aaf3bb8d83488a81bc031ffda595a5 with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:54880
I20260709 13:09:45.866364 28235 tablet_replica.cc:333] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:09:45.867775 28235 raft_consensus.cc:2243] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.868636 28235 raft_consensus.cc:2272] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.872882 28235 ts_tablet_manager.cc:1916] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:45.878142 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:45.889642 28235 ts_tablet_manager.cc:1929] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:09:45.890292 28235 log.cc:1199] T a7aaf3bb8d83488a81bc031ffda595a5 P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/a7aaf3bb8d83488a81bc031ffda595a5
I20260709 13:09:45.893651 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet a7aaf3bb8d83488a81bc031ffda595a5 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:09:45.932196 26583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "108a6730154b42819badee4f37f31ad8"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:45.932737 26583 raft_consensus.cc:606] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:45.935176 26651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:45.935588 26651 raft_consensus.cc:606] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:45.938979 26583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:45.939551 26583 raft_consensus.cc:606] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:45.941974 26507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:45.942512 26507 raft_consensus.cc:606] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:45.943864 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:45.945472 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:45.977980 28131 raft_consensus.cc:993] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:45.978521 28230 raft_consensus.cc:1081] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:09:45.980055 27278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:09:45.980487 27278 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:45.980715 27278 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.985452 27278 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:45.987815 27278 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:45.989038 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:45.989720 26657 raft_consensus.cc:3055] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:45.989761 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:45.990083 26657 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:45.990396 26507 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.990845 26657 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:45.991797 26657 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.999102 26657 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:45.999454 26507 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:46.000099 27241 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:09:46.000864 28135 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.001369 28135 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:46.002120 28135 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:46.010739 26401 catalog_manager.cc:5697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:46.105520 28104 raft_consensus.cc:993] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:46.106004 28214 raft_consensus.cc:1081] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:46.107502 26657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54892
I20260709 13:09:46.108033 26657 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:46.108354 26657 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.113265 26657 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:46.115130 26657 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:46.116132 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:46.116490 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:46.116823 26583 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.117146 26507 raft_consensus.cc:3055] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.117484 26507 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:46.118515 26507 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:46.119978 26507 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.125525 26583 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:46.126118 26507 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:46.126858 26625 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:46.127753 28230 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.128309 28230 raft_consensus.cc:697] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:46.129282 28230 consensus_queue.cc:237] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:46.142083 26401 catalog_manager.cc:5697] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:46.205884 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 108a6730154b42819badee4f37f31ad8: Remote error: Service unavailable: leader transfer in progress
I20260709 13:09:46.209919 26651 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
W20260709 13:09:46.215561 26622 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 574d2707e806420dab53495563bd03aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.216499 26583 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:46.217278 26510 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:46.217823 28170 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:46.218701 28230 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:46.227607 28230 raft_consensus.cc:2955] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.230018 26583 raft_consensus.cc:2955] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.230351 26510 raft_consensus.cc:2955] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.247611 26579 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:46.249364 26401 catalog_manager.cc:5697] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 3, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:46.267539 26548 consensus_peers.cc:597] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 057c1e97d7fb407aaf9cf119a0b63a37. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.268945 26651 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:46.269580 26510 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:46.270840 28231 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.271755 28151 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.283521 28059 raft_consensus.cc:2955] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.287235 26510 raft_consensus.cc:2955] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.290541 26651 raft_consensus.cc:2955] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.299117 26583 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:46.308506 26651 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:46.307880 26404 catalog_manager.cc:5697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 2, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.310683 28059 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:09:46.313442 26548 consensus_peers.cc:597] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01228e22d88047b6bc2f5a6b74aa2b51. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.313880 26510 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:46.316471 28059 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:09:46.328898 26657 raft_consensus.cc:2955] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.328729 28059 raft_consensus.cc:2955] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.341213 26510 raft_consensus.cc:2955] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.344650 26401 catalog_manager.cc:5697] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 4, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:09:46.367672 28231 raft_consensus.cc:993] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:46.368211 28231 raft_consensus.cc:1081] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:46.370337 26657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "108a6730154b42819badee4f37f31ad8"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54888
I20260709 13:09:46.370872 26657 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:46.371192 26657 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.377825 26657 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:46.379726 26657 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:46.381107 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:46.381199 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:46.381738 26583 raft_consensus.cc:3055] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.382083 26583 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:46.382416 26510 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.382833 26583 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:46.384047 26583 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.390436 26583 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:46.391647 26625 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:46.392500 28230 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.393007 28230 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:46.393922 28230 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:46.396943 26510 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:46.410162 26402 catalog_manager.cc:5697] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:46.418589 28088 raft_consensus.cc:993] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:46.419124 28059 raft_consensus.cc:1081] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:46.420697 26510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:09:46.421234 26510 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:46.421773 26510 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.426740 26510 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:46.428825 26510 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:46.429350 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:46.429353 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:46.430032 27276 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.430095 26583 raft_consensus.cc:3055] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.430609 26583 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:46.431429 26583 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:46.432407 26583 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.441036 27276 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:46.447016 26473 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:46.448395 28214 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.449286 28214 raft_consensus.cc:697] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:46.450230 26503 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:46.450196 28214 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:46.466444 28224 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:47.416479 26474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.000s	sys 0.008s
W20260709 13:09:47.416819 26474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.000s	sys 0.008s
W20260709 13:09:47.417171 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 946974us
I20260709 13:09:47.444468 28256 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:47.445190 28256 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.447898 28256 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:09:47.474177 26583 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.041s	user 0.013s	sys 0.009s
I20260709 13:09:47.475131 26583 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:47.475754 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1390) took 1047 ms. Trace:
I20260709 13:09:47.476176 26583 rpcz_store.cc:276] 0709 13:09:46.428704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.429120 (+   416us) service_pool.cc:224] Handling call
0709 13:09:47.475670 (+1046550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:47.510169 28259 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:47.511044 28259 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.514534 28259 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.518554 28256 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.519134 28256 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.521139 28256 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.522323 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:47.523159 28252 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.523682 28252 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.526669 28252 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.527868 28253 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:47.528509 28253 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.529412 28252 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:47.530141 28252 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.530725 28253 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.532521 28252 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.533241 28252 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.533959 28252 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.535966 28252 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:47.539151 28263 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.539710 28263 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.541988 28263 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.542455 28262 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.542946 28262 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.554102 28262 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.555308 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:47.557026 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2161) took 1084 ms. Trace:
I20260709 13:09:47.560686 26651 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:47.560822 26579 rpcz_store.cc:276] 0709 13:09:46.473191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.556293 (+1083102us) service_pool.cc:224] Handling call
0709 13:09:47.556563 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.556730 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.556756 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.556795 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:47.556838 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.556886 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.556975 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:47.557613 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:47.558576 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:47.564989 28264 ts_tablet_manager.cc:933] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.565678 28263 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.566462 28263 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.570124 28263 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:47.572896 26473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.016s	sys 0.006s
I20260709 13:09:47.574833 28263 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.575443 28263 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:47.577791 26473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.016s	sys 0.007s
I20260709 13:09:47.595662 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:47.598803 26401 catalog_manager.cc:5697] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.626639 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:47.593798 28264 tablet_copy_client.cc:323] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:09:47.582167 28253 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.591042 28263 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:47.633729 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 47580.6us
I20260709 13:09:47.597211 28259 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.597776 28257 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:47.606271 28256 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.626024 28262 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.643672 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:47.649525 28261 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:47.651813 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 574d2707e806420dab53495563bd03aa from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:09:47.652562 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 574d2707e806420dab53495563bd03aa from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-574d2707e806420dab53495563bd03aa
I20260709 13:09:47.671622 28252 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.672235 28252 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.674381 28252 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:47.682180 26669 tablet_copy_source_session.cc:215] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:47.636582 28253 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.639698 28259 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.694378 28259 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.654518 28256 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.655195 28262 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.696797 28256 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.697650 28262 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.640192 28257 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.698850 28253 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.682615 28265 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.700090 28257 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.699859 28265 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.702018 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:09:47.692106 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 57367.2us
I20260709 13:09:47.766441 28271 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.762670 28257 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:09:47.758245 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50210.7us
I20260709 13:09:47.766258 28262 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.765399 28264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574d2707e806420dab53495563bd03aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.766060 28266 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.768277 28262 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.771129 28262 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.769042 28266 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.713007 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:47.768137 28257 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.774319 28266 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.767382 28271 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.775974 28257 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.776711 28271 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.758073 28259 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.777711 28259 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.779749 28259 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:47.781798 28272 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.782397 28272 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.784808 28272 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.702118 28265 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.713243 28261 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.787830 28261 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.791512 28259 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.792078 28259 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:47.795526 28259 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:47.795995 28265 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.799646 28265 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.801779 28265 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.732340 28276 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.818019 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.827111 26579 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:47.732625 28256 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.809028 28214 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:47.809873 28272 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.810438 28273 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.811586 28258 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.811718 28257 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.814352 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.840471 26583 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:09:47.814796 28275 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.814940 28259 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.815229 28261 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:47.815822 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.815997 28250 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.816817 26582 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.819479 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:47.819981 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:47.834829 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:47.853749 28275 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.854259 28257 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.855314 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:47.856074 28275 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.712316 28253 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.847892 28279 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.814934 28251 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.831220 28252 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.866918 28253 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.867215 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:47.866951 28255 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.867887 28279 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.841346 28265 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.857465 28271 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.901858 26576 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.841943 28256 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.840117 28214 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.858136 28259 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.898617 28261 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.835902 28276 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.841995 28272 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:47.904520 28257 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.904420 28266 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:47.860261 28250 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.888338 28252 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.899690 28255 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:47.926839 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.927148 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.900049 28265 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.850368 28273 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.930080 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.935901 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.939395 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.941772 28282 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:47.943041 28214 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.943233 28256 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.933516 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:47.846102 28258 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.949247 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.952042 27278 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:47.934703 28257 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.953400 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:47.905143 28271 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.954874 26503 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.918282 28254 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.944278 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:47.961025 28272 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.975884 28265 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.976328 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:47.976733 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:47.977612 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:47.977902 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:47.970783 28252 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:47.978863 28252 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:47.979379 28252 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.979826 28279 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.935393 28266 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:47.972121 28277 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:47.972283 28259 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:47.941300 28255 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:47.973922 28276 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.882465 28251 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.916432 28261 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:47.981930 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.971740 28250 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:47.970144 28258 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:48.042153 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.987294 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.002220 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.011650 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.013180 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.018321 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.973815 26581 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:47.990329 28252 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:48.026855 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.041188 28296 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:48.024978 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:47.973326 28271 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:48.046934 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:47.982771 26507 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.020066 28279 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:48.025964 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.114579 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.115207 26577 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
W20260709 13:09:48.119179 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 288748us
I20260709 13:09:47.956830 28282 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:48.124711 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.126039 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:47.990681 28257 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:48.017187 28254 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:48.138407 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.140987 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.141903 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.149861 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.153365 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.154358 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:48.154568 28294 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:09:48.155349 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.156170 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.156378 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.157600 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.155375 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.159121 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.159713 26656 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:48.159778 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:48.161041 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.162329 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.134961 27271 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:48.083961 28277 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:48.176671 26476 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.177804 28278 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:48.178501 28289 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:48.136575 28279 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:48.179054 28289 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:48.192032 28293 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:48.192950 28255 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:48.124861 28296 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:48.197105 28255 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:48.192951 28288 ts_tablet_manager.cc:933] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:48.161273 28253 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:48.192600 28293 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:48.214831 28273 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:48.216399 28261 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
W20260709 13:09:48.280314 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 235327us
I20260709 13:09:48.216976 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.287791 26476 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.286319 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.289212 28255 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:48.340950 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 53227.6us
W20260709 13:09:48.348116 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 54943us
I20260709 13:09:48.353101 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.353346 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.354283 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:09:48.340181 28264 consensus_meta.cc:287] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.025s
I20260709 13:09:48.365726 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.365983 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.367063 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.368213 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.369649 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.374730 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.376016 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.499003 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.417140 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.499570 28293 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:48.505687 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:48.512988 28304 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:48.513052 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 85905.3us
I20260709 13:09:48.502954 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:48.486346 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 117650us
I20260709 13:09:48.515075 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:48.516799 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.415144 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:48.507463 27299 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4a60 after lost signal to thread 25398
I20260709 13:09:48.420181 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.518411 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:48.397979 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.417651 28257 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:48.407349 28299 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:48.407044 28282 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:48.376293 28251 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:48.371472 28278 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.519583 27274 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:48.396833 28266 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:48.523218 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 76772.2us
I20260709 13:09:48.494482 28289 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:48.492712 28296 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:48.404217 28280 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:48.523970 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.520872 28299 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.525045 28299 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:48.519582 27299 debug-util.cc:398] Leaking SignalData structure 0x7b080026d120 after lost signal to thread 26442
I20260709 13:09:48.525058 28293 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.525285 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.404709 28264 tablet_copy_client.cc:806] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:48.508948 28286 ts_tablet_manager.cc:933] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:48.493202 28302 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:48.417719 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.415714 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.414873 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:48.497171 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 334436us
I20260709 13:09:48.397472 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.372869 28277 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:48.421952 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:09:48.526773 27299 debug-util.cc:398] Leaking SignalData structure 0x7b0800365780 after lost signal to thread 26534
I20260709 13:09:48.526959 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.527168 28255 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.528069 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.527760 26473 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:48.486408 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 137388us
I20260709 13:09:48.418143 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.415616 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.533865 26625 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.395241 28254 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:48.486541 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 199059us
I20260709 13:09:48.400400 28279 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:48.397289 28288 tablet_copy_client.cc:323] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.194:33025
I20260709 13:09:48.535934 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:48.580066 27243 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:48.574923 26625 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.578742 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.541484 28264 tablet_copy_client.cc:670] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:48.582073 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.586263 26473 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.586122 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:48.407567 28297 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.207s
I20260709 13:09:48.588495 27243 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:48.588366 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:48.578079 28280 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.577418 28289 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.612828 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.613216 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.614277 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.602939 26625 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.616087 28300 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.621970 26473 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.622627 28298 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:09:48.624671 28287 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.625312 28250 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:48.624701 28267 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.628724 28300 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.629593 28313 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.630081 28313 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:48.630555 28313 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:48.636888 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 48470.2us
I20260709 13:09:48.590431 28259 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.610702 28296 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:48.640074 27299 debug-util.cc:398] Leaking SignalData structure 0x7b080037a340 after lost signal to thread 26609
I20260709 13:09:48.645982 28309 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:48.621423 28273 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.646736 28265 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.620976 28263 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.642169 28298 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:48.655120 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 52266.6us
I20260709 13:09:48.645263 28286 tablet_copy_client.cc:323] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.194:33025
I20260709 13:09:48.542328 28302 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:48.658267 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.667253 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.679150 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.666252 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.682740 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.689996 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:48.668569 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.695350 26474 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.696885 26474 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:48.700034 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 88811.4us
I20260709 13:09:48.693580 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:48.702616 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 64562us
I20260709 13:09:48.701426 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.678349 28296 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:48.711895 26622 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.656270 28309 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:48.716188 26474 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.719529 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:09:48.718622 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 121292us
W20260709 13:09:48.703408 27299 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed2e0 after lost signal to thread 26683
I20260709 13:09:48.698529 28297 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:48.699842 28280 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.658088 28265 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:48.700910 28278 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.726750 26622 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.657096 28273 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:48.726325 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.730916 28306 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.659881 28263 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:48.721210 28252 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.723483 28259 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.723856 28287 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.724177 28309 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.741173 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.742381 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.743211 27240 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.744246 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.740682 28319 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.751801 28253 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.724342 26584 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:09:48.733458 28278 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:48.756891 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.759334 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.759354 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.761232 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.762037 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.763080 27240 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:48.763441 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:48.768633 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 151856us
I20260709 13:09:48.776986 26625 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:48.755584 28259 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:48.765224 28264 tablet_copy_client.cc:538] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:48.779142 28292 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.781391 28253 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.784058 28295 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.778622 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:48.785413 28265 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:48.785815 28306 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.764493 28278 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:48.772907 27299 debug-util.cc:398] Leaking SignalData structure 0x7b0800377a00 after lost signal to thread 27302
I20260709 13:09:48.791105 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.794976 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:48.799794 26595 tablet_copy_service.cc:140] P ef2886777a8f45e69e213b02a22ecec7: Received BeginTabletCopySession request for tablet 057c1e97d7fb407aaf9cf119a0b63a37 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39940)
I20260709 13:09:48.810637 26594 tablet_copy_service.cc:140] P ef2886777a8f45e69e213b02a22ecec7: Received BeginTabletCopySession request for tablet 01228e22d88047b6bc2f5a6b74aa2b51 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39940)
I20260709 13:09:48.815366 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:48.793329 28253 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:48.818039 26401 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34738 (request call id 284) took 1227 ms. Trace:
I20260709 13:09:48.820022 26473 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:48.819183 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:09:48.823305 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 89839.9us
I20260709 13:09:48.808670 26595 tablet_copy_service.cc:161] P ef2886777a8f45e69e213b02a22ecec7: Beginning new tablet copy session on tablet 057c1e97d7fb407aaf9cf119a0b63a37 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39940: session id = b1f40e8672c549d3b4be7862ac07b7e2-057c1e97d7fb407aaf9cf119a0b63a37
I20260709 13:09:48.818879 28257 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.818959 28253 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.829416 28308 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.828778 26594 tablet_copy_service.cc:161] P ef2886777a8f45e69e213b02a22ecec7: Beginning new tablet copy session on tablet 01228e22d88047b6bc2f5a6b74aa2b51 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39940: session id = b1f40e8672c549d3b4be7862ac07b7e2-01228e22d88047b6bc2f5a6b74aa2b51
I20260709 13:09:48.824728 28275 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.840462 27243 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:48.844228 28318 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.849887 28273 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:48.852046 28320 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.864970 26595 tablet_copy_source_session.cc:215] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:48.857470 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:48.841936 28308 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:48.868227 28308 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.818464 26401 rpcz_store.cc:276] 0709 13:09:47.587956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.588274 (+   318us) service_pool.cc:224] Handling call
0709 13:09:48.815422 (+1227148us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:47.679350 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:47.680264 (+   914us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:47.680318 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:09:47.680349 (+    31us) tablet.cc:662] Decoding operations
0709 13:09:47.680842 (+   493us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:47.680961 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:47.681010 (+    49us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:47.681292 (+   282us) tablet.cc:701] Row locks acquired
0709 13:09:47.681321 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:09:47.816001 (+134680us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b2c00000448. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882b222a11 00007f882b231a0a 00007f882b231693 00007f882b231631 00007f882c964902 00007f882c9646dd 00007f883035f243 00007f883035ed58 00007f88303639f1 00007f88303639a9 00007f8830363939
0709 13:09:47.816064 (+    63us) write_op.cc:270] Start()
0709 13:09:47.836162 (+ 20098us) write_op.cc:276] Timestamp: P: 1783602587687347 usec, L: 0
0709 13:09:47.836205 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:09:47.918541 (+ 82336us) log.cc:844] Serialized 539 byte log entry
0709 13:09:48.500748 (+582207us) op_driver.cc:464] REPLICATION: finished
0709 13:09:48.647006 (+146258us) write_op.cc:301] APPLY: starting
0709 13:09:48.647123 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:48.647267 (+   144us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:48.647303 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:48.647621 (+   318us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:48.647879 (+   258us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:48.647957 (+    78us) write_op.cc:312] APPLY: finished
0709 13:09:48.678916 (+ 30959us) log.cc:844] Serialized 23 byte log entry
0709 13:09:48.698476 (+ 19560us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:48.700605 (+  2129us) write_op.cc:454] Released schema lock
0709 13:09:48.701907 (+  1302us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:48.737830 (+ 35923us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:48.739111 (+  1281us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":142332,"apply.run_cpu_time_us":2358,"apply.run_wall_time_us":83264,"num_ops":1,"prepare.queue_time_us":68840,"prepare.run_cpu_time_us":15355,"prepare.run_wall_time_us":348481,"raft.queue_time_us":214866,"raft.run_cpu_time_us":33136,"raft.run_wall_time_us":206272,"replication_time_us":591248,"spinlock_wait_cycles":13522176,"thread_start_us":337169,"threads_started":4,"wal-append.queue_time_us":92628}]]}
W20260709 13:09:48.875922 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 56802.9us
I20260709 13:09:48.878722 28302 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:48.879230 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 77740.2us
I20260709 13:09:48.888450 26549 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:48.889801 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:48.890480 26504 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
W20260709 13:09:48.961975 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 73573.3us
I20260709 13:09:48.964653 26549 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:48.978890 26549 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:48.979984 28283 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.980233 26549 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:49.010742 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:49.010648 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43862.7us
I20260709 13:09:49.010479 26549 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:49.025198 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.002954 28279 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.031761 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:48.896104 28313 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.035845 28310 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.037509 28310 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.042021 26549 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:49.011981 28265 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.053007 26549 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:49.056747 27278 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:49.033285 28295 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:49.119585 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 66642.1us
I20260709 13:09:49.143246 26549 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:49.060083 28279 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:49.142969 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 91911.5us
I20260709 13:09:49.061607 28276 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:48.982712 28299 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:49.147441 28316 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.012025 28309 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.148561 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:09:49.154764 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 124591us
I20260709 13:09:49.156586 26549 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:49.117103 28261 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:49.156586 26548 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:49.161013 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:49.160001 26549 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:49.144572 28295 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:49.164683 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:49.165299 26502 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:49.160286 28331 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.159538 28283 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:49.174352 28329 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:09:49.175272 26548 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:49.159550 28266 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.161856 28261 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.164022 28279 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:49.187984 28333 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.248601 28333 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:49.249182 28333 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.172737 28334 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:49.244046 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 68873.7us
I20260709 13:09:49.247855 28261 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:49.157265 28276 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.224321 28313 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:49.277819 28327 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.280308 28264 tablet_bootstrap.cc:492] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:49.225136 28295 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.300380 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:49.258400 28253 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:49.258733 28278 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:49.306022 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:49.299944 28288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057c1e97d7fb407aaf9cf119a0b63a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.310374 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:49.324455 26657 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:49.328629 28309 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:49.330153 28299 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:49.335881 26505 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:49.318636 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 154788us
I20260709 13:09:49.352734 28309 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:49.357296 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:49.358026 26578 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:49.353525 28309 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.370139 28278 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:49.363529 28320 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:49.387776 28320 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.390357 28343 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:49.371883 26594 tablet_copy_source_session.cc:215] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:49.391816 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:49.390882 28343 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.400100 28253 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:49.403281 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:49.407240 28276 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:49.405710 28253 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:49.434849 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:49.436235 28295 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:49.447144 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.449247 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.451360 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:49.431013 28317 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.431602 28299 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:49.459352 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:49.434154 28253 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:49.469636 28263 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:49.470597 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:49.474180 28343 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:49.474579 28286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01228e22d88047b6bc2f5a6b74aa2b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.472885 28253 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.505628 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.503381 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:49.519394 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.473083 28299 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.543380 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.547626 28309 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:49.548947 28340 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:09:49.541826 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 88891.2us
I20260709 13:09:49.553637 26622 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:49.550979 28333 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:49.555684 28308 consensus_meta.cc:287] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.004s
I20260709 13:09:49.511826 28287 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:49.563625 28299 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:49.565493 28299 consensus_queue.cc:1059] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.566540 28299 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.561116 28336 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:49.566879 28299 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:49.574533 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.568095 28299 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:49.567688 28336 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:49.560178 28341 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:49.587559 28289 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.588143 28341 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:49.593086 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:49.597280 28279 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:49.556102 28308 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.597889 28279 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.609503 28279 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:49.609606 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:49.610291 26502 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:49.621670 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.617094 28336 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:49.622511 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.622670 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.623994 26584 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:49.627381 28320 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:49.628508 26502 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:49.630182 26577 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:49.632149 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:49.631769 26548 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:09:49.636874 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 207429us
I20260709 13:09:49.568629 28287 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:49.643591 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:49.622764 28266 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:49.649519 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:49.649902 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:49.650345 28301 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.627566 28306 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:49.651618 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.652266 28266 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.647800 28327 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:49.661839 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:49.662657 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:49.668793 26622 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:49.671747 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 127855us
I20260709 13:09:49.658692 28316 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.640820 28341 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:49.678637 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:49.658054 28327 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.636042 28277 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:09:49.666229 28306 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.686100 26476 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:49.676666 28302 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:49.693327 28308 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:49.693919 27275 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:49.695041 28277 raft_consensus.cc:3055] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.695326 28277 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:49.695847 28277 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:49.696672 28277 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.684008 28252 consensus_queue.cc:1059] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:49.700578 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:49.704811 27240 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:49.678201 28336 consensus_queue.cc:1059] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:09:49.689724 28256 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.707484 28320 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.691759 28282 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:49.715868 28288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:34964 (request call id 228) took 1896 ms. Trace:
I20260709 13:09:49.715638 28282 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.717864 28266 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:49.718825 28282 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:49.712464 28256 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:49.719583 28256 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.720386 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:49.699309 28316 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:49.722894 28316 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:49.731037 28287 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:49.731106 28327 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:49.720274 28288 rpcz_store.cc:276] 0709 13:09:47.819359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.819887 (+   528us) service_pool.cc:224] Handling call
0709 13:09:48.200880 (+380993us) ts_tablet_manager.cc:934] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
0709 13:09:49.029725 (+828845us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:49.557096 (+527371us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:49.568483 (+ 11387us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:49.710937 (+142454us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:49.714142 (+  3205us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:49.715711 (+  1569us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:49.715779 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":15312,"tablet-copy.queue_time_us":131723,"thread_start_us":242675,"threads_started":2}
I20260709 13:09:49.731382 28302 raft_consensus.cc:3055] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:49.738533 28302 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:49.738791 28333 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:49.740075 28302 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:49.741945 28299 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.742729 28302 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:49.806679 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 122839us
W20260709 13:09:49.805508 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 118379us
I20260709 13:09:49.802556 26402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34762 (request call id 306) took 1038 ms. Trace:
I20260709 13:09:49.811605 26476 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:49.812263 26402 rpcz_store.cc:276] 0709 13:09:48.763908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.764022 (+   114us) service_pool.cc:224] Handling call
0709 13:09:49.492851 (+728829us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b54002eff90. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829805640 00007f88326dcb76 00007f88327e6c3e 00007f8830ca72a4 00007f8830ca7232 00007f8830ca7161 00007f8830ca70dc 00007f8830ca6392 00007f882ac6448c 00007f882ac638c6
0709 13:09:49.802037 (+309186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46836,"reported_tablets":1,"spinlock_wait_cycles":13840768}
I20260709 13:09:49.819332 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:49.822793 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:49.822726 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:49.827118 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:49.828933 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:49.830523 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:49.832013 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:49.841396 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:49.843986 26505 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:49.845002 26622 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:49.829187 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:49.846156 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:49.859586 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:49.863356 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.863700 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.867920 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.870781 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:49.892524 28255 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:49.896673 27241 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:49.899336 28214 consensus_queue.cc:1059] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:49.899981 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:49.908994 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.909682 28309 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:49.915462 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:49.914256 28257 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.924166 28272 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.926703 28275 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.927774 28275 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:49.929512 28273 raft_consensus.cc:3055] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.930074 28273 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:49.930317 28287 raft_consensus.cc:3055] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.930792 28287 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:49.931365 28273 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.932102 28287 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.900580 28317 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 13:09:49.943054 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 46827.6us
W20260709 13:09:49.944013 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 78905.3us
I20260709 13:09:49.948874 28258 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.949764 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:49.951114 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:49.959811 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:49.961273 28343 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.964015 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:49.964640 28272 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:49.965253 28272 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:49.966648 28272 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:49.968503 28273 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.968693 28272 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.978713 27243 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:49.980672 28318 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:49.985951 28288 tablet_copy_client.cc:806] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:49.986945 28288 tablet_copy_client.cc:670] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:49.993511 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:49.997488 26476 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:49.947851 28319 raft_consensus.cc:3055] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:50.001893 28280 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:50.002331 28319 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:50.003158 26476 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:50.004022 28319 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:50.006021 28257 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:50.008550 28214 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.025553 27243 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:50.034971 28256 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:50.038106 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 45733.6us
I20260709 13:09:50.041103 28319 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.047267 28320 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:50.050417 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 61305.9us
I20260709 13:09:50.060918 28287 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.067814 26509 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:50.082203 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:50.084630 28253 consensus_meta.cc:287] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.008s
I20260709 13:09:50.087703 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:50.088302 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:50.088562 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:50.090701 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:50.101819 28280 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.120813 28286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:34964 (request call id 230) took 2299 ms. Trace:
I20260709 13:09:50.121436 28253 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:50.142274 27243 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:50.156391 28276 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:09:50.156605 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 97068.5us
I20260709 13:09:50.163061 28253 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:50.164829 28253 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:50.166538 28354 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:50.166922 28354 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:50.167948 28354 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:50.169248 28354 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.169842 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:50.171188 26658 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:50.177984 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 110704us
I20260709 13:09:50.184966 28280 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:50.188190 28280 raft_consensus.cc:3055] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:50.188558 28280 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:50.188835 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:50.189635 28280 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:50.191160 28280 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:50.202257 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 44822.8us
I20260709 13:09:50.176045 28256 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:50.229992 27243 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:50.231315 28320 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.246310 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:50.251076 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:50.260948 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:50.263567 28320 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.150036 28286 rpcz_store.cc:276] 0709 13:09:47.820922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.821397 (+   475us) service_pool.cc:224] Handling call
0709 13:09:48.508504 (+687107us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800161a98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f88298051a2 00007f8832746bb9 00007f8831877d88 00007f883193ba07 00007f883196df4e 00007f8831952fdd 00007f8831952f89 00007f8831952f19 00007f8831952ee1
0709 13:09:48.539579 (+ 31075us) ts_tablet_manager.cc:934] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
0709 13:09:49.467658 (+928079us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:49.684055 (+216397us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:49.684196 (+   141us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:50.092382 (+408186us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:50.092919 (+   537us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:50.093286 (+   367us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:50.120571 (+ 27285us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":23761,"spinlock_wait_cycles":27764096,"tablet-copy.queue_time_us":151855,"thread_start_us":166060,"threads_started":2}
I20260709 13:09:50.264384 26508 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:50.277837 28286 tablet_copy_client.cc:806] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:50.278781 28286 tablet_copy_client.cc:670] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:50.283421 28264 tablet_bootstrap.cc:492] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.284842 28264 tablet_bootstrap.cc:492] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
W20260709 13:09:50.301473 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 86400.8us
I20260709 13:09:50.302652 28316 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.305289 26622 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:50.306249 28255 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.306654 28264 ts_tablet_manager.cc:1403] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 1.027s	user 0.022s	sys 0.022s
I20260709 13:09:50.306826 28255 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:50.308137 28255 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:50.310077 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:50.327119 26656 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:50.329713 26474 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:50.333050 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:50.333279 26508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:40352
I20260709 13:09:50.333963 28316 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.334246 26508 raft_consensus.cc:606] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:50.334717 26508 raft_consensus.cc:614] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:50.335201 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:50.336707 28299 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:50.337266 28299 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:50.338165 28299 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:50.342278 28288 tablet_copy_client.cc:538] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:50.345952 28286 tablet_copy_client.cc:538] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:50.347179 26656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:50.347916 26656 raft_consensus.cc:606] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:50.348529 26506 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:50.349960 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:50.351522 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:50.352638 28255 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.353226 28255 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:50.354189 28255 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:50.359519 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:50.360044 28264 raft_consensus.cc:359] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:50.361100 28264 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
W20260709 13:09:50.381964 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 107175us
W20260709 13:09:50.382972 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 47870.8us
I20260709 13:09:50.383783 26548 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:50.393564 28327 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.394984 28264 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:50.378906 28316 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.400578 28264 ts_tablet_manager.cc:1434] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.001s
I20260709 13:09:50.412636 26401 catalog_manager.cc:5697] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.414541 26401 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.417300 26405 catalog_manager.cc:5697] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.422356 28286 tablet_bootstrap.cc:492] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:50.395008 28288 tablet_bootstrap.cc:492] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:09:50.424933 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-574d2707e806420dab53495563bd03aa received from {username='slave'} at 127.0.0.1:39256
I20260709 13:09:50.425479 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-574d2707e806420dab53495563bd03aa on tablet 574d2707e806420dab53495563bd03aa with peer b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:09:50.459456 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 66036us
I20260709 13:09:50.461227 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:50.472772 28327 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.534410 26508 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:50.548266 28316 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.590195 26402 catalog_manager.cc:5697] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.592584 26658 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:50.594491 28333 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:50.617213 28306 raft_consensus.cc:993] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:50.617730 28306 raft_consensus.cc:1081] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:09:50.630791 27277 raft_consensus.cc:1217] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:09:50.629676 26580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:09:50.641902 26580 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.642539 26580 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.691951 26580 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:50.700004 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:50.702255 26580 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:50.705518 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:50.706194 26658 raft_consensus.cc:3055] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:50.703621 26506 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.706526 26658 raft_consensus.cc:740] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:50.722424 26658 consensus_queue.cc:260] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:50.723764 26658 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.736914 26658 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:50.740279 28286 tablet_bootstrap.cc:492] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.741374 28286 tablet_bootstrap.cc:492] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:50.748782 26549 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:50.750065 26508 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:50.752816 26506 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:50.758860 28346 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:09:50.761320 28333 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.772902 28333 raft_consensus.cc:697] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:50.773866 28333 consensus_queue.cc:237] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:50.766455 28286 ts_tablet_manager.cc:1403] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.349s	user 0.027s	sys 0.006s
I20260709 13:09:50.793251 28286 raft_consensus.cc:359] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:50.794224 28286 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:50.796104 28288 tablet_bootstrap.cc:492] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.797052 28288 tablet_bootstrap.cc:492] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:09:50.770264 26506 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.802603 28288 ts_tablet_manager.cc:1403] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.408s	user 0.027s	sys 0.024s
I20260709 13:09:50.804993 28255 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.794857 28286 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:50.831986 28288 raft_consensus.cc:359] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:50.838665 28288 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:09:50.839823 28288 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:09:50.842796 26651 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:50.857946 28272 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:50.859171 27277 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.865231 28309 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:50.865841 28309 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:50.868108 28309 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:09:50.869196 27277 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:50.870484 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:50.871153 26509 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:50.871896 28286 ts_tablet_manager.cc:1434] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.001s
I20260709 13:09:50.870616 28327 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:50.872822 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:50.872937 28327 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:50.875351 28327 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:50.876503 28318 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.877076 28318 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:50.877610 28318 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.882304 26595 tablet_copy_service.cc:342] P ef2886777a8f45e69e213b02a22ecec7: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-01228e22d88047b6bc2f5a6b74aa2b51 received from {username='slave'} at 127.0.0.1:39940
I20260709 13:09:50.882898 26595 tablet_copy_service.cc:434] P ef2886777a8f45e69e213b02a22ecec7: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-01228e22d88047b6bc2f5a6b74aa2b51 on tablet 01228e22d88047b6bc2f5a6b74aa2b51 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:50.884083 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:50.888005 26585 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.889472 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:50.891835 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:50.873049 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:50.899886 27271 raft_consensus.cc:1217] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:09:50.900367 26580 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 2: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:50.910569 28279 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:50.911159 28279 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:50.913309 28279 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:50.918275 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:50.919224 27274 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 2: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:09:50.919132 28288 ts_tablet_manager.cc:1434] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.116s	user 0.010s	sys 0.000s
I20260709 13:09:50.922272 28289 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:50.923200 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:50.923880 26508 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:50.925138 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:50.926133 28277 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.926527 28277 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:50.926988 28277 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.928609 26595 tablet_copy_service.cc:342] P ef2886777a8f45e69e213b02a22ecec7: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-057c1e97d7fb407aaf9cf119a0b63a37 received from {username='slave'} at 127.0.0.1:39940
I20260709 13:09:50.929306 26595 tablet_copy_service.cc:434] P ef2886777a8f45e69e213b02a22ecec7: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-057c1e97d7fb407aaf9cf119a0b63a37 on tablet 057c1e97d7fb407aaf9cf119a0b63a37 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:50.934403 26585 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.935338 28365 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.948402 28289 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.950853 26405 catalog_manager.cc:5697] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.946580 28318 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:50.954592 26580 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.956823 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:50.957608 26581 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 2: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:50.958266 28318 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:09:50.958921 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:50.967628 26508 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:50.968694 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:50.969686 28277 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:50.969731 28320 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.970857 28320 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:50.972146 28320 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:50.968220 26580 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:50.975310 28272 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:50.982990 28277 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:50.984233 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:50.984730 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:50.985090 27271 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 2: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:09:50.992101 26506 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:50.993323 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:50.994359 28365 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.994858 28365 raft_consensus.cc:697] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:50.995859 28365 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:51.059720 28378 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:09:51.072878 28289 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:51.073465 28289 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:51.075766 28289 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:51.077628 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:51.089502 26506 raft_consensus.cc:2393] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 2: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:51.109263 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:51.109999 26580 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:51.114126 26401 catalog_manager.cc:5697] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.120229 26625 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:51.128039 28289 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.128477 28289 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:51.128916 28289 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.161828 28255 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.162600 28255 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:51.170116 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:51.171010 26508 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:51.189018 27277 raft_consensus.cc:1217] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:51.207672 28255 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:51.209769 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:51.212832 28373 raft_consensus.cc:1064] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:51.222451 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:51.226918 28289 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:51.232230 28373 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:51.237772 28253 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:51.236639 28289 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:51.238204 28253 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.239894 28253 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.256376 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:51.257977 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:51.258787 26506 raft_consensus.cc:2393] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 2: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:51.271787 26405 catalog_manager.cc:5697] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 2, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.297142 26585 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:51.298346 26625 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:51.299638 28346 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.300627 28346 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:51.301929 28346 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:51.305056 28253 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:51.333937 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:51.334534 26506 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.342334 26506 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:09:51.343498 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:51.343796 27271 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:51.344534 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:51.345995 28385 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:51.346540 28385 raft_consensus.cc:697] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:51.346899 28255 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:51.347380 28385 consensus_queue.cc:237] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:51.350494 26658 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.352995 28365 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.359051 26405 catalog_manager.cc:5697] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.361131 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:51.364382 26581 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:51.343686 28253 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:51.366118 28253 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:51.530223 28256 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.530803 28256 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:51.530359 26506 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:51.533092 28256 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:51.554592 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:51.554958 28363 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:51.555277 27277 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:51.555652 28363 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:51.556681 28279 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:51.558320 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:51.557384 28279 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:51.561070 26585 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:51.583490 28279 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:51.585637 26581 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:51.589092 28289 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:51.561012 28363 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:51.604408 26476 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:51.609262 26405 catalog_manager.cc:5697] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.616179 28272 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:51.621678 28272 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.622048 28272 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.630383 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:51.636551 26506 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.641554 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:51.650466 26506 raft_consensus.cc:2368] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4.
I20260709 13:09:51.650574 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:09:51.667148 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 47051.8us
I20260709 13:09:51.673338 26509 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:51.648191 28320 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:09:51.743696 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 72389.9us
W20260709 13:09:51.794788 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 56677.1us
I20260709 13:09:51.692529 28327 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:09:51.810403 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:51.819161 27277 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:09:51.855552 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 59855us
W20260709 13:09:51.861819 28396 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:09:51.865245 28385 raft_consensus.cc:2955] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:51.912410 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 228928us
W20260709 13:09:51.908850 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 250854us
I20260709 13:09:51.940102 26506 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:51.946182 28320 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:51.948405 26506 raft_consensus.cc:2955] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:51.945379 26503 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:51.951540 28421 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.953472 28272 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:51.962839 26508 raft_consensus.cc:2368] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4.
I20260709 13:09:51.938983 26548 leader_election.cc:400] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4.
I20260709 13:09:51.968982 26548 leader_election.cc:403] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:51.968163 28272 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:09:51.991520 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 62702.8us
I20260709 13:09:51.996222 26505 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.998163 26577 raft_consensus.cc:2955] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:51.995869 28425 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.014089 26585 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.017463 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:52.018141 26580 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.054540 28423 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:52.057384 28255 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.066661 26580 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:09:52.071033 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:52.071870 27274 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.073889 26548 leader_election.cc:400] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4.
I20260709 13:09:52.075052 26548 leader_election.cc:403] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:52.076061 28394 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4.
I20260709 13:09:52.049199 28333 raft_consensus.cc:1064] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:52.078732 28333 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:52.086308 26476 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:52.089200 28414 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:52.091681 28414 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:52.092753 28414 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:52.102794 27271 raft_consensus.cc:2955] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:52.104430 28410 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.109866 26405 catalog_manager.cc:5697] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 3 to 4, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:52.126049 27272 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:52.152568 27274 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:09:52.129227 28272 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.178162 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.177973 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 43997.6us
I20260709 13:09:52.138798 28425 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4.
I20260709 13:09:52.196048 28423 raft_consensus.cc:1064] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:09:52.199821 28423 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:52.203151 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 73194.9us
I20260709 13:09:52.216625 26509 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:52.228825 26651 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:52.254197 26576 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:52.190311 28272 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:52.276296 27277 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEARNER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:09:52.279371 28435 log.cc:927] Time spent T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:09:52.223480 28420 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:09:52.291474 28398 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.291997 28398 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:52.300406 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:52.243641 28363 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:09:52.325095 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:52.296401 28398 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:52.324926 28410 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:09:52.353156 28411 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:09:52.382042 27240 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:52.385917 28272 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:52.384610 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:52.392364 28398 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.385046 28394 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:09:52.542520 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:52.566983 26502 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.580523 28394 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:52.586803 26656 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.619251 26585 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:52.621601 27275 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 LEARNER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.626444 26474 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:52.637199 28272 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:52.655756 28277 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:09:52.651193 28392 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.721974 27274 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:52.718237 28412 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 13:09:52.795806 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 86724.1us
I20260709 13:09:52.819038 28426 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:52.822113 26404 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:52.850107 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 66657.4us
I20260709 13:09:52.848151 28425 raft_consensus.cc:2955] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:52.858826 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:52.893461 28448 log.cc:927] Time spent T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:09:53.058354 27271 raft_consensus.cc:2955] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:53.134472 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 91983.5us
W20260709 13:09:53.250757 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 376389us
W20260709 13:09:53.262347 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 125612us
W20260709 13:09:53.300549 28458 log.cc:927] Time spent T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:09:53.308874 26655 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:53.338372 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 80181.6us
W20260709 13:09:53.378654 28455 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:09:53.399569 28464 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:09:53.520081 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 199934us
W20260709 13:09:53.524302 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 202500us
W20260709 13:09:53.624015 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 98813.2us
W20260709 13:09:53.720873 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 95675us
I20260709 13:09:53.734916 28465 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:09:53.868799 28425 consensus_meta.cc:287] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.782s	user 0.002s	sys 0.006s
I20260709 13:09:53.882638 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 549) took 1027 ms. Trace:
W20260709 13:09:53.877185 28457 log.cc:927] Time spent T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.480s	user 0.019s	sys 0.035s
I20260709 13:09:53.877513 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1473) took 1193 ms. Trace:
I20260709 13:09:53.883270 27277 rpcz_store.cc:276] 0709 13:09:52.854793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.854897 (+   104us) service_pool.cc:224] Handling call
0709 13:09:52.855149 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.875293 (+ 20144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.875327 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.976041 (+100714us) log.cc:844] Serialized 26 byte log entry
0709 13:09:53.177148 (+201107us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:53.177648 (+   500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.178118 (+   470us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.400666 (+222548us) raft_consensus.cc:1685] finished
0709 13:09:53.400685 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.882555 (+481870us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50106,"raft.queue_time_us":20842,"raft.run_cpu_time_us":7276,"raft.run_wall_time_us":125713,"thread_start_us":139814,"threads_started":1,"wal-append.queue_time_us":258805}
I20260709 13:09:53.881681 26654 raft_consensus.cc:2955] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:53.879948 26656 raft_consensus.cc:2955] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:53.905352 28465 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:53.387504 28471 raft_consensus.cc:2955] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:53.917843 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 396698us
I20260709 13:09:53.896562 26582 rpcz_store.cc:276] 0709 13:09:52.684473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.684649 (+   176us) service_pool.cc:224] Handling call
0709 13:09:52.685016 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.685437 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.693927 (+  8490us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.711365 (+ 17438us) log.cc:844] Serialized 26 byte log entry
0709 13:09:53.020964 (+309599us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:53.021014 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.021103 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.877243 (+856140us) raft_consensus.cc:1685] finished
0709 13:09:53.877262 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.877419 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75787,"raft.queue_time_us":9255,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":6275,"spinlock_wait_cycles":3840,"thread_start_us":294210,"threads_started":1,"wal-append.queue_time_us":517292}
W20260709 13:09:54.036800 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 109528us
I20260709 13:09:54.047938 26505 raft_consensus.cc:2955] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:09:54.077903 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 95755.2us
W20260709 13:09:54.079272 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 60398.8us
W20260709 13:09:54.076174 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 150391us
W20260709 13:09:54.097966 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 444079us
I20260709 13:09:54.113871 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:54.075558 26510 raft_consensus.cc:2955] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:54.081362 28445 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:09:54.138511 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 45630.8us
I20260709 13:09:54.123225 28465 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:54.182580 28485 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:09:54.186774 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 62642.4us
I20260709 13:09:54.142575 28413 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:54.190126 28413 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.192552 28413 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:09:54.186890 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 76209.1us
I20260709 13:09:54.163606 28489 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.212587 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:54.142644 28445 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:54.234477 28491 log.cc:927] Time spent T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:09:54.238217 28506 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:54.238878 28506 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:54.241989 28492 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:54.207131 28485 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.248639 28468 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.249377 28485 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:54.249248 28468 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:54.251036 28497 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.253465 28497 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.251057 28479 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:09:54.256394 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 118827us
I20260709 13:09:54.256304 28363 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.244329 28506 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:54.269237 28363 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:54.284209 28385 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:54.305032 28385 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:54.306425 28363 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.307127 28385 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:54.288362 28421 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:54.307948 28421 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:54.309945 28421 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:54.211570 28489 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:54.312007 28489 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.296101 28272 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:54.312657 28272 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:54.314579 28476 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.302946 28445 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.262383 28479 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.317905 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:54.320576 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:54.324440 28423 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.333767 28490 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.317931 28397 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.315208 28476 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.314601 28272 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.337226 26581 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:54.342025 28423 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:54.365173 28320 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:54.365888 28320 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.342850 28490 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.374727 28423 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.376111 28426 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.376780 28426 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:54.378919 26404 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34738 (request call id 293) took 2058 ms. Trace:
I20260709 13:09:54.380116 28461 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:54.388255 28468 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.413723 26402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48166 (request call id 192) took 2136 ms. Trace:
I20260709 13:09:54.414291 26402 rpcz_store.cc:276] 0709 13:09:52.274248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.274408 (+   160us) service_pool.cc:224] Handling call
0709 13:09:52.389857 (+115449us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54002eff90. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f88298050b2 00007f883277ea89 00007f8832716da6 00007f88326e8088 00007f88327e637e 00007f8830ca72a4 00007f8830ca7232 00007f8830ca7161 00007f8830ca70dc
0709 13:09:52.614034 (+224177us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540013f454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c893090 00007f882c931f3a 00007f88326e81cc 00007f88327e637e 00007f8830ca72a4 00007f8830ca7232 00007f8830ca7161 00007f8830ca70dc 00007f8830ca6392 00007f882ac6448c 00007f882ac638c6
0709 13:09:54.410994 (+1796960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76490,"reported_tablets":1,"spinlock_wait_cycles":554389120}
I20260709 13:09:54.368360 28489 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.343214 28397 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.519793 28426 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.397082 26404 rpcz_store.cc:276] 0709 13:09:52.319969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.324086 (+  4117us) service_pool.cc:224] Handling call
0709 13:09:54.378821 (+2054735us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:53.246262 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:53.246882 (+   620us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:53.246918 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:09:53.246935 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:53.247282 (+   347us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:53.247372 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:53.247418 (+    46us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:53.247687 (+   269us) tablet.cc:701] Row locks acquired
0709 13:09:53.247715 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:09:53.247915 (+   200us) write_op.cc:270] Start()
0709 13:09:53.248075 (+   160us) write_op.cc:276] Timestamp: P: 1783602593247857 usec, L: 0
0709 13:09:53.248107 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:09:53.263723 (+ 15616us) log.cc:844] Serialized 539 byte log entry
0709 13:09:53.976493 (+712770us) op_driver.cc:464] REPLICATION: finished
0709 13:09:54.202184 (+225691us) write_op.cc:301] APPLY: starting
0709 13:09:54.208619 (+  6435us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:54.223998 (+ 15379us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:54.241725 (+ 17727us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:54.242007 (+   282us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:54.242244 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:54.242293 (+    49us) write_op.cc:312] APPLY: finished
0709 13:09:54.242487 (+   194us) log.cc:844] Serialized 23 byte log entry
0709 13:09:54.242680 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:54.242767 (+    87us) write_op.cc:454] Released schema lock
0709 13:09:54.242807 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:54.243264 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:54.243295 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59854,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":205201,"apply.run_cpu_time_us":2154,"apply.run_wall_time_us":49090,"num_ops":1,"prepare.queue_time_us":387433,"prepare.run_cpu_time_us":3208,"prepare.run_wall_time_us":28338,"replication_time_us":704046,"thread_start_us":382249,"threads_started":2}]]}
W20260709 13:09:54.553705 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 324822us
I20260709 13:09:54.440399 28489 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.427857 28461 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.519801 28498 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:09:54.656363 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.020s	sys 0.038s
W20260709 13:09:54.656915 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.020s	sys 0.038s
W20260709 13:09:54.657291 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 529433us
W20260709 13:09:54.689409 26625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.016s	sys 0.028s
W20260709 13:09:54.695152 26625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.017s	sys 0.028s
I20260709 13:09:54.701164 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:54.714404 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:54.718670 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:54.730163 26650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:54.716501 27271 raft_consensus.cc:2955] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:54.730950 26650 raft_consensus.cc:606] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:54.732134 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:54.723619 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:54.732220 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:54.759728 28272 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.760749 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:54.761404 26505 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:54.760371 28272 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.763345 28497 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.764294 28514 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.765854 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:54.766184 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:54.766426 28423 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.767057 28423 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.764820 28514 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.766518 26501 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:54.775653 26504 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:54.705449 28490 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:54.793035 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 77176.9us
I20260709 13:09:54.791668 26503 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:54.798996 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:54.804242 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:54.809823 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:54.813174 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:54.814606 27277 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:54.809412 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:54.822086 27275 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:54.829757 28466 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:54.830353 28426 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.831180 28426 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:54.833925 28504 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:54.834758 28504 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:54.837746 28465 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:54.838476 28465 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:54.844007 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:54.854314 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:54.784554 28317 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:54.787667 28395 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:54.888700 28463 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:54.889531 28481 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:54.890151 28397 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.792809 28398 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:54.702536 28498 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:54.900549 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 96462.4us
I20260709 13:09:54.916121 28508 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:54.916698 28423 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:54.924226 28462 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:54.925897 28515 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:54.926515 28485 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:54.928727 28469 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.929540 28502 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.930334 28516 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:54.808699 28320 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.817112 28400 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:54.892423 28395 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.392632 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:55.237739 26582 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.121s	sys 0.211s
W20260709 13:09:55.401139 26582 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.127s	sys 0.229s
I20260709 13:09:55.147389 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:55.407169 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:55.402660 26583 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:09:55.289150 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:54.837445 28504 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:55.410907 26578 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:55.144156 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:54.931173 28514 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:54.925284 28424 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.423724 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:55.429620 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:55.431316 26548 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:54.887704 28476 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:55.436781 26623 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.011s	sys 0.086s
I20260709 13:09:55.426740 28504 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.413451 28400 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.437588 28504 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.430416 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:55.439090 28400 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:55.439556 28504 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:54.830435 28466 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.163533 28490 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.413355 28398 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:55.437206 26623 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.011s	sys 0.086s
I20260709 13:09:55.440641 28490 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.441825 28493 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.124455 28277 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:55.390312 28475 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.163166 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:55.117965 28392 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.389580 28467 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.390470 28503 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.389966 28412 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.413174 28515 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.421758 28508 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.456151 28475 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.456792 28490 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:55.427207 28516 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.237004 28404 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.420514 28426 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:54.898279 28479 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:55.423688 28461 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:09:55.226266 28471 consensus_meta.cc:287] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.207s	user 0.011s	sys 0.002s
W20260709 13:09:55.460978 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.012s	sys 0.019s
I20260709 13:09:55.437493 28514 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:55.462410 28399 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.041s	sys 0.080s
I20260709 13:09:55.417977 28462 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.526471 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:55.511669 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.012s	sys 0.019s
I20260709 13:09:55.453338 28277 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.512336 26656 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:55.422201 28485 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.520689 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:55.526414 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:55.527570 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 603987us
I20260709 13:09:55.463121 28504 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.050861 28317 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:55.460024 28513 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.481s	user 0.001s	sys 0.000s
I20260709 13:09:55.506980 28466 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:55.412803 28502 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.467820 28394 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:09:55.520381 28399 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.205s	user 0.042s	sys 0.080s
I20260709 13:09:55.561372 27273 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:55.427034 28469 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.391384 28481 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.505432 28412 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.520831 28488 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.520287 28514 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.518596 28465 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:55.520738 28510 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.514118 28426 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.525930 28398 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:55.564852 26652 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:55.541949 28277 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.520787 28500 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.534309 28486 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.464349 28392 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.546257 28472 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:55.565795 28461 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.591912 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:54.976751 28463 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.444276 28424 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.466454 28493 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.598803 26577 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:09:55.593247 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1486) took 1369 ms. Trace:
I20260709 13:09:55.516319 28503 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.527480 28404 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.505071 28467 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.590725 28514 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.562592 28504 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.586045 28489 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:55.616405 26582 rpcz_store.cc:276] 0709 13:09:54.223959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.224106 (+   147us) service_pool.cc:224] Handling call
0709 13:09:54.226833 (+  2727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.227117 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:55.401592 (+1174475us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.592874 (+191282us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.592928 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:55.592975 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.593039 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.593190 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1307288,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":9550,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7933,"thread_start_us":1325584,"threads_started":2}
I20260709 13:09:55.610023 28486 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.600605 28415 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.580544 28394 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.640599 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:55.660028 26658 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:55.654981 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:55.663524 26473 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:55.663395 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:55.657341 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:55.601081 28426 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.666159 28395 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:55.675480 28423 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:55.677006 28424 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:55.591796 28488 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.654526 28473 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.642593 28466 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:55.686561 28412 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:09:55.688864 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 145598us
I20260709 13:09:55.648547 28505 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.666731 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:55.681365 28490 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:55.678913 28489 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:55.615708 28461 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.686869 28400 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.686555 28475 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:55.607853 28500 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.607595 28510 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.752756 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:55.716502 28520 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.183s	user 0.000s	sys 0.002s
I20260709 13:09:55.615828 28472 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.682266 28415 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.787528 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:55.779917 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 125730us
I20260709 13:09:55.788365 26653 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:09:55.788700 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:55.698122 28526 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.787590 28465 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.778141 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:55.796491 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:55.759210 28489 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:55.797515 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:55.795946 27243 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:55.773132 28521 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.705883 28466 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.783903 28463 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:55.752722 28490 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.758975 27271 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
W20260709 13:09:55.803515 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 124571us
I20260709 13:09:55.774899 28462 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:55.797905 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 121431us
I20260709 13:09:55.770865 28498 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:55.825774 28519 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.772724 28505 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.784706 28419 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:55.800220 28395 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:55.828773 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:55.829308 28395 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.830912 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:55.831604 28395 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:55.809486 27243 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:55.800328 28406 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.832823 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:55.818120 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:55.823657 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:55.834734 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:55.790643 28485 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:55.789758 28399 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:55.833542 26502 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:55.753078 28473 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.838979 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:55.807966 28489 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.828540 28419 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.802768 28465 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.833222 28406 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:55.851243 28399 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.795477 28516 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:55.799769 28522 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.816541 28515 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:55.796406 28400 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.826419 28519 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:55.859625 28521 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.064038 28461 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.064790 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:55.860896 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:55.789669 28526 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:55.986750 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 51519.7us
I20260709 13:09:56.069288 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.067596 26501 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:56.115298 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.116211 26651 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:55.864813 28463 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:55.871097 28397 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:55.922462 28507 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:55.922796 28392 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.161227 28419 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:55.867230 28395 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:56.173343 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:55.913959 28481 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.080713 28399 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.173635 28395 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.097056 28522 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.079589 28415 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:56.079391 28505 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.056133 28394 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:56.173671 28531 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:09:56.162900 28397 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:56.133999 28472 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.163020 28493 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.084360 28404 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.175662 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.064837 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:56.227000 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 417570us
I20260709 13:09:56.284972 27243 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:56.285516 28488 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.285768 28415 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:56.287421 28521 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:56.231559 28486 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.220021 28397 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.288596 28507 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:56.288820 28473 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:56.275486 28277 consensus_meta.cc:287] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.667s	user 0.004s	sys 0.004s
W20260709 13:09:56.324522 26473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.035s	sys 0.017s
I20260709 13:09:56.324739 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.289343 28504 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.272625 28465 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.292722 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.180732 28502 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:56.226687 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 424854us
W20260709 13:09:56.278610 28524 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:09:56.307433 28541 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:56.220193 28426 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.176103 28463 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:56.325344 26473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.036s	sys 0.017s
I20260709 13:09:56.328750 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.334048 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.334575 26507 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:56.334170 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.335510 26504 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
W20260709 13:09:56.335801 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 672307us
I20260709 13:09:56.293267 28395 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.271735 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:55.865275 28317 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:09:56.329015 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.016s	sys 0.039s
W20260709 13:09:56.346761 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.016s	sys 0.039s
I20260709 13:09:56.337152 26473 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:56.290241 28526 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.350754 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.351871 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.352802 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.328790 28277 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.229629 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.357966 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:56.339234 26625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.018s	sys 0.028s
W20260709 13:09:56.359020 26625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.018s	sys 0.028s
I20260709 13:09:56.361999 28277 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.362723 28522 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.363252 28400 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.363469 26576 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:56.364352 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.364969 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.335510 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:56.340819 28272 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.340979 28473 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:56.342068 28505 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:56.339828 28479 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:56.345759 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 333) took 1202 ms. Trace:
I20260709 13:09:56.299965 28415 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:56.338696 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.362398 28489 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.374480 26473 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:56.325943 26508 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 1.
I20260709 13:09:56.342469 26401 catalog_manager.cc:5697] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 4 to 5, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:56.372041 28426 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:56.388090 26401 catalog_manager.cc:5697] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 2 to 3, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:09:56.389106 28519 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.389724 28504 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:56.390218 28504 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.392095 28504 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.368594 28317 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:56.375941 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.385604 26583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:56.400270 26583 raft_consensus.cc:606] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:56.376400 26577 rpcz_store.cc:276] 0709 13:09:55.143678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.143828 (+   150us) service_pool.cc:224] Handling call
0709 13:09:56.345518 (+1201690us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54002f03d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:09:56.345655 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418858752}
I20260709 13:09:56.402869 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.371459 26474 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:56.365636 28541 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.372402 28498 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:56.410665 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:56.410626 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.412139 27243 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:56.413403 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.415500 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.416884 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.387027 28415 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.327455 28507 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.393719 28510 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.422663 28521 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:56.383773 28399 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.424122 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:56.430691 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 253693us
I20260709 13:09:56.435431 28541 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.406556 28426 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:56.412166 28504 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:56.440312 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.386533 28479 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.384757 28505 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.442478 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:56.418402 28503 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.417702 28498 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:56.386415 28473 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.450860 26501 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:56.461778 28272 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:56.462357 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.462360 28272 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.463215 28395 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:56.463966 28542 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:56.463771 28395 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.464524 28540 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:56.464743 28272 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.465044 28540 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:56.411118 28317 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.427378 28472 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:56.446463 28481 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:56.452864 26508 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:56.457046 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.469957 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.469758 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:56.442282 28504 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:56.465452 28540 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.471665 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:56.467422 28522 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:56.485496 28544 raft_consensus.cc:993] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:56.486081 28528 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:56.486455 28519 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:56.474056 28504 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.486640 28528 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.488415 28510 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:56.488847 28528 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.488891 28510 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:56.486665 26548 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:56.456691 28498 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.496537 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.496973 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.497598 26505 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:56.466184 28511 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:56.502077 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.502487 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:56.503039 26505 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.489497 28510 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:56.476295 28394 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:56.537726 28394 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:56.538149 28394 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.508000 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.508592 28546 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:56.510087 28399 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.510525 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.512974 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.514183 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.496481 28541 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:56.519194 28473 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.519912 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2252) took 1622 ms. Trace:
I20260709 13:09:56.521409 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.522739 28463 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.523567 28508 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.526571 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1477) took 1413 ms. Trace:
I20260709 13:09:56.526799 28317 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.527770 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2245) took 1810 ms. Trace:
I20260709 13:09:56.528159 28505 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.528496 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1484) took 1105 ms. Trace:
I20260709 13:09:56.476879 26584 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:09:56.530015 27272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 601) took 1740 ms. Trace:
I20260709 13:09:56.530483 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.531059 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.531590 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 341) took 1381 ms. Trace:
I20260709 13:09:56.532351 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.534228 28507 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:56.535516 28514 consensus_meta.cc:287] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.874s	user 0.003s	sys 0.007s
I20260709 13:09:56.536156 28406 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:56.536887 28479 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.541642 26474 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:56.537443 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:56.543150 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.540449 26503 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:09:56.508646 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 339) took 1359 ms. Trace:
I20260709 13:09:56.464498 28542 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.600925 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.602115 26548 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:56.609000 26505 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
W20260709 13:09:56.656607 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 115072us
I20260709 13:09:56.652272 26579 rpcz_store.cc:276] 0709 13:09:55.149370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.149523 (+   153us) service_pool.cc:224] Handling call
0709 13:09:55.288945 (+139422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.522402 (+233457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.522431 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.522475 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:55.522505 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.508436 (+985931us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b540015bb54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:56.508477 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.508591 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536481152}
I20260709 13:09:56.657809 26585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:09:56.611931 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.613545 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.658631 26585 raft_consensus.cc:606] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:56.621057 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.545821 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.602072 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.607174 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.499791 28472 raft_consensus.cc:1081] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:56.666734 28543 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:56.667574 28543 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.645099 26510 rpcz_store.cc:276] 0709 13:09:54.717129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.718205 (+  1076us) service_pool.cc:224] Handling call
0709 13:09:54.718459 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.436619 (+718160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.436660 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.436723 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:55.436782 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.527572 (+1090790us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54002fba54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:56.527609 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.527713 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1651179392}
I20260709 13:09:56.671094 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.672367 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.600993 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.673436 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.649500 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.675015 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.675350 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.644376 26580 rpcz_store.cc:276] 0709 13:09:55.149925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.419498 (+269573us) service_pool.cc:224] Handling call
0709 13:09:55.704785 (+285287us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b5800003098. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f8831902fc0 00007f88318ed929 00007f88318ed3d2 00007f882ae64bd4
0709 13:09:55.704990 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.798226 (+ 93236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.798267 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.798325 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:55.798370 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.531389 (+733019us) spinlock_profiling.cc:243] Waited 93 ms on lock 0x7b54000d9654. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:56.531430 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.531535 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235104896}
I20260709 13:09:56.653594 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.644857 26651 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
W20260709 13:09:56.662163 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 60127us
I20260709 13:09:56.676898 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.654017 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.679780 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.680590 26653 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:09:56.646001 26656 rpcz_store.cc:276] 0709 13:09:55.423360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.423472 (+   112us) service_pool.cc:224] Handling call
0709 13:09:56.528310 (+1104838us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b5400167e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:09:56.528415 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185991936}
I20260709 13:09:56.682451 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.678331 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.501085 28395 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:56.684813 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.639839 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2306) took 1262 ms. Trace:
I20260709 13:09:56.623114 26506 rpcz_store.cc:276] 0709 13:09:54.897852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.898078 (+   226us) service_pool.cc:224] Handling call
0709 13:09:54.899655 (+  1577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.621926 (+722271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.621976 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.622032 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:55.622094 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.519674 (+897580us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54001743d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:56.519716 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.519854 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660420864}
I20260709 13:09:56.674295 27273 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:56.684062 26651 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:56.688110 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.688169 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.689980 26651 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:56.691478 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.505497 28511 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.694958 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.694618 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.675614 26657 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:56.621246 28424 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:56.637944 28478 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:56.685705 26576 rpcz_store.cc:276] 0709 13:09:55.377732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.432105 (+ 54373us) service_pool.cc:224] Handling call
0709 13:09:55.432489 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.363824 (+931335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.639516 (+275692us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b540032e6d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:56.639746 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140585856}
I20260709 13:09:56.624537 28541 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:56.699575 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.707882 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.699414 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.658411 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.656142 28514 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.644886 28546 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:56.738505 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 101771us
I20260709 13:09:56.729360 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.781338 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1487) took 1194 ms. Trace:
I20260709 13:09:56.824098 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.842774 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.711424 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.843438 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.828497 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 295) took 1366 ms. Trace:
I20260709 13:09:56.822891 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.838053 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.847131 26622 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:56.848580 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:09:56.844115 26657 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:56.850626 26622 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:56.849747 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.674119 28465 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:56.842730 26659 rpcz_store.cc:276] 0709 13:09:55.454836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.459610 (+  4774us) service_pool.cc:224] Handling call
0709 13:09:55.505338 (+ 45728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.786806 (+281468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.786834 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.786872 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:55.786906 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.649353 (+862447us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400140854. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:56.649396 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.649509 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646805248}
I20260709 13:09:56.844271 27278 rpcz_store.cc:276] 0709 13:09:55.461885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.465592 (+  3707us) service_pool.cc:224] Handling call
0709 13:09:55.469208 (+  3616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.789160 (+319952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.789192 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.789232 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:55.789292 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.828163 (+1038871us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54008183d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:56.828218 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.828410 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735381376}
W20260709 13:09:56.697095 26474 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.859s (SENT)
I20260709 13:09:56.857050 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.859750 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2312) took 1425 ms. Trace:
I20260709 13:09:56.860005 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.857461 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1480) took 1567 ms. Trace:
I20260709 13:09:56.687594 28479 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:56.861244 26581 rpcz_store.cc:276] 0709 13:09:55.434353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.562096 (+127743us) service_pool.cc:224] Handling call
0709 13:09:55.562396 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.682471 (+120075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.682510 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.682563 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:55.682615 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.859526 (+1176911us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002ef254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:56.859567 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.859675 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275139968}
I20260709 13:09:56.861837 26654 rpcz_store.cc:276] 0709 13:09:55.290123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.290280 (+   157us) service_pool.cc:224] Handling call
0709 13:09:55.290631 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.568999 (+278368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.569043 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.569097 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:55.569152 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.857255 (+1288103us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400169754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:56.857295 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.857405 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639555840}
I20260709 13:09:56.630538 28415 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.861277 27278 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
W20260709 13:09:56.848738 28397 consensus_meta.cc:287] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.004s
I20260709 13:09:56.730665 28541 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.869650 26578 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:56.872529 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:56.873832 26625 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:56.878796 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:56.855453 28463 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:56.886837 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.887868 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.852984 28501 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:56.875463 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.929849 27269 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:56.930743 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.931396 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.931957 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.932727 28277 raft_consensus.cc:993] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:56.932857 26655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:42488
I20260709 13:09:56.765074 28466 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.886343 28544 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:09:56.935037 28544 raft_consensus.cc:3055] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:56.935405 28544 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:56.936241 26655 raft_consensus.cc:606] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:56.858973 28481 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:56.949796 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:56.951251 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:56.895658 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:56.645874 26650 rpcz_store.cc:276] 0709 13:09:55.113168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.120858 (+  7690us) service_pool.cc:224] Handling call
0709 13:09:55.331810 (+210952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.613543 (+281733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.615994 (+  2451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.617495 (+  1501us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:55.617575 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.526371 (+908796us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54002c2c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:56.526411 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.526518 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616514432}
I20260709 13:09:56.899187 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:09:56.982082 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45682.1us
I20260709 13:09:56.705456 27274 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:56.710664 28423 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 13:09:56.644539 27272 rpcz_store.cc:276] 0709 13:09:54.789641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.792574 (+  2933us) service_pool.cc:224] Handling call
0709 13:09:56.529247 (+1736673us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b5800161a98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804eee 0000000000375939 00007f88318781e0 00007f88319410c4 00007f8831941131 00007f8831902fc0 00007f88318ed929 00007f88318ed3d2 00007f882ae64bd4
0709 13:09:56.529427 (+   180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.529662 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.529690 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.529732 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:56.529775 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.529831 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.529939 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48496000}
I20260709 13:09:56.901497 28536 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:56.902064 28505 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:56.902639 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:56.903292 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.933183 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.859763 27270 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:09:57.036569 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:56.909854 28500 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.910259 27241 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:09:57.041895 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 131702us
I20260709 13:09:57.042599 27241 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:56.916580 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.918684 28514 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.921633 28522 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:56.807964 28424 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.047679 27241 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:56.947198 28481 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:56.873885 28479 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:56.924516 28510 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:56.881705 28543 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.041095 28505 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:56.982973 27240 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:56.933233 28277 raft_consensus.cc:1081] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:56.986025 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:56.987143 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.047590 28522 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:56.988235 28463 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:56.988343 28423 raft_consensus.cc:3055] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:56.990811 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:56.785146 28478 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.993884 26652 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:56.903914 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:56.858683 28465 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:57.039141 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:57.018291 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:09:56.928320 28511 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:56.988392 28462 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:56.958199 26585 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:09:57.046293 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.102711 28373 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.103181 28373 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:57.103556 28373 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.103708 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.103992 28510 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.104422 27272 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:09:57.051980 28400 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:56.893335 28397 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:56.987378 28489 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:57.080708 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 97815.9us
I20260709 13:09:57.093284 28514 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:57.053342 28481 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.050143 28466 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:57.083033 26579 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:57.084430 26656 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:09:56.994946 28536 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.089154 28423 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:09:57.095835 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 77679.3us
I20260709 13:09:57.123744 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:09:57.099381 27276 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:57.083791 28548 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:56.768777 28469 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.134990 28505 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.087819 28522 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:57.067665 28479 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:57.090173 26549 connection.cc:256] RPC call timeout handler was delayed by -1.0515403850000666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 13:09:57.109158 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:09:57.108433 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 229702us
I20260709 13:09:57.097079 28465 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:57.111289 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 414189us
I20260709 13:09:57.090107 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.116575 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:57.050717 28476 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:57.117993 27243 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:57.154974 28548 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:57.155504 28548 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:57.156141 28548 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.108994 28400 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:57.158316 28400 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:57.158448 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:57.126312 28536 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.127194 28423 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.160475 28423 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.160882 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 299) took 1547 ms. Trace:
I20260709 13:09:57.161351 27271 rpcz_store.cc:276] 0709 13:09:55.613919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.615429 (+  1510us) service_pool.cc:224] Handling call
0709 13:09:57.160648 (+1545219us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b54006a4fd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:09:57.160792 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99608320}
I20260709 13:09:57.128731 28462 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:57.075551 28544 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.182648 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2308) took 1782 ms. Trace:
I20260709 13:09:57.183169 28544 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.183068 26578 rpcz_store.cc:276] 0709 13:09:55.399814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.440069 (+ 40255us) service_pool.cc:224] Handling call
0709 13:09:55.440351 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.881389 (+1441038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.182418 (+301029us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000203d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:57.182585 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3286627712}
I20260709 13:09:57.130910 26622 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:57.133340 27275 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:09:57.185144 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 54307.5us
I20260709 13:09:57.186185 26622 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:57.186530 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.188019 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:57.140772 28498 consensus_meta.cc:287] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.635s	user 0.005s	sys 0.005s
I20260709 13:09:57.141860 28478 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.148731 26549 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:57.166023 28413 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:57.142148 28546 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.158713 28490 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:57.130378 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.167936 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.169171 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.169876 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.204227 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:57.170279 26474 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:57.150218 28543 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:57.166199 28466 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:57.224994 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.174932 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.175593 28373 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.165926 28489 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:57.175604 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.180723 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:57.228454 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.192008 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:57.196844 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:09:57.199949 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 51351.3us
I20260709 13:09:57.229449 26582 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.170841 28462 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:57.171140 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.152304 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.121968 28514 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.234542 28514 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.213074 28508 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:57.214681 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 608) took 1437 ms. Trace:
I20260709 13:09:57.240726 27277 rpcz_store.cc:276] 0709 13:09:55.777596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.779089 (+  1493us) service_pool.cc:224] Handling call
0709 13:09:57.164058 (+1384969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.190968 (+ 26910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.190999 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.191034 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:57.191070 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.213927 (+ 22857us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54006a4fd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:57.213970 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.214510 (+   540us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54006a4fd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:09:57.214607 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3245842944}
W20260709 13:09:57.215515 27275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 298) took 1648 ms (client timeout 2000 ms). Trace:
I20260709 13:09:57.216167 27276 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:09:57.217036 28406 raft_consensus.cc:993] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
W20260709 13:09:57.220170 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 49971us
I20260709 13:09:57.165141 28548 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.166379 28550 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:09:57.241951 27275 rpcz_store.cc:269] 0709 13:09:55.567441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.567556 (+   115us) service_pool.cc:224] Handling call
0709 13:09:56.333905 (+766349us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b5800161a98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:09:57.215358 (+881453us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54005fdf54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:09:57.215466 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818607232}
I20260709 13:09:57.228542 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:57.153470 27240 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:57.205394 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:57.230744 26549 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:57.203668 28317 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:57.210705 28463 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:57.240136 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.211520 28551 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:57.236140 28462 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:57.191483 28413 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.230769 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:57.252766 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.254688 26502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59080
I20260709 13:09:57.260890 26474 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:57.262069 26502 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:57.252915 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.257262 26501 raft_consensus.cc:2393] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:57.227170 28392 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.233310 28400 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.199491 28498 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.268827 28498 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.269516 26507 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:57.262616 26502 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:57.262840 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:09:57.259018 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 105614us
I20260709 13:09:57.260485 28514 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.218883 28472 consensus_queue.cc:1059] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:09:57.266669 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 217680us
I20260709 13:09:57.238967 28489 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.273432 27274 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:57.272728 28397 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.274441 28500 raft_consensus.cc:993] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:57.275143 27277 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:57.279930 28394 consensus_meta.cc:287] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.001s
I20260709 13:09:57.273435 28481 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.282935 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.257293 28463 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:57.284359 28413 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.230548 28543 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.290506 27241 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:57.291802 26582 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:09:57.291831 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:09:57.292728 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.290316 27240 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:57.285553 28373 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.299688 26505 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:57.261736 28466 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:57.303202 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:09:57.312556 28504 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.000s
I20260709 13:09:57.308127 26501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59084
I20260709 13:09:57.308643 26549 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:57.324719 26654 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 3: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:09:57.299010 28540 consensus_meta.cc:287] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.803s	user 0.011s	sys 0.000s
I20260709 13:09:57.269757 28519 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:57.270591 28424 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:57.265478 28554 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.286276 28493 raft_consensus.cc:1081] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:09:57.300109 28498 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:57.318252 26506 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:57.319295 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47711us
I20260709 13:09:57.291165 28514 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:57.319343 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:57.314085 28463 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:57.320273 28478 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.320580 28500 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:57.260653 28550 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.264012 28392 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:57.343417 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.324347 26501 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:57.344305 26501 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:57.325624 28477 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:57.322229 28397 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:57.326423 26549 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:57.342027 26578 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:09:57.306919 28400 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.314252 28423 raft_consensus.cc:1081] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:09:57.345237 28413 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:57.332639 27240 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:57.326905 28548 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:57.342540 27241 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:09:57.370296 26549 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:57.341789 28392 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.329308 28558 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:57.369138 28523 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:57.314225 28394 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.372656 26622 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:57.379058 27241 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:57.335436 28542 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:57.341250 28550 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.330711 28399 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:57.387516 28523 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:57.398562 28523 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.332775 28554 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:57.331915 28498 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:57.386595 28488 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:57.338853 28500 raft_consensus.cc:3055] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:57.390472 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:57.371080 28505 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.338068 28478 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:57.329332 28504 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.382166 28413 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.389003 28558 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.424957 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:09:57.371116 28489 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.331313 28540 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:57.389415 28555 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:09:57.380622 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 48026.5us
I20260709 13:09:57.386435 28466 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.408010 26577 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:57.399717 28467 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.351416 28519 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.417805 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:57.438114 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 48738.3us
W20260709 13:09:57.419179 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99895.8us
I20260709 13:09:57.466426 28394 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:09:57.472076 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 47186.6us
I20260709 13:09:57.513517 27275 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:57.515178 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:57.396384 28469 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:57.391585 28528 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:57.391155 28548 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:57.475301 27273 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:57.474189 26501 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.486423 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:09:57.413694 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.487705 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:57.350564 28514 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.515816 26657 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:57.469305 28541 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.407867 28399 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.407318 28554 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.530139 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:57.561947 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 74333.9us
I20260709 13:09:57.553908 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:57.561949 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:57.553440 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:57.564157 26504 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:57.564245 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:57.516182 26622 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:57.522554 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:57.565543 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:09:57.565799 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 52573.3us
I20260709 13:09:57.543306 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:57.517341 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:57.517524 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 87052.1us
I20260709 13:09:57.566788 26505 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:57.567144 26549 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:57.568737 26549 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:57.416289 28498 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:57.418314 28488 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:57.586272 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:57.474135 28395 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:57.520185 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:57.596973 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 133469us
I20260709 13:09:57.596078 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.492484 26502 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.599540 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:57.600220 26508 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:57.540779 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:57.600843 26585 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.525040 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.577782 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:57.483392 28563 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.447660 28542 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:57.581813 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:57.581935 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:57.473270 28543 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.472502 28505 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:57.610833 28373 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:57.611120 28505 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.552532 28504 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.590255 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:57.472785 28478 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.504146 28466 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:57.602362 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:57.522081 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.475118 28540 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.605647 26582 raft_consensus.cc:1240] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:57.583272 26549 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:57.452459 28559 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.137s
I20260709 13:09:57.601948 28508 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:09:57.583019 28544 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:57.613270 28465 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.613695 28511 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:57.611765 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:57.419615 28500 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:57.614894 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.531819 28481 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.523952 28415 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.530714 28558 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:57.614105 28472 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:09:57.578769 28561 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:57.617296 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:57.618943 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:57.620047 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:57.553000 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:57.624336 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.624537 28399 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.626825 28522 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.477216 28462 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.628181 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:57.583925 28394 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:57.588788 28488 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.630550 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:57.631271 27275 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:09:57.598523 28395 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:57.529408 28463 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.546660 28479 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.584309 28397 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:09:57.628960 28514 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.643132 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:57.716758 26510 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:58.089955 26503 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:58.092846 28536 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:58.092969 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 509784us
I20260709 13:09:58.093335 28536 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:58.093614 28511 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:58.093912 28536 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:58.093950 28465 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:58.094241 28511 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.096370 26474 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:58.097239 28504 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:58.097857 28504 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:58.098246 28504 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.099607 27276 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:58.102438 28424 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:58.102833 28424 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:58.103499 28536 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.598090 28510 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.103706 28424 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:57.608930 28563 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:58.104732 28424 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.104939 28563 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.587610 28562 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.702692 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:09:58.106423 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 462498us
I20260709 13:09:58.106820 26658 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.107064 26510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:59084
I20260709 13:09:57.788573 27241 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:58.108265 26549 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:09:58.108940 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 320606us
I20260709 13:09:57.756991 26501 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:58.109740 26502 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:58.001724 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.111279 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 342938us
I20260709 13:09:58.112265 27241 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:58.107606 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:58.113394 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.113646 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:58.113426 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 501702us
I20260709 13:09:58.114598 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.115170 26582 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:09:58.115978 26585 consensus_meta.cc:287] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.002s
I20260709 13:09:58.116393 26585 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:09:57.675377 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:58.118642 26578 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:09:58.119975 26548 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:58.134012 26508 raft_consensus.cc:2393] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:58.106068 28562 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:09:58.164740 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 52549.6us
I20260709 13:09:58.166843 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:57.638475 28466 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.162667 26474 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:57.615466 28392 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.210903 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:58.118490 28467 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:58.212878 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.010s	sys 0.037s
W20260709 13:09:58.229693 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.010s	sys 0.037s
I20260709 13:09:57.911020 28553 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:58.113397 28528 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:58.165867 28536 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:57.835479 28519 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:58.214290 27243 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:58.212508 27241 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:58.212440 28490 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:58.118269 28540 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:57.828271 28541 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:58.119793 28399 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:58.253775 28397 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:58.220192 26652 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:58.229219 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.219725 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.261401 28400 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:58.251446 28395 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.262621 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:58.263409 26651 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:58.263864 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:58.218197 26584 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:58.264318 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:57.628960 28523 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.265584 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:58.266127 26657 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:58.266397 26657 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:58.267385 28523 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:58.267168 26657 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:57.638026 28501 consensus_queue.cc:1059] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.577s
I20260709 13:09:58.268121 26657 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:58.268524 28501 raft_consensus.cc:3055] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:58.268934 28501 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:58.269717 28501 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.270864 26509 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:58.271217 26656 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:58.215417 28498 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 13:09:58.271728 28498 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.273790 28498 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:58.238900 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.275094 26506 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:58.240908 26658 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:58.186932 28510 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.241854 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:58.242342 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.276826 26583 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:58.277210 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:58.210525 28473 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:57.837610 28413 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:58.253727 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.055680 28505 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.216130 28562 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.215049 28472 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:58.233263 28553 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:58.228633 28542 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:58.320199 26625 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:09:58.301942 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:58.276145 28504 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.292490 28543 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:58.304066 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 182683us
W20260709 13:09:58.304834 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 139623us
I20260709 13:09:58.311064 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:58.292044 28373 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.243633 28528 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:58.242057 26504 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:58.316157 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 194025us
I20260709 13:09:58.296415 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.327908 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:09:58.329308 26579 raft_consensus.cc:1240] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:58.329739 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.312008 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:58.331995 26622 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:58.312175 28481 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.340833 28473 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:58.341271 28473 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:58.316092 28397 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:58.343905 26622 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:58.338330 28413 consensus_queue.cc:1059] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:09:58.348062 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:58.349455 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.350347 26585 raft_consensus.cc:2393] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:58.349522 27240 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:58.357080 26508 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:58.358955 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:58.366400 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.366675 28373 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:58.319011 28557 consensus_queue.cc:1059] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:09:58.340085 28406 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:58.373301 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:58.373909 26657 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:09:58.375463 28407 consensus_queue.cc:1059] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:58.375844 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:58.382328 26474 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:58.379135 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:58.379602 28413 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:58.354446 28394 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:09:58.341671 28473 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.380388 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:09:58.371910 28554 consensus_meta.cc:287] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.774s	user 0.007s	sys 0.004s
I20260709 13:09:58.319451 28472 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.376040 28536 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:58.381940 28514 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:58.399708 28557 raft_consensus.cc:3055] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:58.399827 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:58.339638 28568 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.329849 28542 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.404646 26622 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:58.341621 28392 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:58.400187 28550 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:58.408329 28399 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:58.408654 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:58.369666 28510 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.369755 28463 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:58.407692 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:58.380419 28493 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:58.383642 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 47591.2us
I20260709 13:09:58.398732 28406 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:58.400880 28413 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:58.433235 26585 raft_consensus.cc:2393] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:58.405536 28571 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.369481 28543 consensus_queue.cc:1059] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:09:58.433923 26655 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.406282 28519 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:58.435415 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:58.382012 28397 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.418277 28574 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:09:58.401746 28573 consensus_queue.cc:1059] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:09:58.409533 28566 consensus_queue.cc:1059] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 13:09:58.516827 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.498664 28399 raft_consensus.cc:697] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:58.626506 28490 raft_consensus.cc:3055] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:58.626963 28490 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:58.627022 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.627857 28395 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.417013 28479 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:58.628634 28490 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:58.629379 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 221744us
I20260709 13:09:58.630389 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2348) took 1226 ms. Trace:
I20260709 13:09:58.630779 26584 rpcz_store.cc:276] 0709 13:09:57.403733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.407214 (+  3481us) service_pool.cc:224] Handling call
0709 13:09:57.450211 (+ 42997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.264551 (+814340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.629980 (+365429us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54003d1154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:58.630179 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1751562496}
I20260709 13:09:58.631705 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:58.632140 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:58.632207 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:58.516139 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.638266 26580 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:58.632292 26652 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:58.516645 26579 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:58.498306 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:09:58.622669 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.618611 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 233561us
I20260709 13:09:58.405707 28553 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.641115 26654 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:58.407259 28528 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.641630 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:58.438714 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:58.640514 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.640245 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.644526 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:58.413843 28462 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:58.632611 28488 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.652422 26657 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:58.654989 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.649892 26579 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:58.656148 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.657332 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:58.426729 28557 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:58.657243 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.418497 28522 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:58.432637 28521 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:58.644613 28392 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:58.662010 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:58.701749 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.702886 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.703897 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.704800 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 209) took 1108 ms. Trace:
W20260709 13:09:58.495048 28478 consensus_meta.cc:287] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.823s	user 0.012s	sys 0.000s
I20260709 13:09:58.659925 28424 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:58.689271 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.714008 26655 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:58.745512 26576 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:09:58.418401 28498 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.232s
W20260709 13:09:58.780521 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 111064us
I20260709 13:09:58.642966 28406 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.640214 28505 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:58.416456 28554 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.496992 28575 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:58.807039 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:58.808491 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.810014 28392 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:58.811410 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:58.813630 28413 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.814877 28413 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:58.780553 28528 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.437054 28542 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:58.437186 28548 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:58.547587 28568 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.626811 28399 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.705252 26504 rpcz_store.cc:276] 0709 13:09:57.596210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.610373 (+ 14163us) service_pool.cc:224] Handling call
0709 13:09:57.610644 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.334533 (+723889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.704584 (+370051us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54003525d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:58.704744 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433182080}
W20260709 13:09:58.818249 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 176978us
I20260709 13:09:58.843230 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:09:58.816263 28466 consensus_meta.cc:287] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.005s
I20260709 13:09:58.846413 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:58.820122 26506 raft_consensus.cc:2393] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:58.819870 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:58.825938 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:58.850186 26581 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:58.811067 28462 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:58.828970 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:09:58.806059 28511 consensus_meta.cc:287] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.711s	user 0.005s	sys 0.006s
I20260709 13:09:58.830296 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:58.787097 26585 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:58.654493 28519 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.157s
I20260709 13:09:58.862313 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:58.884461 26579 raft_consensus.cc:3055] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:58.861475 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:58.885906 28569 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.884882 26579 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:58.887006 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.873818 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.788774 28478 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.890378 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.826592 26652 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
W20260709 13:09:58.875514 26476 leader_election.cc:336] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.526s (SENT)
I20260709 13:09:58.894078 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:58.894260 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:58.830756 28548 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:09:58.902449 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 498475us
I20260709 13:09:58.893606 26579 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.905304 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2285) took 1271 ms. Trace:
I20260709 13:09:58.905943 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:58.857779 28397 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:58.905819 26502 rpcz_store.cc:276] 0709 13:09:57.634271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.110689 (+476418us) service_pool.cc:224] Handling call
0709 13:09:58.211318 (+100629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.280295 (+ 68977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.280343 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.280398 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:58.280450 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.904010 (+623560us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b54001743d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:58.905103 (+  1093us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.905245 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158160128}
I20260709 13:09:58.910772 26579 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.895938 28569 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.913599 28472 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:58.915652 28569 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:58.815636 28575 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.915295 28557 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:58.919057 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.919848 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:09:58.920499 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 47013.5us
I20260709 13:09:58.433876 28570 consensus_queue.cc:1059] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.450s
I20260709 13:09:58.829301 28579 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.925376 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:58.926173 28394 consensus_queue.cc:1059] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:58.917377 28569 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:58.930889 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:58.865968 28466 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.933616 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:58.918422 28542 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.885890 28586 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:58.889504 28511 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.917838 28575 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:58.949355 26580 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:09:58.932386 27270 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:58.932245 28519 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.947976 26581 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:09:58.890538 28462 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.948832 27276 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:09:58.939217 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:58.949210 28579 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.926234 28581 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:58.951661 26583 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:58.946331 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:09:59.054234 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 236197us
I20260709 13:09:59.009882 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:59.055579 26580 raft_consensus.cc:2393] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:09:58.948174 28563 consensus_meta.cc:287] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.838s	user 0.013s	sys 0.000s
I20260709 13:09:58.994814 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.975303 28586 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.963025 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.060441 26502 raft_consensus.cc:2393] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 2: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:59.060578 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:58.934222 28548 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.992424 28554 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:58.858466 28568 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:58.989406 28505 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:58.935393 28472 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.993940 26510 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.093418 26510 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.987601 26506 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:58.922206 28397 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.939857 28569 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.054315 26576 raft_consensus.cc:2393] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:09:59.014432 26504 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.057288 28563 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:58.989737 28587 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:09:59.066309 26476 leader_election.cc:336] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.737s (SENT)
I20260709 13:09:59.059324 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:59.015957 28488 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:59.052255 28557 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.089020 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:59.059307 26577 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:59.056043 28542 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:58.883945 28392 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:59.259742 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 206196us
I20260709 13:09:59.261926 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:59.155102 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.352979 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.240031 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:09:59.260509 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 331748us
I20260709 13:09:59.354772 26656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54888
I20260709 13:09:59.355557 26656 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.354813 26476 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.356221 26656 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.242583 26510 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.357954 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.350858 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:09:59.535193 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.357645 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 117708us
I20260709 13:09:59.514343 28488 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:59.536652 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:59.357895 26503 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 3. Ops: []
I20260709 13:09:59.537668 28467 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.152161 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:59.163192 28554 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:09:59.541345 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 475049us
I20260709 13:09:59.544963 28574 raft_consensus.cc:3055] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.545204 28554 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.545585 28565 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:59.546305 28565 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.547542 28554 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:09:59.166460 28562 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.001s
I20260709 13:09:59.548394 28565 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.548277 28562 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:59.549516 26476 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.585s (SENT)
I20260709 13:09:59.545423 28574 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:59.550139 26476 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.550876 28562 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:59.550952 28565 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.550827 28574 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:59.486856 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 134574us
I20260709 13:09:59.551757 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:59.157491 27272 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:09:59.552357 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2288) took 1917 ms. Trace:
I20260709 13:09:59.552449 27274 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.552801 26503 rpcz_store.cc:276] 0709 13:09:57.635151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.112212 (+477061us) service_pool.cc:224] Handling call
0709 13:09:58.112449 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.551607 (+1439158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.552141 (+   534us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002fba54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:59.552301 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2863868800}
I20260709 13:09:59.552173 28574 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.543500 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1516) took 1026 ms. Trace:
I20260709 13:09:59.554097 26583 rpcz_store.cc:276] 0709 13:09:58.516665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.704756 (+188091us) service_pool.cc:224] Handling call
0709 13:09:58.949917 (+245161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.055756 (+105839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.543306 (+487550us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540032f0d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:09:59.543443 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563177856}
W20260709 13:09:59.554970 26476 leader_election.cc:336] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.603s (SENT)
I20260709 13:09:59.555473 26476 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.557847 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:09:59.309279 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.563308 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:59.519995 26653 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.095472 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:59.185622 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:59.219730 26579 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:59.563320 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:59.513547 26656 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:09:59.170002 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.577615 27276 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.578076 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:59.542440 28536 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:09:59.222026 28397 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:59.357474 28469 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.580160 28469 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.166718 28586 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:59.581907 26656 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:59.584216 28528 consensus_meta.cc:287] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.000s
I20260709 13:09:59.584586 28558 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.534052 28572 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:59.584997 28558 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:59.556373 28466 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:59.538115 28553 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.585990 28558 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.538686 28550 raft_consensus.cc:3055] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:59.577276 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1526) took 1315 ms. Trace:
I20260709 13:09:59.542480 28514 raft_consensus.cc:3055] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:09:59.589064 26473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.030s	sys 0.044s
W20260709 13:09:59.591163 26473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.031s	sys 0.044s
W20260709 13:09:59.591491 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 526121us
I20260709 13:09:59.512730 28394 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:59.265406 28473 consensus_meta.cc:287] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.849s	user 0.013s	sys 0.000s
I20260709 13:09:59.250838 28478 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:59.589437 26655 rpcz_store.cc:276] 0709 13:09:58.261362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.263624 (+  2262us) service_pool.cc:224] Handling call
0709 13:09:59.577097 (+1313473us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002db254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:09:59.577216 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389905152}
I20260709 13:09:59.577307 27272 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.487272 28575 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:59.273131 28511 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.591059 28514 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:59.561501 28565 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:59.154798 28462 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.214982 28579 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:59.594597 26548 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:09:59.156594 28568 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:59.537321 28488 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.598161 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.084810 28581 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.598817 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:59.599932 26503 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.632733 26506 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:59.603006 28598 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:59.603561 28586 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:09:59.604084 28395 consensus_meta.cc:287] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.976s	user 0.012s	sys 0.000s
I20260709 13:09:59.605046 28415 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:59.605195 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.607724 28466 consensus_queue.cc:1059] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:59.611312 28593 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:59.614326 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:59.614519 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:59.514369 28587 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.619906 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:59.589355 28550 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:59.507943 28542 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.623891 26401 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34762 (request call id 319) took 4910 ms. Trace:
I20260709 13:09:59.624385 28588 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:09:59.624580 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:09:59.272311 28571 consensus_meta.cc:287] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.617s	user 0.004s	sys 0.004s
I20260709 13:09:59.663215 28488 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:59.645884 28415 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.663226 28571 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.663246 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:59.664755 28588 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.665041 28415 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:59.665135 28588 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:59.666200 28588 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.667737 28588 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.659369 26401 rpcz_store.cc:276] 0709 13:09:54.713353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.713520 (+   167us) service_pool.cc:224] Handling call
0709 13:09:59.623805 (+4910285us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:56.770621 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:56.919765 (+149144us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:56.919813 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:09:56.919842 (+    29us) tablet.cc:662] Decoding operations
0709 13:09:56.920486 (+   644us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:56.920563 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:56.920602 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:09:56.920933 (+   331us) tablet.cc:701] Row locks acquired
0709 13:09:56.920953 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:09:56.921145 (+   192us) write_op.cc:270] Start()
0709 13:09:56.921291 (+   146us) write_op.cc:276] Timestamp: P: 1783602596921081 usec, L: 0
0709 13:09:56.921329 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:09:57.088387 (+167058us) log.cc:844] Serialized 1053 byte log entry
0709 13:09:58.312128 (+1223741us) op_driver.cc:464] REPLICATION: finished
0709 13:09:58.408958 (+ 96830us) write_op.cc:301] APPLY: starting
0709 13:09:58.409037 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:58.409157 (+   120us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:58.409281 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:58.546991 (+137710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:58.623509 (+ 76518us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:09:58.641551 (+ 18042us) write_op.cc:312] APPLY: finished
0709 13:09:58.780454 (+138903us) log.cc:844] Serialized 29 byte log entry
0709 13:09:58.795171 (+ 14717us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:58.811314 (+ 16143us) write_op.cc:454] Released schema lock
0709 13:09:58.815931 (+  4617us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:58.865401 (+ 49470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:58.884922 (+ 19521us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2675,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":92868,"apply.run_cpu_time_us":3304,"apply.run_wall_time_us":432279,"num_ops":2,"prepare.queue_time_us":265732,"prepare.run_cpu_time_us":41422,"prepare.run_wall_time_us":555964,"raft.queue_time_us":617906,"raft.run_cpu_time_us":19302,"raft.run_wall_time_us":169896,"replication_time_us":1359258,"thread_start_us":432226,"threads_started":4,"wal-append.queue_time_us":221259}]]}
I20260709 13:09:59.668581 28548 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.654515 28500 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.593006 28394 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:59.624680 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:09:59.675163 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 50667.3us
I20260709 13:09:59.597393 28479 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.634028 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:59.822063 26581 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.822743 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.601436 28528 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:59.823702 28528 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.825750 28528 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.633944 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.827158 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.828375 26503 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:59.623329 28558 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.640538 28578 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.642236 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.601819 28473 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.832962 28473 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.630620 28561 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:59.833721 28561 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:59.834620 28561 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.835860 28561 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.837026 26503 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:59.644259 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:59.618408 27275 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:59.839510 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:59.840262 27275 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 2: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:09:59.841076 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:59.646351 26502 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.640113 28592 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:59.643699 28514 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.846187 28514 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.845994 28592 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.848450 28592 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.849037 28592 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:59.643685 28598 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.653483 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:59.850277 27273 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:09:59.851907 28598 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.653967 27269 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:59.853258 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 211073us
I20260709 13:09:59.657084 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.854044 26476 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:59.642920 28406 consensus_meta.cc:287] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.001s
I20260709 13:09:59.854935 28406 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.856316 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.662148 28550 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.857407 28406 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:59.857695 28550 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.858484 26476 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.859580 26476 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.861402 28598 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.861719 28586 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.629400 28575 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.862280 28598 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:59.849505 28592 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.863951 28575 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:59.644146 28511 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:59.672183 26659 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:59.162662 28589 consensus_queue.cc:1059] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.465s
I20260709 13:09:59.674665 27274 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
W20260709 13:09:59.865386 27274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 582) took 2255 ms (client timeout 1547 ms). Trace:
I20260709 13:09:59.676784 28394 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.866139 28592 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.868132 27269 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:09:59.724050 28569 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:59.655556 28593 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.872430 28593 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:59.635746 28579 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.674705 28500 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.875383 28579 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:59.875669 26476 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.876448 26502 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:09:59.876992 28574 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.730840 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1513) took 2215 ms. Trace:
I20260709 13:09:59.877348 27271 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.632714 28413 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:09:59.877868 26506 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:59.877704 26653 rpcz_store.cc:276] 0709 13:09:57.515218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.515327 (+   109us) service_pool.cc:224] Handling call
0709 13:09:57.522872 (+  7545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.568920 (+2046048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.730553 (+161633us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54002d9e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:59.730767 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4592272128}
I20260709 13:09:59.878885 28413 raft_consensus.cc:3055] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.879496 28413 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:59.879637 28473 consensus_queue.cc:1059] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:59.880318 28413 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.746851 28591 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.746966 28317 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.881316 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:59.882122 26583 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:59.881904 28317 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:09:59.749414 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.882965 26476 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:59.883224 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.884176 28317 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.750487 28570 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:59.885731 28570 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:59.886791 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:59.886643 28570 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.887966 28570 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.887534 28394 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.751085 28566 raft_consensus.cc:3055] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.887959 28569 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.889581 26583 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:59.889743 28566 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:09:59.887722 28473 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:09:59.890862 28566 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.753090 28563 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.754813 28601 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:59.892069 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:59.892779 27275 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:59.892694 28601 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.755390 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2349) took 1636 ms. Trace:
W20260709 13:09:59.756350 28541 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:09:59.747002 28415 consensus_queue.cc:1059] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:09:59.758297 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.723006 27270 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.763350 28493 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:59.764751 28395 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:59.757213 28542 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:09:59.746908 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 70709.2us
I20260709 13:09:59.767077 28568 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:09:59.766681 28465 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:59.768472 28510 raft_consensus.cc:3055] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:59.767942 28501 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.774861 26504 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:59.775300 28504 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:09:59.760509 28581 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:09:59.783812 26501 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.786026 28587 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.787207 26402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34738 (request call id 294) took 4954 ms. Trace:
I20260709 13:09:59.787204 28543 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:09:59.790251 26657 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:09:59.658332 28565 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:59.794982 28536 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:59.911679 28543 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.911718 28536 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.913527 28601 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.914115 28565 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:59.914562 28465 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:59.914820 28395 raft_consensus.cc:3055] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.915254 28395 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:59.915015 28565 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.915513 28465 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.916297 28565 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.916159 28395 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.797821 28490 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.798584 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.798471 28523 consensus_queue.cc:1059] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:59.917932 28493 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.918365 27240 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.918637 28523 raft_consensus.cc:3055] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.919044 28523 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:59.894734 26622 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:09:59.919957 28557 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:59.920238 28493 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.799324 28553 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:59.802613 26654 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:59.900312 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:59.804247 26579 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.802831 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:59.921895 28579 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.811183 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:59.748886 26510 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.771709 28469 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:09:59.865813 27274 rpcz_store.cc:269] 0709 13:09:57.609699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.675935 (+ 66236us) service_pool.cc:224] Handling call
0709 13:09:59.551589 (+1875654us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5800161a98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:09:59.865177 (+313588us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27110144}
I20260709 13:09:59.898465 28563 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:59.922881 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:59084 (request call id 2284) took 2300 ms. Trace:
I20260709 13:09:59.923853 26510 rpcz_store.cc:276] 0709 13:09:57.622736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.106954 (+484218us) service_pool.cc:224] Handling call
0709 13:09:59.726187 (+1619233us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b54002fba54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c920a3d 00007f88318f0cd0 00007f882ae75254 00007f882ae751e2 00007f882ae75111 00007f882ae7508c 00007f882ae74342 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:09:59.922822 (+196635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037995904}
I20260709 13:09:59.917877 26508 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:09:59.925595 26402 rpcz_store.cc:276] 0709 13:09:54.833312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.833623 (+   311us) service_pool.cc:224] Handling call
0709 13:09:59.787133 (+4953510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4806,"reported_tablets":6}
I20260709 13:09:59.891336 26476 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.917155 26505 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:09:59.917125 28510 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:09:59.920413 28557 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.919873 28523 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.920809 27240 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:09:59.934911 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 43656.5us
I20260709 13:09:59.904212 28399 raft_consensus.cc:3055] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.881916 28589 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:59.896440 26474 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:59.936267 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.936496 26476 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.795719 26404 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48166 (request call id 193) took 3997 ms. Trace:
I20260709 13:09:59.927098 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:09:59.936983 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.928978 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.766041 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:59.929664 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:09:59.908479 27277 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:59.924504 28542 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.938301 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:59.938269 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:59.937769 27278 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.940701 26404 rpcz_store.cc:276] 0709 13:09:55.798165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.798688 (+   523us) service_pool.cc:224] Handling call
0709 13:09:59.795647 (+3996959us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32905,"reported_tablets":4}
I20260709 13:09:59.938761 26651 raft_consensus.cc:2393] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:09:59.942363 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:09:59.935223 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.922938 26578 rpcz_store.cc:276] 0709 13:09:58.119465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.119570 (+   105us) service_pool.cc:224] Handling call
0709 13:09:58.163013 (+ 43443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.329164 (+166151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.329192 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.329226 (+    34us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:58.329261 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.755142 (+1425881us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002ef254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:09:59.755187 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.755327 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377606528}
I20260709 13:09:59.937880 26583 raft_consensus.cc:2393] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 2: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:59.812801 26549 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:09:59.930968 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:59.945194 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.945582 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.931137 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:59.916654 28465 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:59.952476 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.931949 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:09:59.932430 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:59.933287 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.954872 26654 raft_consensus.cc:2393] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 3: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:09:59.938225 28587 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.946008 26504 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:09:59.798106 26405 catalog_manager.cc:5697] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.956773 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:59.958256 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:59.958137 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:59.947573 26476 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.962136 27240 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:09:59.938397 28574 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.922426 28415 raft_consensus.cc:3055] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.933240 28462 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:59.966519 26505 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.925086 28568 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.973455 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:09:59.956959 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.980630 26651 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:09:59.981703 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.982368 26651 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:09:59.983111 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.902339 28528 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:09:59.892107 28566 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.990617 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:09:59.993119 27275 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:09:59.991119 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.971733 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.965317 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:09:59.994750 26651 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:09:59.887835 28413 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.917488 28395 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.892019 28394 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:09:59.967968 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 155244us
I20260709 13:09:59.934293 28557 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.973035 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.933056 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.938783 28523 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.915057 28536 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.923305 28563 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.984338 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.037830 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:59.933140 28543 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:09:59.944234 28558 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.940150 28541 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:00.050925 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:59.940326 28504 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.951928 28593 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:59.940071 28399 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:09:59.939682 28542 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.995738 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.061434 26651 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:09:59.957597 28493 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:09:59.999364 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.975942 26583 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.921113 28553 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:09:59.894939 28561 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:59.968776 28508 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:00.080929 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:00.002197 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.968513 28575 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:59.974269 28479 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.039080 26578 raft_consensus.cc:3055] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.973891 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.039116 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:00.094990 26503 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.001057 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:00.049129 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:00.096087 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47012.4us
I20260709 13:10:00.096506 26654 raft_consensus.cc:3055] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.096846 26654 raft_consensus.cc:740] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:09:59.968746 28554 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:00.012543 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.019920 26549 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:00.050148 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:09:59.972501 28594 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:00.102952 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 83180.2us
I20260709 13:10:00.105023 26652 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:00.109375 26656 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:00.109848 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 59825.4us
I20260709 13:10:00.051725 26577 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:09:59.973619 28415 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:00.054607 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:09:59.965157 28589 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:10:00.040056 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.060197 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:00.062474 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:00.063032 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.058149 28558 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.116703 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:00.108122 26654 consensus_queue.cc:260] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.117888 27243 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:00.118110 26654 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.057950 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.066998 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:09:59.986290 28574 raft_consensus.cc:697] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:00.073386 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:00.075141 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:09:59.989068 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:09:59.997650 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.080525 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:00.084815 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.084827 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.124377 26658 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:00.126964 26658 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:00.078822 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.019291 28511 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.089537 26578 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:00.058502 28514 consensus_queue.cc:1059] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:09:59.986007 28462 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.087564 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.088073 28575 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:00.139967 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:00.111943 26579 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:10:00.112892 26505 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:00.113029 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.106510 28599 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.121521 26657 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:00.082623 28593 raft_consensus.cc:697] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:00.137784 26658 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:00.080475 28493 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:09:59.999714 28528 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.095953 28561 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:00.060408 28541 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.108824 28536 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:00.130402 26578 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.172726 26657 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:00.213716 26657 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:00.121434 28581 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.175203 27243 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:00.226598 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 51518.7us
W20260709 13:10:00.176224 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.183914 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.229113 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.122315 28394 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.187186 28476 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:00.183527 28599 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.188316 27269 raft_consensus.cc:2393] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:00.234913 28609 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:00.235654 28609 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.236204 28598 raft_consensus.cc:3055] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:00.236582 28598 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:00.236810 26651 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.132817 28488 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:00.237859 28488 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:00.234985 28415 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.238345 28488 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:00.190294 28582 consensus_queue.cc:1059] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:10:00.239703 28582 raft_consensus.cc:3055] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:00.240079 28582 raft_consensus.cc:740] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:00.236603 26576 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.123483 28478 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.240904 28582 consensus_queue.cc:260] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.252224 28582 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.140403 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.133714 28400 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.139012 27274 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.197412 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.134449 28540 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.052596 28510 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.154589 28575 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.214524 28536 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.236972 27277 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 2: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:00.189545 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.195749 28558 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:00.294098 26656 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:00.191118 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:00.223901 28574 consensus_queue.cc:237] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.306703 28400 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.255119 28596 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:00.314483 27275 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.315537 28568 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:00.312386 28536 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.319844 28553 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.321856 28561 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.344789 28541 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:00.328140 28593 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.350446 28467 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.351014 28467 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.351362 28609 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.352073 28528 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.327479 28508 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:00.361197 28563 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.365588 28510 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.347200 28599 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:00.407704 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.281206 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 189400us
W20260709 13:10:00.415369 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.415263 26625 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:00.418275 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 311386us
I20260709 13:10:00.424116 26651 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:00.346364 27278 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:00.443698 28400 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:00.316282 28488 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.448180 28488 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:00.431018 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.431577 27270 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:00.432369 26650 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:00.324627 28399 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.357473 28508 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:00.455245 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.458770 28612 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:00.346967 28493 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:00.460012 28612 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:00.466042 28504 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.469383 28587 consensus_meta.cc:287] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.504s	user 0.028s	sys 0.027s
I20260709 13:10:00.469106 28504 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:00.469856 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 48737.3us
I20260709 13:10:00.470247 28587 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.471125 26622 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:00.469226 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:00.474675 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 57234.3us
I20260709 13:10:00.483481 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.487142 26576 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:00.492600 28612 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:00.460008 28501 consensus_meta.cc:287] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.548s	user 0.005s	sys 0.005s
I20260709 13:10:00.501919 28406 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.502648 28406 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:00.507860 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.508278 28563 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:00.508327 28528 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.509128 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.510411 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.510030 28528 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.511590 26655 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:00.514508 26503 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:00.518493 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.520376 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:00.522542 26653 consensus_meta.cc:287] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.009s
I20260709 13:10:00.524735 26583 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:00.526430 28593 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.527944 28490 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.611s	user 0.005s	sys 0.013s
I20260709 13:10:00.564007 28593 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.567175 28473 raft_consensus.cc:3055] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:00.568328 26577 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:10:00.568475 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.569705 26585 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:10:00.570909 26655 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:00.567616 28528 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.539816 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:00.569718 28542 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.573370 26653 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
W20260709 13:10:00.575820 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.567672 28473 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:00.577466 28473 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.554876 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:00.558773 28581 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.473233 28504 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.567616 28593 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:00.587262 27276 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:00.588233 28562 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.588970 28562 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.597434 28473 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:00.598500 28406 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.504321 26650 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:00.610664 27241 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:00.611639 26654 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:00.612115 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:00.613281 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:00.614769 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.614876 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.619423 28415 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.621405 28462 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.623767 27274 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:00.628926 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.629055 28582 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:00.657318 28582 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.658916 26581 raft_consensus.cc:2393] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:00.659886 28582 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:00.660545 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50070.3us
I20260709 13:10:00.661412 27241 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:00.663599 27241 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:00.664489 28593 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.665378 28593 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:00.666056 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 195200us
W20260709 13:10:00.666326 28566 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.646s	user 0.014s	sys 0.014s
I20260709 13:10:00.667438 28566 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.668298 26622 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:00.672297 27269 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:00.631258 28467 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.632867 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:00.633839 28573 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:00.673159 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.674116 27243 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:00.634346 26652 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:00.639338 28536 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.639596 26625 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:00.674942 28573 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:00.679003 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 84283.5us
I20260709 13:10:00.680825 28573 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.681977 28573 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.683692 26585 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:00.703426 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.706355 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.707648 26583 raft_consensus.cc:2393] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 2: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:00.708974 27275 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:00.685182 26625 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:00.709939 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.687047 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:00.691990 28557 consensus_meta.cc:287] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.643s	user 0.015s	sys 0.007s
I20260709 13:10:00.715003 26658 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:00.715087 28544 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.714991 27277 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:00.686640 28462 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.726904 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.717026 28536 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.716586 28578 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.723872 26622 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:00.724195 28588 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.694032 28548 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:00.696135 28612 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.694818 28406 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:00.732363 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:00.725142 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.734455 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 69428.2us
I20260709 13:10:00.738304 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:00.740658 28612 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.734513 28548 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.742045 28548 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.743148 28612 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:00.744016 28588 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.748368 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:00.748884 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.749089 26502 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:00.749545 27275 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:00.688622 28575 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:00.753717 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 69335.7us
I20260709 13:10:00.755195 26476 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:00.755416 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:00.756038 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.763875 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.755903 28574 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.749954 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:00.758625 28565 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.842s	user 0.014s	sys 0.012s
I20260709 13:10:00.736726 28528 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:00.777041 26582 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:00.777272 28528 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:00.777806 28528 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.781847 28406 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:00.782272 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 320) took 1168 ms. Trace:
I20260709 13:10:00.782707 27276 rpcz_store.cc:276] 0709 13:09:59.614230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.616664 (+  2434us) service_pool.cc:224] Handling call
0709 13:10:00.782037 (+1165373us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b5400760f54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:00.782201 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043362176}
I20260709 13:10:00.759370 26578 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.759564 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:00.785960 27278 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.760383 27274 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:00.723888 28544 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.686805 28540 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:10:00.774947 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.776598 26580 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:10:00.787089 27243 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:00.791134 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.784793 28395 consensus_meta.cc:287] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.765s	user 0.005s	sys 0.014s
I20260709 13:10:00.794659 26584 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:00.731905 28557 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.785370 28548 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.793224 28488 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:00.775415 28574 raft_consensus.cc:697] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:00.800861 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:00.801205 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:00.801625 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:00.802009 26505 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:00.806047 26501 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:00.811218 26578 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
W20260709 13:10:00.806557 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 82879.1us
I20260709 13:10:00.806792 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:00.815503 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.817409 26503 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:00.819535 28548 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:00.821058 28394 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:00.821547 27278 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:00.821827 28394 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.824290 28394 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.826093 28544 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.827041 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.827594 28562 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:00.830901 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.809741 28488 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.816058 28565 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:00.847826 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 92849.2us
I20260709 13:10:00.845888 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.849725 26504 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.857823 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:00.858567 26579 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.859200 28511 consensus_queue.cc:1059] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:10:00.860451 28511 raft_consensus.cc:3055] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:00.860805 28511 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:00.861690 28413 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.814s	user 0.005s	sys 0.017s
I20260709 13:10:00.862035 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:00.862422 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:00.862939 26506 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:10:00.863839 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:00.864473 26581 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:00.864914 26654 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:00.842837 28488 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.865840 28473 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.866539 28500 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:00.867097 28500 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:00.867551 28500 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:00.873946 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 57257.1us
I20260709 13:10:00.874888 26625 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:00.875908 26625 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:00.877877 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.878239 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.878646 26578 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:00.878995 28394 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:00.879567 28394 raft_consensus.cc:697] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:00.879974 26581 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:00.880548 28544 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.866550 28473 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:00.880594 28394 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.881280 28544 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:00.882128 28473 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.882390 28544 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.884218 26622 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:00.884783 26659 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:00.885982 28542 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:00.886934 26584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1519) took 2369 ms (client timeout 1547 ms). Trace:
I20260709 13:10:00.887609 28395 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.888166 27241 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:00.888430 28561 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:10:00.889964 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.890242 28399 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.890635 28557 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:00.887367 26584 rpcz_store.cc:269] 0709 13:09:58.517543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.631884 (+114341us) service_pool.cc:224] Handling call
0709 13:10:00.886717 (+2254833us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b540015cf54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:00.886844 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4108768640}
I20260709 13:10:00.888198 28395 raft_consensus.cc:697] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:00.894107 28588 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:00.894798 28395 consensus_queue.cc:237] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.896689 28598 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:00.898499 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.900992 28511 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.902840 28511 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.904774 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:00.905411 26659 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:00.905958 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 169829us
W20260709 13:10:00.908034 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.912489 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:00.913465 27278 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:00.914216 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.914887 28562 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.915264 26650 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:10:00.833483 28528 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.915951 26405 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34748 (request call id 318) took 2541 ms. Trace:
I20260709 13:10:00.917640 28528 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:00.919114 28575 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:00.920084 26502 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:00.922267 27243 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:00.924127 27241 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:00.924954 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:00.925485 28540 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.925868 26510 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:00.926090 28540 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.927392 28565 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:00.927559 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:00.928328 28540 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:00.928875 28540 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:00.929239 28540 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.929710 28588 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:00.930070 26476 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:00.932598 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.936151 26504 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:00.938545 28540 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.944396 28591 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.946653 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:00.951157 28573 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.946445 28574 consensus_queue.cc:237] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:00.953461 28500 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:00.954839 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:00.865278 26549 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:00.953934 28591 raft_consensus.cc:697] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:00.961530 28566 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:01.000582 26510 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:10:01.004091 28566 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:00.965682 28488 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.014820 28573 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:01.016644 28488 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:00.969872 28562 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:01.018561 28562 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.020180 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:01.020922 26580 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.021256 26579 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:00.974113 28598 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.026381 27243 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:01.026721 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:01.027387 26503 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.029987 28573 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:01.031726 28573 raft_consensus.cc:697] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:01.033849 26650 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:00.965519 26659 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:01.036597 26659 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:01.036975 26503 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:01.038131 26650 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:01.038375 27240 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:01.039299 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:01.039951 28566 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:01.040078 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:01.040812 28566 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:01.041015 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:01.041939 28566 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.042512 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:01.043637 26582 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:01.043815 26650 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:01.045451 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.983700 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:01.046213 26584 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.047256 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:01.048036 26585 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:01.049292 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.984334 26581 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:10:01.050094 26585 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:00.987610 28536 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:01.051196 28536 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:01.052122 28536 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:00.988016 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 122850us
W20260709 13:10:01.053702 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.982189 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:01.054241 26549 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:01.055083 26502 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.056774 26549 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:00.994072 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:00.995965 28591 consensus_queue.cc:237] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:01.058632 26578 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
W20260709 13:10:00.994638 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 109214us
I20260709 13:10:01.042565 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:01.063268 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 309923us
I20260709 13:10:00.979741 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.066569 26580 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:01.083348 26584 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:01.046276 26582 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:01.033308 28573 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.133836 26504 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:01.139364 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:00.987798 28500 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:00.916324 26405 rpcz_store.cc:276] 0709 13:09:58.374839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.376713 (+  1874us) service_pool.cc:224] Handling call
0709 13:09:59.547283 (+1170570us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b540013f454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c893090 00007f882c931f3a 00007f88326e81cc 00007f88327e637e 00007f8830ca72a4 00007f8830ca7232 00007f8830ca7161 00007f8830ca70dc 00007f8830ca6392 00007f882ac6448c 00007f882ac638c6
0709 13:10:00.915734 (+1368451us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:00.191198 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:00.194392 (+  3194us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:00.194442 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:10:00.194461 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:00.194954 (+   493us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:00.195035 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:00.195065 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:00.195257 (+   192us) tablet.cc:701] Row locks acquired
0709 13:10:00.195274 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:10:00.195417 (+   143us) write_op.cc:270] Start()
0709 13:10:00.195538 (+   121us) write_op.cc:276] Timestamp: P: 1783602600195365 usec, L: 0
0709 13:10:00.195565 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:10:00.196333 (+   768us) log.cc:844] Serialized 544 byte log entry
0709 13:10:00.376907 (+180574us) op_driver.cc:464] REPLICATION: finished
0709 13:10:00.476460 (+ 99553us) write_op.cc:301] APPLY: starting
0709 13:10:00.476790 (+   330us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:00.477155 (+   365us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:00.477419 (+   264us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:00.477958 (+   539us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:00.478537 (+   579us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:10:00.478629 (+    92us) write_op.cc:312] APPLY: finished
0709 13:10:00.500289 (+ 21660us) log.cc:844] Serialized 23 byte log entry
0709 13:10:00.501002 (+   713us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:00.501268 (+   266us) write_op.cc:454] Released schema lock
0709 13:10:00.501355 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:00.514009 (+ 12654us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:00.514057 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56825,"reported_tablets":9,"spinlock_wait_cycles":58019584,"child_traces":[["op",{"apply.queue_time_us":97537,"apply.run_cpu_time_us":6553,"apply.run_wall_time_us":26263,"num_ops":1,"prepare.queue_time_us":233998,"prepare.run_cpu_time_us":6998,"prepare.run_wall_time_us":115093,"raft.queue_time_us":32731,"raft.run_cpu_time_us":5044,"raft.run_wall_time_us":138193,"replication_time_us":181193,"thread_start_us":721046,"threads_started":4,"wal-append.queue_time_us":121437}]]}
W20260709 13:10:01.145247 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.147148 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:01.149008 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:01.133597 28504 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.977219 28540 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.156401 26579 raft_consensus.cc:2393] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:01.143832 28548 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:01.160156 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 103577us
W20260709 13:10:01.165990 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 251135us
I20260709 13:10:01.154386 28400 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:01.143860 28575 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:10:01.150619 28598 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.174095 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:01.163930 28462 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:01.171870 28469 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.196228 26548 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:01.169126 28548 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:01.198580 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.170974 28400 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.200549 26474 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:01.171938 28543 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:01.182777 28544 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:01.202169 26625 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:01.182035 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:01.210570 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:01.215188 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:01.184303 28479 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.215480 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:01.172143 28504 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.230492 26577 raft_consensus.cc:2368] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3.
W20260709 13:10:01.233781 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 56024.4us
I20260709 13:10:01.237946 26585 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.182924 28598 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:01.221161 28400 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.222651 28578 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:01.224365 28544 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.236166 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:01.214768 28317 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.266100 28511 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:01.271000 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.271737 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.231966 26650 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:01.274420 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.231304 28570 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:01.248759 28578 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:01.275810 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.276620 26507 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:01.279230 28548 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.282524 28540 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:01.211215 28469 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:01.284868 28504 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:01.285655 28469 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:01.255237 28544 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:01.290233 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 113378us
I20260709 13:10:01.291595 26474 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:01.249050 28508 consensus_queue.cc:1059] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 13:10:01.295010 28508 raft_consensus.cc:3055] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.295588 28508 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:01.296609 28508 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.245906 28543 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:01.273551 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.305459 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:01.306006 26506 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:10:01.306154 26584 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.246346 28462 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:01.314612 26474 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:01.245729 28394 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:01.317394 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.329761 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:01.332515 27276 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:01.252152 28574 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.336277 26502 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:10:01.338651 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:01.339390 27278 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:01.275835 28578 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:01.348839 26585 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:01.266156 28500 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:01.310171 28504 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:01.349833 28399 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:01.370091 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:01.370245 28399 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:01.370769 28399 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.372210 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:01.373000 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.373456 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.359547 28490 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.374045 26506 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:01.374222 28490 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.375245 26507 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:01.376101 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.376547 28490 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:01.376994 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:01.356050 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:01.378034 27270 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:01.378530 27240 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:01.378700 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:01.353538 28500 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:01.379712 26625 leader_election.cc:400] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3.
I20260709 13:10:01.379840 28500 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.380064 26625 leader_election.cc:403] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:10:01.380425 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.380826 26625 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:01.364487 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:01.381636 28542 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.381732 28557 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:01.382083 27269 raft_consensus.cc:2368] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:01.382292 28557 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:01.365379 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:01.383049 27278 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:01.334952 28317 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.383267 28557 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.385170 28317 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:01.379369 27276 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:01.366942 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.369154 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:01.355945 28574 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.387650 28562 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.388213 28562 raft_consensus.cc:697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:01.379352 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:01.389156 28562 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.389727 28317 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:01.390691 28400 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.394613 26584 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:01.392643 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:01.393829 28575 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:01.393893 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:01.391223 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:01.389249 28598 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:01.398811 28400 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:01.326206 28462 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.403807 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:01.404963 28543 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:01.396936 28544 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:01.426646 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:01.405835 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:01.427372 26654 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:01.334509 28394 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.428179 28394 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:01.408891 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.429523 27241 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:01.430356 28566 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:01.409080 27243 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:01.430836 28566 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.431247 28540 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:01.431988 28540 raft_consensus.cc:697] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:01.416301 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:01.432921 26659 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:10:01.420047 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 129210us
I20260709 13:10:01.397708 28500 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.433226 28540 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.431293 28566 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.435396 28500 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:01.436929 26549 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:01.422575 27277 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.439018 28500 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:01.439860 28500 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:01.419425 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 183364us
I20260709 13:10:01.441424 28479 raft_consensus.cc:697] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:01.442186 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:01.443195 28582 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:01.443164 28479 consensus_queue.cc:237] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:01.444119 28582 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:01.445493 28582 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.446998 26549 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:01.451572 26549 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:01.452260 28473 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:01.452983 26549 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:01.454512 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 73758.8us
I20260709 13:10:01.414256 28508 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.459950 28561 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.461338 28544 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:01.463902 28566 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.422387 28462 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:01.426928 28542 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3.
W20260709 13:10:01.473135 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 82024.2us
W20260709 13:10:01.474009 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 56622.9us
I20260709 13:10:01.454435 28500 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:01.426179 28317 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:01.516624 28317 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:01.518496 28317 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.417138 28575 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.492391 26659 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:01.492476 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:01.501912 27277 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:01.503448 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.505996 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:01.509828 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:01.523552 26585 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:01.511554 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:01.510898 26582 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:10:01.515411 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 62590.6us
I20260709 13:10:01.466871 27274 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 3. Ops: []
I20260709 13:10:01.523455 27241 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:01.515537 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:01.524554 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:01.530747 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.522099 28536 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:01.558218 26579 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:01.554636 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:01.556737 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.559897 26506 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:01.555950 26503 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:01.559216 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:01.563956 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:01.564610 26502 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.534525 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:01.549049 28490 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:01.568104 26549 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:01.568651 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 62741.3us
I20260709 13:10:01.563230 26473 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:01.573691 28395 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:01.573756 28511 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:01.574398 28511 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.574824 28511 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.576125 26474 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:01.553876 28543 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.574996 26504 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.596554 26585 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:01.588621 28399 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:01.599565 26549 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:01.601775 28469 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:01.600770 26549 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:01.575297 27269 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:01.566550 28644 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:01.617426 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.572077 28536 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:01.794381 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.682475 27270 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:01.630340 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45465.4us
W20260709 13:10:01.767971 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 135160us
I20260709 13:10:01.587110 28490 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:01.721812 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.808983 26504 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:01.806679 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:01.769006 26502 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:01.605146 28641 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:01.784240 28570 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.782640 28628 log.cc:927] Time spent T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.152s	user 0.000s	sys 0.007s
I20260709 13:10:01.568142 28542 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:10:01.788514 26476 leader_election.cc:336] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.553s (SENT)
I20260709 13:10:01.825206 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:01.799978 28469 raft_consensus.cc:2764] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:10:01.829475 28651 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.809316 26508 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:01.830034 28651 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:01.814513 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 238478us
I20260709 13:10:01.831441 26474 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:01.820464 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 219773us
I20260709 13:10:01.823915 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:01.838639 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:01.828493 26579 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:01.828944 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 44270us
I20260709 13:10:01.805371 28575 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:01.846799 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.814747 28504 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:01.866734 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 65548us
I20260709 13:10:01.813979 28508 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:01.858654 26476 leader_election.cc:336] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.685s (SENT)
I20260709 13:10:01.885391 26476 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:01.895161 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 63789.2us
I20260709 13:10:01.832223 28406 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:01.846814 28542 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:01.843979 28641 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:01.851028 28644 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:01.852917 28566 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:01.825378 28570 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:01.902215 28651 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:01.928946 26584 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:01.929216 26580 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:01.846671 28557 consensus_queue.cc:1059] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:10:01.922325 26503 raft_consensus.cc:1240] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:01.930974 26501 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:01.919211 26548 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:01.921260 26585 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.911356 28542 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.907738 28406 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.912829 28644 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.933954 26582 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:01.934321 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:01.935132 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.919032 28653 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:01.937798 28394 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:01.938865 28648 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:10:01.940037 28394 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:01.930724 28591 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:01.926944 28638 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.942241 28638 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:01.944224 28638 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:01.945122 28536 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:01.917416 28490 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:01.950030 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:01.953264 26576 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.955518 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:01.961651 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.972525 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 75972.4us
I20260709 13:10:01.950493 26583 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:01.987517 26581 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:01.988867 26578 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:01.993521 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:01.993726 28536 consensus_queue.cc:1059] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.994526 26508 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:01.995602 28582 raft_consensus.cc:3055] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:01.996105 28582 raft_consensus.cc:740] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:01.998056 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:01.998816 26503 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.018047 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.018824 26650 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:10:01.951280 28542 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.915270 28508 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.056442 26659 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:02.025257 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:02.057718 26654 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.022516 27241 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:10:02.031155 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.951159 28406 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.952909 28644 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:02.060745 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 214857us
W20260709 13:10:02.060812 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 202210us
I20260709 13:10:02.054885 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:02.062801 26503 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:02.063490 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:02.063696 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 48963.3us
I20260709 13:10:02.064505 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.061381 26622 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:02.062428 28415 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:02.073297 28415 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:02.073690 28415 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:02.073850 28646 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:10:02.074227 28508 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:02.074815 28651 consensus_queue.cc:1059] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:02.075286 28637 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.288s	user 0.000s	sys 0.000s
I20260709 13:10:02.075960 28651 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.076522 28651 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.079496 28473 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.079988 28473 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.081786 28591 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:02.082105 28647 log.cc:927] Time spent T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:10:02.082231 28591 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:02.083324 28657 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:02.060384 28462 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.083232 28591 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.083789 28657 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:02.084223 28657 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.084581 28591 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.075037 28570 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.081137 28415 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.071484 28548 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:10:02.096601 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:02.097304 28415 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.090950 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.059825 28511 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.097793 28659 raft_consensus.cc:2764] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:10:02.097903 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:02.098173 26655 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:02.098580 28659 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:02.099542 28511 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:02.100309 28395 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:02.071993 26652 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:02.101884 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:02.091557 28462 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:02.094110 28473 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.095263 28543 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:02.095361 28651 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.106079 28653 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.107672 28582 consensus_queue.cc:260] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:02.109149 28578 consensus_meta.cc:287] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.749s	user 0.006s	sys 0.004s
I20260709 13:10:02.111652 26654 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:02.073876 28643 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:02.114768 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:02.119463 28654 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:10:02.120613 28399 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.147547 27277 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:02.150241 26503 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.121730 28664 raft_consensus.cc:3055] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.122520 26508 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:02.123703 28574 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:02.163686 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.163867 28542 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.085222 28641 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.166014 26652 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.165900 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:02.144477 28643 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.166683 26505 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:02.166780 28643 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:02.124634 28561 consensus_meta.cc:287] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.627s	user 0.000s	sys 0.009s
I20260709 13:10:02.112329 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:02.172675 28561 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:02.150671 28578 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.150101 26476 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:02.149545 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:02.152726 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.148910 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:02.175417 27273 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:02.153504 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50632.8us
I20260709 13:10:02.160060 28582 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.179679 26652 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:02.149689 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:02.149179 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:02.173846 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.170614 26548 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:02.189757 26651 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:02.146082 26622 leader_election.cc:400] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:02.191912 26622 leader_election.cc:403] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:02.193698 26659 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:02.194271 26653 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:10:02.195137 28659 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
W20260709 13:10:02.202662 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 56725.4us
I20260709 13:10:02.178592 27275 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:02.155040 28664 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:02.178651 26503 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:02.205144 28664 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.205706 28578 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.206465 28664 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.209115 27273 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:02.169545 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:02.139243 28557 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:02.187500 28406 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.149032 27270 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:02.203179 27274 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.150830 28653 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:02.214066 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 64053.6us
I20260709 13:10:02.215399 28653 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.191038 28561 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.216110 28653 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:02.216403 28561 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.216918 28653 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.218063 28557 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.220745 27241 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:10:02.220854 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50956.9us
I20260709 13:10:02.220045 27271 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:02.221064 28557 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.185755 28566 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:02.223646 28557 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:02.224514 26474 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:02.225528 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 54988.8us
I20260709 13:10:02.203919 28542 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:02.226513 28406 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:02.218645 28561 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.227367 28655 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:02.232190 28653 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:02.227927 28570 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:02.228978 26476 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:02.233217 28548 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.229741 28591 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.233840 28548 raft_consensus.cc:697] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:02.234864 28661 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:02.234778 28548 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.235440 28644 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.236152 26476 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:02.236790 26650 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:02.235327 28661 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.187402 28650 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:02.244854 26503 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:02.204010 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:02.243521 28399 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:02.243852 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:02.239537 26549 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:02.246091 26502 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:02.247593 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:02.244416 28673 log.cc:927] Time spent T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:10:02.263280 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 59350.9us
I20260709 13:10:02.264539 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:02.250633 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:02.245222 28574 consensus_queue.cc:1059] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:10:02.266374 28574 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:02.245709 28661 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:02.255316 28543 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:02.285146 26502 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
W20260709 13:10:02.301873 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 51354.5us
W20260709 13:10:02.303707 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 56184.2us
I20260709 13:10:02.242218 28561 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:02.305869 26549 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:02.308864 26502 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:02.262405 28582 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:02.312865 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:02.266857 28574 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:02.245966 28591 consensus_queue.cc:1059] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:10:02.257701 28651 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:10:02.304061 28578 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.320861 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:02.321828 26508 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:02.322682 26503 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.324677 26655 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:02.325707 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:02.307103 28542 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:02.326287 26510 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.304804 28406 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:02.306869 28543 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:02.327069 26502 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:02.329489 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:02.315853 28582 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.333801 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:02.334484 26506 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
W20260709 13:10:02.335688 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.329080 28668 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:02.320039 28653 raft_consensus.cc:476] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:02.316558 28473 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:10:02.344205 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:02.329957 28578 raft_consensus.cc:697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:02.348827 28578 consensus_queue.cc:237] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.329452 28462 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.331992 28406 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:02.354843 28643 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.333753 28582 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:02.336167 28543 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.333110 28598 raft_consensus.cc:3055] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.425685 28598 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:02.426631 28598 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.428022 28598 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.356637 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:02.430254 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 73715.1us
I20260709 13:10:02.362237 28400 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.433934 28400 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.434964 26576 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:02.436229 28400 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:02.336961 28668 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.362465 27274 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:02.363133 26659 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:02.376744 28462 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.392040 28644 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:02.377669 28657 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.399760 28643 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.403178 27240 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:02.382125 28395 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:10:02.404336 28588 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:02.411556 26582 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:02.412034 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:02.433437 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.449674 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.413327 28661 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.414142 26581 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:02.414688 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:02.416692 26650 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:02.418848 26473 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:02.465464 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 46680.2us
I20260709 13:10:02.466498 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:02.419435 28651 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:02.346136 28542 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.454911 26578 raft_consensus.cc:2393] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 2: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:02.436609 28659 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:02.486227 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:02.436798 28668 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.489387 26578 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.490947 28657 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:02.495170 26576 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:02.496740 28488 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:02.496815 28665 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.495270 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:02.497872 26502 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:02.378841 28406 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.476708 26504 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.478961 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:02.497354 28488 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.503266 28508 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:02.503031 28542 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.503882 28508 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.504505 28488 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.505193 28542 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:02.505764 28644 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:02.506480 28644 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.509061 26651 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.510059 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:02.510623 26651 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.478880 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:02.511992 26582 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:02.499279 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.512305 26652 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.512768 26659 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:02.409222 28582 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.474048 26510 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
W20260709 13:10:02.518914 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 67021.1us
I20260709 13:10:02.521365 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.522490 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:02.511270 28462 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:02.535583 26503 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:02.476642 28561 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:02.538163 26654 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:02.523597 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.548889 26508 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.549250 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:02.494072 28399 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:02.552331 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:02.554051 26658 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:02.566025 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:02.572571 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.579159 26548 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:02.586208 26504 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:02.544680 26405 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 5, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 5 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:02.590552 26405 catalog_manager.cc:5697] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 3 to 4, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 4 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.518079 28659 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:02.594611 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.594236 26405 catalog_manager.cc:5697] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 3 to 4, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 4 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.588382 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:02.598774 26507 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:02.441239 28574 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.572005 28536 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.564182 28399 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.604657 26502 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:02.618379 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:02.600430 26405 catalog_manager.cc:5697] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.572515 28644 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:02.618947 28659 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.620404 26405 catalog_manager.cc:5697] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.622381 26405 catalog_manager.cc:5697] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 3, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.623121 26507 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:02.624511 26507 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.623962 26405 catalog_manager.cc:5697] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 3, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 3 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.625422 26405 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 5, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 5 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:10:02.626222 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 46057.3us
I20260709 13:10:02.628868 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.574186 28557 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:02.574465 28653 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:02.610531 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:02.577431 28500 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:02.654619 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.571563 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.633487 26548 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:02.635813 26658 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:02.588120 28561 raft_consensus.cc:697] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:02.648765 26507 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.593437 28488 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:02.665684 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 262579us
I20260709 13:10:02.662415 26657 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:02.598802 28655 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:02.669090 26651 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:02.627435 28657 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.631150 28399 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.686179 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:02.610517 28490 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:02.588876 28469 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:10:02.690742 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:02.691704 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:02.698693 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:02.699653 26651 raft_consensus.cc:2368] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4.
I20260709 13:10:02.693889 28511 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.705041 28511 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.705545 28641 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:02.706091 28641 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:02.706883 28641 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.709054 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:02.522923 28665 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.707295 28511 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:02.708858 28543 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.683537 28566 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:02.674674 28500 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:02.716935 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:02.661375 28548 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:10:02.696589 28574 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:02.705283 28661 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.689890 28536 raft_consensus.cc:697] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:02.747768 26655 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:02.654848 28557 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.675370 28650 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:10:02.734757 26507 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:02.767774 26501 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:02.712473 28655 raft_consensus.cc:697] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:02.676937 28488 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:02.770653 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 56317.5us
I20260709 13:10:02.770787 26508 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:10:02.781728 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 53782us
I20260709 13:10:02.674477 28653 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.701886 28657 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:02.793044 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 272747us
I20260709 13:10:02.799868 26622 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:02.800904 26625 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:02.804301 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:02.715044 28504 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:10:02.766721 28400 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:02.721467 28406 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.710908 28490 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.785938 28566 raft_consensus.cc:697] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:02.845355 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 211934us
I20260709 13:10:02.808171 28644 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:02.886682 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:02.896678 27275 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:02.837688 28582 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.808099 28542 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:10:02.847353 28664 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:02.839318 28394 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:02.886549 28672 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:02.807973 28544 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:10:02.808034 28528 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:10:02.925431 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:02.951063 26508 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:02.886209 28663 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:02.894861 28668 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:02.814193 28561 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.903191 28644 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.843015 28400 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.926059 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:03.032315 26652 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:03.020047 26582 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:02.903445 28500 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.035118 28680 consensus_queue.cc:1059] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.291s
I20260709 13:10:03.040311 28680 raft_consensus.cc:3055] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:03.040695 28680 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:03.038864 28679 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.251s
I20260709 13:10:03.037653 28665 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:03.043198 28657 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:03.043375 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:03.043553 28395 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.044296 27274 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:02.925032 28536 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.039125 28543 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:02.946358 28394 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:03.059777 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 125507us
I20260709 13:10:02.950098 28664 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:02.953013 28663 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.070359 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:03.066689 26508 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:03.004668 28490 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:03.005683 28488 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:03.069080 26625 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:03.044410 28557 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:03.061313 27270 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:03.080076 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:03.081753 28542 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:03.082253 28681 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:10:03.062295 28668 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:03.084101 28664 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:02.953655 28655 consensus_queue.cc:237] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.085251 26577 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:03.085525 28473 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:03.086279 28406 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:03.039069 28653 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:03.089895 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:03.093946 28686 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:10:03.094229 28542 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:03.094671 28684 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:03.095352 28684 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:03.095234 28542 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.047355 28644 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.096560 28684 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.099109 28644 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:03.041500 28680 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.103441 28680 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.104075 28508 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:03.074014 28663 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.069355 27271 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:02.997969 28566 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.076599 28638 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:10:03.090818 28557 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:03.140230 26504 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:03.141960 28683 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:10:03.143932 28400 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:03.153945 28598 consensus_meta.cc:287] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.726s	user 0.000s	sys 0.013s
W20260709 13:10:03.185456 28693 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:03.182552 28638 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:10:03.190614 26505 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:03.191828 26509 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.149827 28557 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.231663 28557 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:03.225463 28570 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:10:03.229386 28473 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.234615 28473 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.237651 28473 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:03.226786 28399 consensus_meta.cc:287] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.003s
I20260709 13:10:03.216287 28578 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:10:03.255110 28473 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.271723 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:03.272185 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:03.273077 26474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.017s	sys 0.051s
I20260709 13:10:03.272294 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:03.275240 26584 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:10:03.273423 26474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.017s	sys 0.051s
W20260709 13:10:03.279650 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 586522us
I20260709 13:10:03.282013 26474 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:03.283316 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:03.315429 26580 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:03.315454 26583 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:10:03.268882 28575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.007s	sys 0.024s
I20260709 13:10:03.256657 28399 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.323000 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:03.323773 26583 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.328694 28543 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:03.330482 28672 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:03.331169 28672 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.317935 28591 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:03.342648 28394 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:03.344339 27278 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.005s	sys 0.051s
W20260709 13:10:03.344688 27278 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.005s	sys 0.051s
I20260709 13:10:03.346201 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:03.316301 28598 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:10:03.317716 28653 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:10:03.365006 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:03.320148 28473 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:03.380203 26405 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.011s	sys 0.026s
I20260709 13:10:03.348996 28399 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:03.381539 26405 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.011s	sys 0.026s
W20260709 13:10:03.380141 26550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.014s	sys 0.010s
I20260709 13:10:03.398437 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:03.398770 26550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.015s	sys 0.010s
I20260709 13:10:03.371796 28591 consensus_queue.cc:1059] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:10:03.400396 28394 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:03.471158 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:03.408887 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 43995.3us
I20260709 13:10:03.479787 26476 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:03.481057 26654 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.481143 26474 leader_election.cc:400] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4.
I20260709 13:10:03.481685 26474 leader_election.cc:403] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:03.481809 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:03.487016 27276 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:03.490289 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:03.427567 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:03.421011 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:03.493467 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:03.494179 26504 raft_consensus.cc:1813] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Handling vote request from an unknown peer ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:03.549343 26504 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:03.550120 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:03.550598 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 66877us
I20260709 13:10:03.551067 26654 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.558075 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:03.558804 26656 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:03.429447 28574 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
I20260709 13:10:03.400545 28543 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.570604 26657 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:03.566697 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:03.571570 26658 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:03.436841 28544 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.419199 28473 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:03.579751 26654 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:03.435079 28562 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.584771 28528 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:03.594573 28543 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.620282 28528 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.621119 28591 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:03.622455 28528 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:03.416525 28395 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.620213 26583 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
W20260709 13:10:03.586335 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 106650us
W20260709 13:10:03.587481 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 106531us
I20260709 13:10:03.427937 28578 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.166s
I20260709 13:10:03.635922 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:03.476308 28394 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.657671 28399 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.662885 28469 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:03.663285 28582 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.619673 26404 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 5 to 6, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 6 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.626783 28691 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.688230 26404 catalog_manager.cc:5697] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 2 to 3, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:03.105741 28462 consensus_queue.cc:1175] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9c3761688a64982ae1c4aeb758e09ef" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:03.680965 28562 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.664899 28395 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.702041 28510 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:03.702592 28510 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.703318 28395 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:03.703454 28562 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:03.687048 28399 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.704579 28510 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:03.698961 26404 catalog_manager.cc:5697] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 3 to 4, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 4 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.705776 28578 raft_consensus.cc:3055] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:03.706223 28578 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:03.707072 28578 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.708272 28578 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.708989 26404 catalog_manager.cc:5697] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 2 to 3, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.716600 26577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:10:03.716750 28672 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.717446 26577 raft_consensus.cc:606] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:03.716964 26404 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 2 to 3, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.595953 28544 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:03.622471 28543 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:03.435323 28508 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.200s
I20260709 13:10:03.474607 28663 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.682190 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:03.682154 26658 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
W20260709 13:10:03.674207 27241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.009s	sys 0.021s
I20260709 13:10:03.623256 28574 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4.
I20260709 13:10:03.624166 28473 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.671094 26656 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:03.667547 26583 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:03.562000 28661 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:03.671741 26474 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:03.570509 28680 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:03.581404 28651 raft_consensus.cc:476] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Not starting pre-election -- already a leader
W20260709 13:10:03.684194 27243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.009s	sys 0.025s
I20260709 13:10:03.718834 26578 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:03.859354 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:03.855904 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:03.948870 28680 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:03.949357 26654 raft_consensus.cc:1813] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Handling vote request from an unknown peer ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:03.950065 26654 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:03.951062 28680 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:03.950726 26654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:42488
W20260709 13:10:03.829463 26503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.011s	sys 0.030s
W20260709 13:10:03.687781 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.005s	sys 0.027s
W20260709 13:10:03.946669 28655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.020s	sys 0.028s
W20260709 13:10:04.592301 27278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.241s	user 0.031s	sys 0.053s
W20260709 13:10:04.660887 27278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.032s	sys 0.061s
I20260709 13:10:04.659843 26653 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
W20260709 13:10:04.660287 26581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.577s	user 0.042s	sys 0.051s
W20260709 13:10:04.637053 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.662519 26581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.579s	user 0.042s	sys 0.051s
I20260709 13:10:03.985420 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:04.661978 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1586) took 1108 ms. Trace:
W20260709 13:10:04.249800 26549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.008s	sys 0.010s
W20260709 13:10:04.664083 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.829s	user 0.014s	sys 0.038s
W20260709 13:10:04.665056 26549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.008s	sys 0.018s
W20260709 13:10:04.665189 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 1.86084e+06us
W20260709 13:10:04.610518 26476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.010s	sys 0.015s
W20260709 13:10:04.666056 26476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.010s	sys 0.015s
I20260709 13:10:04.147716 26657 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.734583 26404 catalog_manager.cc:5697] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:04.630151 26504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.012s	sys 0.013s
W20260709 13:10:03.805117 27240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.010s	sys 0.043s
I20260709 13:10:04.666860 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1585) took 1184 ms. Trace:
W20260709 13:10:04.667094 27240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.828s	user 0.017s	sys 0.055s
W20260709 13:10:03.788678 26576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.020s	sys 0.065s
W20260709 13:10:04.667645 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 1.82876e+06us
W20260709 13:10:04.668362 26576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.580s	user 0.049s	sys 0.087s
W20260709 13:10:03.942870 26508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.008s	sys 0.012s
W20260709 13:10:04.666819 26504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.012s	sys 0.014s
W20260709 13:10:03.929490 26659 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.004s	sys 0.024s
W20260709 13:10:04.659513 28655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.501s	user 0.031s	sys 0.067s
W20260709 13:10:03.952173 26503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.163s	user 0.012s	sys 0.033s
W20260709 13:10:04.360733 26585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.514s	user 0.012s	sys 0.012s
W20260709 13:10:04.663566 27241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.718s	user 0.013s	sys 0.038s
W20260709 13:10:04.662088 27243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.862s	user 0.013s	sys 0.040s
I20260709 13:10:04.664060 26653 rpcz_store.cc:276] 0709 13:10:03.554627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.654328 (+ 99701us) service_pool.cc:224] Handling call
0709 13:10:04.661921 (+1007593us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:04.669371 26508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.016s	sys 0.019s
W20260709 13:10:04.672269 26659 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.443s	user 0.014s	sys 0.076s
I20260709 13:10:04.036644 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1570) took 1425 ms. Trace:
W20260709 13:10:04.660797 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 989067us
I20260709 13:10:04.666868 26476 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:04.660017 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2417) took 1024 ms. Trace:
W20260709 13:10:03.825735 28536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.011s	sys 0.013s
W20260709 13:10:03.878499 28500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.013s	sys 0.029s
I20260709 13:10:04.660142 28668 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.669832 28643 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:03.719254 28691 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.675308 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1582) took 1181 ms. Trace:
I20260709 13:10:04.675694 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1578) took 1185 ms. Trace:
I20260709 13:10:04.675035 28598 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:04.709072 28536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.641s	user 0.012s	sys 0.033s
W20260709 13:10:03.880959 27273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.000s	sys 0.026s
W20260709 13:10:04.091460 26506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.023s	sys 0.074s
W20260709 13:10:04.727079 26506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.411s	user 0.043s	sys 0.093s
W20260709 13:10:03.860745 28542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.015s	sys 0.011s
W20260709 13:10:03.878201 28664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.019s	sys 0.008s
W20260709 13:10:03.942222 26507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.006s	sys 0.030s
W20260709 13:10:04.744024 26507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.845s	user 0.012s	sys 0.040s
W20260709 13:10:04.488662 28700 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.541s	user 0.001s	sys 0.000s
W20260709 13:10:04.236706 28641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.000s	sys 0.018s
I20260709 13:10:03.796916 28699 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.682785 26582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.006s	sys 0.005s
W20260709 13:10:04.691541 26502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.453s	user 0.022s	sys 0.060s
W20260709 13:10:04.751731 26502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.513s	user 0.022s	sys 0.063s
W20260709 13:10:04.701963 26585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.856s	user 0.017s	sys 0.015s
W20260709 13:10:04.704067 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 1.90438e+06us
I20260709 13:10:04.698961 26583 rpcz_store.cc:276] 0709 13:10:03.635339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.635552 (+   213us) service_pool.cc:224] Handling call
0709 13:10:04.659936 (+1024384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:04.573173 28701 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.667412 26657 rpcz_store.cc:276] 0709 13:10:03.482600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.146798 (+664198us) service_pool.cc:224] Handling call
0709 13:10:04.147249 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.666638 (+519389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.666808 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:04.136102 28665 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.699425 28591 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.085009 28706 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.740077 28542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.525s	user 0.026s	sys 0.017s
I20260709 13:10:03.747608 28557 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:04.605345 28679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.169s	user 0.003s	sys 0.054s
I20260709 13:10:03.879207 28395 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:04.641077 28394 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:04.084746 28692 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:04.607417 28676 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.138821 28659 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.711385 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 250) took 2144 ms. Trace:
I20260709 13:10:04.759353 28657 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:03.705811 28399 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:03.948523 28661 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:04.714763 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1812) took 1492 ms. Trace:
W20260709 13:10:04.681231 26501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.013s
W20260709 13:10:04.779450 26501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.003s	sys 0.013s
W20260709 13:10:04.710284 28684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.234s	user 0.005s	sys 0.023s
W20260709 13:10:04.722621 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 55970.3us
I20260709 13:10:04.776095 26503 rpcz_store.cc:276] 0709 13:10:02.555285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.572001 (+ 16716us) service_pool.cc:224] Handling call
0709 13:10:02.589701 (+ 17700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.589974 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:02.789130 (+199156us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.699148 (+1910018us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.699208 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:04.699253 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.699324 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.699455 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":327076,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":2087633,"threads_started":2,"wal-append.queue_time_us":1734966}
W20260709 13:10:04.714990 26550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.007s	sys 0.010s
I20260709 13:10:04.723294 26654 raft_consensus.cc:606] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:04.781243 26550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.007s	sys 0.010s
I20260709 13:10:04.781320 26654 raft_consensus.cc:614] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:04.723486 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.728050 27273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.606s	user 0.006s	sys 0.037s
I20260709 13:10:04.782001 26651 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:04.725167 26656 rpcz_store.cc:276] 0709 13:10:03.478502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.480180 (+  1678us) service_pool.cc:224] Handling call
0709 13:10:04.663980 (+1183800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:04.732699 28691 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:04.710827 28500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.669s	user 0.040s	sys 0.087s
I20260709 13:10:04.659613 28473 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:04.784087 28661 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:04.784735 28473 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:03.699138 28582 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:04.724532 28723 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:10:04.766922 28665 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.760673 28680 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 13:10:04.715126 28566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.288s	user 0.002s	sys 0.023s
I20260709 13:10:04.749861 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1804) took 1855 ms. Trace:
W20260709 13:10:04.748656 26505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.012s	sys 0.027s
I20260709 13:10:03.697212 28469 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:04.751634 26582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.008s	sys 0.006s
I20260709 13:10:04.803712 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1580) took 1324 ms. Trace:
I20260709 13:10:04.723551 28574 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:04.723192 28508 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.724852 26658 rpcz_store.cc:276] 0709 13:10:03.479633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.548812 (+ 69179us) service_pool.cc:224] Handling call
0709 13:10:04.661360 (+1112548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:04.699997 26652 rpcz_store.cc:276] 0709 13:10:02.606978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.626989 (+ 20011us) service_pool.cc:224] Handling call
0709 13:10:02.627303 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.036664 (+409361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.031560 (+994896us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54002da354. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:04.031824 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931003264}
I20260709 13:10:04.804109 26651 rpcz_store.cc:276] 0709 13:10:03.479078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.480277 (+  1199us) service_pool.cc:224] Handling call
0709 13:10:03.557680 (+ 77403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.782384 (+1224704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.803391 (+ 21007us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400106b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:04.803584 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2815277824}
W20260709 13:10:04.743614 28664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.638s	user 0.022s	sys 0.021s
W20260709 13:10:04.751101 28641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.000s	sys 0.020s
I20260709 13:10:04.738413 28510 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:04.736399 28638 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:04.300273 28462 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.725219 28668 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:04.725008 28643 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:04.772207 28679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.336s	user 0.003s	sys 0.057s
W20260709 13:10:04.295063 26473 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.736s (SENT) [suppressed 23 similar messages]
W20260709 13:10:04.782971 28684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.305s	user 0.005s	sys 0.023s
I20260709 13:10:04.775786 28395 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.775013 28557 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.841882 28672 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:04.842176 28582 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:04.811983 28508 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:04.843638 28664 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.844548 28663 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:04.769335 28706 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.785414 28543 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:04.847047 28706 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:04.847141 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2403) took 2158 ms. Trace:
I20260709 13:10:04.847787 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 612) took 2049 ms. Trace:
I20260709 13:10:04.849860 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2410) took 1776 ms. Trace:
I20260709 13:10:04.849978 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1805) took 1756 ms. Trace:
I20260709 13:10:04.850360 26506 rpcz_store.cc:276] 0709 13:10:03.094021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.120971 (+ 26950us) service_pool.cc:224] Handling call
0709 13:10:03.162950 (+ 41979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.180434 (+ 17484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.180473 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.269946 (+ 89473us) log.cc:844] Serialized 508 byte log entry
0709 13:10:04.727561 (+1457615us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:04.727620 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.727716 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.849806 (+122090us) raft_consensus.cc:1685] finished
0709 13:10:04.849822 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.849927 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1411737,"threads_started":1,"wal-append.queue_time_us":1532520}
W20260709 13:10:04.851557 28713 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:04.749042 28479 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:10:04.812173 28574 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.790653 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 346) took 1973 ms. Trace:
I20260709 13:10:04.793260 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:04.801507 26505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.012s	sys 0.028s
I20260709 13:10:04.711072 28703 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:04.780606 28659 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:04.853895 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 60724.8us
I20260709 13:10:04.854310 28574 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:04.854200 28703 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.854878 28574 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:04.855607 28659 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:04.855435 28574 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.856168 28659 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:04.856500 28703 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:04.839071 28708 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.780627 28676 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.857609 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2408) took 1785 ms. Trace:
I20260709 13:10:04.858287 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1815) took 1601 ms. Trace:
I20260709 13:10:04.857957 26576 rpcz_store.cc:276] 0709 13:10:03.072432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.073348 (+   916us) service_pool.cc:224] Handling call
0709 13:10:03.074091 (+   743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.086255 (+ 12164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.086286 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.086887 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.668990 (+1582103us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:04.669029 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.669098 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.857387 (+188289us) raft_consensus.cc:1685] finished
0709 13:10:04.857407 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.857529 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12621,"raft.queue_time_us":14202,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":15982,"spinlock_wait_cycles":786432,"thread_start_us":1580548,"threads_started":1,"wal-append.queue_time_us":1665524}
I20260709 13:10:04.801301 26507 rpcz_store.cc:276] 0709 13:10:02.894478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.894628 (+   150us) service_pool.cc:224] Handling call
0709 13:10:02.894947 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.895170 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.895193 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.898991 (+  3798us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.744495 (+1845504us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:04.744546 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.744642 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.744694 (+    52us) raft_consensus.cc:1685] finished
0709 13:10:04.744708 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.749778 (+  5070us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1845039,"threads_started":1,"wal-append.queue_time_us":1656086}
I20260709 13:10:04.767050 28701 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.774307 28707 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:04.768363 28591 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:04.810899 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 252) took 2130 ms. Trace:
I20260709 13:10:04.807029 28544 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:04.813894 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1810) took 1651 ms. Trace:
I20260709 13:10:04.889030 26653 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:10:04.889235 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 222510us
W20260709 13:10:04.801107 28566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.003s	sys 0.023s
I20260709 13:10:04.779237 26508 rpcz_store.cc:276] 0709 13:10:03.207137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.207662 (+   525us) service_pool.cc:224] Handling call
0709 13:10:03.217550 (+  9888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.217932 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.217973 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.218508 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.699202 (+1480694us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:04.699242 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.699311 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.699352 (+    41us) raft_consensus.cc:1685] finished
0709 13:10:04.699363 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.699476 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":836,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":14846,"thread_start_us":1445014,"threads_started":1,"wal-append.queue_time_us":1397077}
I20260709 13:10:04.804805 28661 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:04.889534 26502 rpcz_store.cc:276] 0709 13:10:03.162141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.180565 (+ 18424us) service_pool.cc:224] Handling call
0709 13:10:03.180956 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.181370 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.181409 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.194681 (+ 13272us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.752243 (+1557562us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:04.752296 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.752394 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.813630 (+ 61236us) raft_consensus.cc:1685] finished
0709 13:10:04.813658 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.813823 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":941,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":29265,"spinlock_wait_cycles":811776,"thread_start_us":1513767,"threads_started":1,"wal-append.queue_time_us":1575817}
I20260709 13:10:04.841336 28557 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:04.741487 28598 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.778409 28692 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.850279 26581 rpcz_store.cc:276] 0709 13:10:03.073099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.073243 (+   144us) service_pool.cc:224] Handling call
0709 13:10:03.073794 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.078094 (+  4300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.078130 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.083200 (+  5070us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.663465 (+1580265us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:04.663504 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.663575 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.849640 (+186065us) raft_consensus.cc:1685] finished
0709 13:10:04.849673 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.849807 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10567,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":36224,"thread_start_us":1579911,"threads_started":1,"wal-append.queue_time_us":1713997}
I20260709 13:10:04.856554 28659 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:04.806159 26549 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:04.803429 28399 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:04.848224 27278 rpcz_store.cc:276] 0709 13:10:02.798747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.798859 (+   112us) service_pool.cc:224] Handling call
0709 13:10:02.835237 (+ 36378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.349897 (+514660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.349927 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.350936 (+  1009us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.661475 (+1310539us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:04.661522 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.661632 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.847586 (+185954us) raft_consensus.cc:1685] finished
0709 13:10:04.847606 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.847735 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":239532,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":11465,"thread_start_us":1819505,"threads_started":2,"wal-append.queue_time_us":1322945}
I20260709 13:10:04.847525 26585 rpcz_store.cc:276] 0709 13:10:02.688970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.690368 (+  1398us) service_pool.cc:224] Handling call
0709 13:10:02.698320 (+  7952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.761695 (+ 63375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.761739 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.792331 (+ 30592us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.752733 (+1960402us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:04.752787 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.752866 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.846897 (+ 94031us) raft_consensus.cc:1685] finished
0709 13:10:04.846918 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.847067 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91311,"raft.queue_time_us":73551,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":9494,"thread_start_us":1906338,"threads_started":1,"wal-append.queue_time_us":2010286}
I20260709 13:10:04.853037 27273 rpcz_store.cc:276] 0709 13:10:02.808942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.835033 (+ 26091us) service_pool.cc:224] Handling call
0709 13:10:02.835342 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.003253 (+167911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.003291 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.070126 (+ 66835us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.782248 (+1712122us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:04.782297 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.782371 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.782416 (+    45us) raft_consensus.cc:1685] finished
0709 13:10:04.782427 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.782541 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96530,"raft.queue_time_us":237337,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":16656,"thread_start_us":1659660,"threads_started":1,"wal-append.queue_time_us":1398073}
I20260709 13:10:04.807088 28500 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:10:04.762404 28699 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:04.875223 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 206302us
I20260709 13:10:04.838783 28570 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:04.883888 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 212944us
I20260709 13:10:04.805385 28691 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:04.868898 26510 rpcz_store.cc:276] 0709 13:10:02.680493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.702723 (+ 22230us) service_pool.cc:224] Handling call
0709 13:10:02.717849 (+ 15126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.731491 (+ 13642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.731535 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.761334 (+ 29799us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.266101 (+504767us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:03.266415 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.266512 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.810666 (+1544154us) raft_consensus.cc:1685] finished
0709 13:10:04.810686 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.810838 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24218,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":27405,"thread_start_us":460933,"threads_started":1,"wal-append.queue_time_us":1046170}
I20260709 13:10:04.894699 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42488 (request call id 27) took 1065 ms. Trace:
W20260709 13:10:04.895840 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 56555us
I20260709 13:10:04.858773 26501 rpcz_store.cc:276] 0709 13:10:03.257317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.562683 (+305366us) service_pool.cc:224] Handling call
0709 13:10:03.563009 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.587347 (+ 24338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.587396 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.149350 (+561954us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b2c000014c8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882b222a11 00007f882b232372 00007f882c964a01 00007f882c92943a 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2
0709 13:10:04.149889 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.780043 (+630154us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:04.780112 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.780213 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.858010 (+ 77797us) raft_consensus.cc:1685] finished
0709 13:10:04.858029 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.858232 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23876,"raft.queue_time_us":24031,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":60279,"spinlock_wait_cycles":64335232,"thread_start_us":629692,"threads_started":1,"wal-append.queue_time_us":650290}
I20260709 13:10:04.899857 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1571) took 2244 ms. Trace:
W20260709 13:10:04.776777 28697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.027s	sys 0.026s
I20260709 13:10:04.857290 28708 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:04.915951 28701 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:04.916656 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:04.916898 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:04.962328 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:04.949447 26659 rpcz_store.cc:276] 0709 13:10:02.662271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.675163 (+ 12892us) service_pool.cc:224] Handling call
0709 13:10:02.675488 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.675817 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.675851 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.684760 (+  8909us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.216526 (+531766us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:04.699652 (+1483126us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.899526 (+199874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.899601 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.899641 (+    40us) raft_consensus.cc:1685] finished
0709 13:10:04.899652 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.899768 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63658,"prepare.queue_time_us":444348,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":109850,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":34278,"thread_start_us":2149265,"threads_started":3,"wal-append.queue_time_us":950517}
I20260709 13:10:04.917480 28542 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:04.963876 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:04.965009 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:04.923746 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:04.966434 26582 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:04.924556 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:04.928323 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 174283us
W20260709 13:10:04.891029 28578 consensus_meta.cc:287] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.182s	user 0.012s	sys 0.002s
I20260709 13:10:04.930174 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:04.927037 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:04.969110 26651 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:04.877643 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:04.969844 26656 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.860371 28638 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.939169 27240 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:04.938618 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 45895.6us
I20260709 13:10:04.931110 28659 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.889916 28664 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:04.950313 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:04.952996 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:04.838531 28394 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:10:04.932032 28540 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:10:04.835347 28510 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:04.902262 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 606983us
I20260709 13:10:04.940990 26654 rpcz_store.cc:276] 0709 13:10:03.797112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.950620 (+153508us) service_pool.cc:224] Handling call
0709 13:10:04.862619 (+911999us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400106b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c923853 00007f88318f160a 00007f882ae777d4 00007f882ae77762 00007f882ae77691 00007f882ae7760c 00007f882ae768c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:04.862770 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1774225792}
I20260709 13:10:04.888573 28676 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:04.917214 28672 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:04.967243 26658 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:10:04.967818 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:04.863123 28508 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:04.969153 26653 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:04.970698 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:04.961333 28399 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:04.971855 28727 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.972276 28557 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:04.972404 28317 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:04.973814 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 167740us
I20260709 13:10:04.974157 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1813) took 1750 ms. Trace:
I20260709 13:10:04.974316 28684 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:04.974946 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:04.975478 28663 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:04.976154 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:04.976475 27273 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:04.977038 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:04.977898 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:04.978657 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:04.979404 27274 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:04.979856 28701 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:04.982875 28692 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:04.984189 28395 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:04.984323 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:04.984894 28706 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.985311 26656 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:04.940260 28729 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.953672 28697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.028s	sys 0.026s
I20260709 13:10:04.835003 28462 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.942102 28469 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:04.954602 28691 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:04.960214 28570 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:05.107010 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 215853us
W20260709 13:10:05.450814 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 485863us
I20260709 13:10:05.646381 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:05.009647 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 70557.5us
I20260709 13:10:05.006242 26651 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
W20260709 13:10:05.120435 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.649714 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:05.647418 26504 rpcz_store.cc:276] 0709 13:10:03.224612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.558576 (+333964us) service_pool.cc:224] Handling call
0709 13:10:03.559122 (+   546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.655347 (+ 96225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.655381 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.657420 (+  2039us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.671867 (+1014447us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:04.671910 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.671981 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.973970 (+301989us) raft_consensus.cc:1685] finished
0709 13:10:04.973989 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.974102 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64131,"raft.queue_time_us":117536,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5872,"thread_start_us":989657,"threads_started":1,"wal-append.queue_time_us":1203125}
I20260709 13:10:05.655087 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:05.021687 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:05.016073 28573 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:05.660622 28573 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.661026 28573 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:05.250262 28680 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:05.662550 28680 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:05.665005 28680 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:05.665338 26650 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:05.666061 26655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.005s	sys 0.005s
W20260709 13:10:05.666448 26655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.006s	sys 0.005s
I20260709 13:10:05.666369 26659 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:05.667405 28750 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:05.668185 28750 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:05.670253 26473 connection.cc:256] RPC call timeout handler was delayed by -1.1805377450000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 13:10:05.670713 26473 connection.cc:256] RPC call timeout handler was delayed by -1.1248642960000552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260709 13:10:05.651881 27276 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:05.689007 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 44806.6us
I20260709 13:10:05.705245 26652 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
W20260709 13:10:05.575979 28734 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:10:05.715385 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:05.716382 26653 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:10:05.543862 28743 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.722373 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:05.065768 28598 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:05.659930 27270 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:04.994884 28745 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:05.705078 28692 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:05.727478 27276 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:05.444862 28657 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:05.460207 28638 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:05.485311 28574 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:05.652275 28643 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:05.697819 28399 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:05.018951 28665 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:05.014845 28699 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:05.017639 28591 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:05.017016 28543 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:05.252141 28708 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:04.994639 28542 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:05.726861 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:05.245265 28661 consensus_queue.cc:1059] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.488s
I20260709 13:10:05.013655 28664 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:05.573542 28742 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:05.008741 28741 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.774s
I20260709 13:10:05.698195 28663 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:05.704455 28672 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:05.243947 28739 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.570s
I20260709 13:10:05.698062 28727 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.244596 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 483) took 1268 ms. Trace:
I20260709 13:10:05.708593 27269 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:05.888120 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 197590us
W20260709 13:10:05.786054 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 139737us
I20260709 13:10:06.248162 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1817) took 2924 ms. Trace:
W20260709 13:10:06.231653 26548 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.000s	sys 0.025s
W20260709 13:10:06.256716 26548 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.000s	sys 0.025s
I20260709 13:10:06.249749 26651 rpcz_store.cc:276] 0709 13:10:04.976201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.920422 (+944221us) service_pool.cc:224] Handling call
0709 13:10:06.243911 (+323489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.244152 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.244188 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.244254 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:06.244306 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.244375 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.244520 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:06.257259 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 609057us
W20260709 13:10:06.226588 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 544080us
I20260709 13:10:06.258491 26549 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:06.250357 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 665) took 1276 ms. Trace:
I20260709 13:10:05.704473 28676 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:05.721987 28680 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:06.149714 28757 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
I20260709 13:10:06.251467 28317 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:06.252286 28573 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.591s	user 0.004s	sys 0.008s
I20260709 13:10:05.718309 28508 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.251089 28543 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:06.279348 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 201385us
W20260709 13:10:06.061189 28749 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.514s	user 0.001s	sys 0.000s
I20260709 13:10:05.704728 28706 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.260303 27276 rpcz_store.cc:276] 0709 13:10:04.974205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.977660 (+  3455us) service_pool.cc:224] Handling call
0709 13:10:06.250291 (+1272631us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:06.266814 26625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.005s	sys 0.025s
W20260709 13:10:06.320356 26625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.010s	sys 0.025s
I20260709 13:10:06.241707 28570 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:06.314896 27241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.005s	sys 0.013s
I20260709 13:10:06.316633 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 485) took 1340 ms. Trace:
I20260709 13:10:05.751183 28598 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:06.264635 26549 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:06.109859 28462 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:06.319903 26551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.021s
I20260709 13:10:06.240149 28510 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:06.254791 26505 rpcz_store.cc:276] 0709 13:10:03.323793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.882040 (+558247us) service_pool.cc:224] Handling call
0709 13:10:03.921210 (+ 39170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.936115 (+ 14905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.936165 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.947970 (+ 11805us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.853895 (+905925us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:04.853937 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.854006 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.247917 (+1393911us) raft_consensus.cc:1685] finished
0709 13:10:06.247941 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.248086 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":581,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"thread_start_us":817458,"threads_started":1,"wal-append.queue_time_us":1069873}
I20260709 13:10:05.709725 28729 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:05.962694 28747 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:06.342207 27241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.005s	sys 0.013s
I20260709 13:10:06.296538 28638 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:05.745281 28684 raft_consensus.cc:697] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:06.375844 26625 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:05.741952 28743 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.342250 26651 rpcz_store.cc:276] 0709 13:10:04.976679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.296707 (+1320028us) service_pool.cc:224] Handling call
0709 13:10:06.315973 (+ 19266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.316187 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.316219 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.316274 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:06.316325 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.316414 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.316554 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:06.151774 28691 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:06.260042 28591 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.351634 26551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.000s	sys 0.022s
I20260709 13:10:06.261180 27270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 670) took 1276 ms. Trace:
I20260709 13:10:06.362705 26656 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:06.363081 28399 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:06.319254 28680 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.299297 28643 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:06.364326 28598 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:06.304335 28746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.004s	sys 0.027s
W20260709 13:10:06.370693 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 106159us
I20260709 13:10:06.307590 28737 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:06.372954 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 486) took 1396 ms. Trace:
I20260709 13:10:06.298218 28751 consensus_queue.cc:1059] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:10:06.260771 28574 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.259717 28692 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.272280 28657 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.303063 28676 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.344996 28508 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.343608 28573 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.271733 28745 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:06.369084 28748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.017s	sys 0.026s
W20260709 13:10:06.475792 28748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.017s	sys 0.026s
I20260709 13:10:06.471383 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1581) took 1598 ms. Trace:
W20260709 13:10:06.411885 27243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.013s	sys 0.012s
I20260709 13:10:06.391847 26585 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
W20260709 13:10:06.415911 26475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.000s	sys 0.023s
W20260709 13:10:06.487246 27243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.022s	sys 0.013s
I20260709 13:10:06.485471 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 488) took 1508 ms. Trace:
I20260709 13:10:06.392642 26652 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:06.486913 26657 rpcz_store.cc:276] 0709 13:10:04.976912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.360736 (+1383824us) service_pool.cc:224] Handling call
0709 13:10:06.361188 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.361376 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.361400 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.361441 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:06.361476 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.361528 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.372871 (+ 11343us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:06.488415 26475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.001s	sys 0.032s
W20260709 13:10:06.434904 26476 connection.cc:256] RPC call timeout handler was delayed by -1.1688529660000313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 13:10:06.390276 26550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.032s	sys 0.054s
W20260709 13:10:06.491564 26550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.033s	sys 0.066s
I20260709 13:10:06.490643 26656 rpcz_store.cc:276] 0709 13:10:04.977442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.362127 (+1384685us) service_pool.cc:224] Handling call
0709 13:10:06.362399 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.485160 (+122761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.485406 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:06.390270 27240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.032s	sys 0.031s
W20260709 13:10:06.494335 27240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.033s	sys 0.031s
I20260709 13:10:06.495170 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:06.495494 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 846381us
I20260709 13:10:06.351357 28742 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.402508 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2424) took 1474 ms. Trace:
I20260709 13:10:06.485735 26655 rpcz_store.cc:276] 0709 13:10:04.872805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.872929 (+   124us) service_pool.cc:224] Handling call
0709 13:10:04.915351 (+ 42422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.958534 (+ 43183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.958562 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.996523 (+ 37961us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.666848 (+670325us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:05.666883 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.666949 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.684018 (+ 17069us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4800240258. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8831852aa1 00007f8831849b37 00007f88318499ca 00007f883194126f 00007f8831940f37 00007f883195555c 00007f8831955508 00007f8831955488 00007f8831955443 00007f88319546ec 00007f883087ea96
0709 13:10:06.470974 (+786956us) raft_consensus.cc:1685] finished
0709 13:10:06.471002 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.471299 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71959,"raft.queue_time_us":52951,"raft.run_cpu_time_us":4419,"raft.run_wall_time_us":712258,"spinlock_wait_cycles":31202688,"thread_start_us":506984,"threads_started":1,"wal-append.queue_time_us":1279588}
I20260709 13:10:06.500305 26581 rpcz_store.cc:276] 0709 13:10:04.928037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.928240 (+   203us) service_pool.cc:224] Handling call
0709 13:10:04.928532 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.986754 (+ 58222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.986785 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:05.070227 (+ 83442us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.539991 (+469764us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:05.540066 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.706442 (+166376us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54001c39d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:05.706501 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.381052 (+674551us) raft_consensus.cc:1685] finished
0709 13:10:06.381079 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.402418 (+ 21339us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6865,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":26810,"spinlock_wait_cycles":78781696,"thread_start_us":340207,"threads_started":1,"wal-append.queue_time_us":568751}
I20260709 13:10:06.475874 28729 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:06.488066 28746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.007s	sys 0.032s
I20260709 13:10:06.510470 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.510519 28742 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.374300 28317 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:06.518643 26655 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:06.498685 28591 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.522161 28394 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:06.522905 28394 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.523366 28394 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.524147 28591 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:06.528791 28543 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.531206 28706 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:06.531426 28739 raft_consensus.cc:3055] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:06.468938 28775 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:06.533200 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 478) took 1558 ms. Trace:
I20260709 13:10:06.408074 28750 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:06.452376 28763 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:06.537452 28769 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:10:06.385473 28747 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:06.539623 28659 consensus_meta.cc:287] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.831s	user 0.005s	sys 0.003s
I20260709 13:10:06.540840 28784 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.380043 28661 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:06.542114 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 54190.9us
W20260709 13:10:06.542237 26476 connection.cc:256] RPC call timeout handler was delayed by -1.1525473730000613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 13:10:06.413836 28762 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.544605 26581 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:10:06.474714 28761 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.500000 28574 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.549939 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:06.532856 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:06.474089 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 477) took 1499 ms. Trace:
I20260709 13:10:06.399561 28766 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:06.559805 28399 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.554304 26659 rpcz_store.cc:276] 0709 13:10:04.974989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.672628 (+697639us) service_pool.cc:224] Handling call
0709 13:10:05.673002 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.303905 (+630903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.303934 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.303971 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:06.303998 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.532880 (+228882us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400168d54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:06.532946 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.533130 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450524544}
I20260709 13:10:06.496645 28737 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:06.557633 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.567575 28664 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:06.567400 28765 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:06.568135 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 71986.7us
I20260709 13:10:06.570185 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.545336 28557 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:06.611999 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.612766 26507 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:06.570647 28663 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:06.544612 28591 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:06.582793 26581 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:06.469458 28778 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.499151 28643 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.550307 28739 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:06.556000 28679 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.468549 28779 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:10:06.597668 26655 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:06.583987 28661 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.499481 27270 rpcz_store.cc:276] 0709 13:10:04.980620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.984020 (+  3400us) service_pool.cc:224] Handling call
0709 13:10:06.256717 (+1272697us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:06.551252 26622 connection.cc:256] RPC call timeout handler was delayed by -2.3432081040000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:10:06.629694 26622 connection.cc:256] RPC call timeout handler was delayed by -2.1022012840001025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2936s for a response
W20260709 13:10:06.630163 26622 connection.cc:256] RPC call timeout handler was delayed by -1.8521821609999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 13:10:06.630478 26622 connection.cc:256] RPC call timeout handler was delayed by -1.3046081040000672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2936s for a response
W20260709 13:10:06.630815 26622 connection.cc:256] RPC call timeout handler was delayed by -1.2311821609999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27320000000000005s for a response
I20260709 13:10:06.601967 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 491) took 1584 ms. Trace:
I20260709 13:10:06.604162 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.557183 28746 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.604655 28727 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:06.614182 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.615877 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.616453 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.618108 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.587281 28750 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.513967 28684 consensus_queue.cc:237] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.624526 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:06.626259 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.581772 27269 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:06.631863 26653 rpcz_store.cc:276] 0709 13:10:05.017417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.363606 (+1346189us) service_pool.cc:224] Handling call
0709 13:10:06.363868 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.364052 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:06.575485 (+211433us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.600964 (+ 25479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.601146 (+   182us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:06.601276 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.601435 (+   159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.601814 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":176753,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":267,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6561,"thread_start_us":229184,"threads_started":2}
I20260709 13:10:06.635362 26504 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:06.637142 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.638005 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:06.637863 28663 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:06.638845 28664 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:06.562150 28775 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:06.681702 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 43790.3us
I20260709 13:10:06.684890 26510 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:06.680527 26506 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:06.567083 28763 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.690644 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.577265 28659 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.613106 28399 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.596736 28761 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.584436 28784 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.586457 28762 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.612447 28317 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.617597 28765 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.691659 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.829062 28643 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:06.829411 28782 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:06.829692 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.830106 28782 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:06.706326 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 95831.2us
W20260709 13:10:06.762794 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 123944us
W20260709 13:10:06.705193 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 134105us
W20260709 13:10:06.747704 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 131591us
I20260709 13:10:06.837359 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:06.838920 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:06.839084 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:06.839717 26659 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:06.628116 28778 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.840626 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.841228 26576 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:06.842588 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.704226 28768 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.156s
I20260709 13:10:06.641119 28679 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.846299 28679 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:06.846354 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:06.849793 27274 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:06.850033 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.851411 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.851702 26474 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:06.852605 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.853336 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.853902 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.854440 27275 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:06.855693 26576 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:06.855674 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.856488 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.857102 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.848452 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.857407 26506 raft_consensus.cc:2410] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:06.859622 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.847752 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.864562 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.865118 27276 raft_consensus.cc:2410] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:06.625465 28591 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.835291 26578 raft_consensus.cc:2410] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:06.863281 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.860401 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.869087 26507 raft_consensus.cc:2368] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5.
I20260709 13:10:06.869966 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:06.870740 26507 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:06.871495 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.847471 26504 raft_consensus.cc:2393] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:06.872077 26507 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:06.872717 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:06.872963 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.873149 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:06.874886 26504 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.875440 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:06.832603 28659 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:06.833211 28657 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:06.832525 28782 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:06.828071 28508 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:06.889101 28742 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:06.615422 28766 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.890699 26502 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:06.890893 28672 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:06.877491 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:06.891801 26655 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:06.892150 26622 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:06.893069 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:06.884909 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 49196.9us
I20260709 13:10:06.888139 28663 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:06.863567 27270 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:06.883736 26507 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:06.894336 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:06.899343 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.894392 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.902058 26502 raft_consensus.cc:2410] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:10:06.897831 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 354831us
I20260709 13:10:06.903745 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:06.903802 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:06.896407 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 54280.2us
I20260709 13:10:06.905516 26653 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:06.689054 28665 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:06.938418 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.949672 27276 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:10:06.692101 28793 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.707419 27269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 666) took 1733 ms (client timeout 1782 ms). Trace:
I20260709 13:10:06.959573 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:06.906698 28742 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:06.692317 28792 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.940161 26509 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:06.876231 28679 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:10:06.938820 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.951643 26625 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:06.983485 28663 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:06.983695 26625 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:06.984193 28663 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:06.984815 28663 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.985411 28665 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:06.884167 28676 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:06.767477 28779 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:06.957043 26504 raft_consensus.cc:2410] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:06.689939 28727 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:06.990000 28727 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:06.992986 28727 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:06.698721 28750 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.980122 26503 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:06.995800 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.996263 28795 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.996578 26503 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:06.904495 28543 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:06.950522 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 56265.3us
I20260709 13:10:06.707022 28510 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.251s
I20260709 13:10:06.557314 28729 raft_consensus.cc:2955] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:06.781507 28739 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:06.684077 28746 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:07.000439 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:07.029975 28747 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:07.148057 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:07.001003 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:07.056715 26510 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:07.023989 26506 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:07.022150 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:07.052631 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 177352us
I20260709 13:10:07.154943 27243 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:07.000849 28543 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:07.157955 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:07.164175 26503 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:07.161684 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:06.978739 28742 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:07.167991 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 169631us
W20260709 13:10:07.148993 28394 consensus_meta.cc:287] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.001s
I20260709 13:10:06.997030 28795 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:07.172055 27243 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:06.980136 28657 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.172513 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:07.025027 28787 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.025205 28774 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:07.145675 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:07.184548 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:07.071573 28638 consensus_meta.cc:287] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
I20260709 13:10:06.970744 28793 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:07.191488 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:07.192240 27273 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:07.193032 26502 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:06.979902 28743 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:07.024632 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:07.000818 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:06.989221 28779 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:07.100447 28574 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:07.094353 28661 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:07.169308 28739 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.014549 28745 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:07.001276 28766 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:07.169342 28543 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.197296 26502 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:10:07.244753 26502 pending_rounds.cc:85] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 3
I20260709 13:10:07.199885 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:07.245591 27276 raft_consensus.cc:2410] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:10:06.597242 26650 rpcz_store.cc:276] 0709 13:10:04.974750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.666536 (+691786us) service_pool.cc:224] Handling call
0709 13:10:05.666943 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.739809 (+ 72866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.745464 (+  5655us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.004414 (+258950us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.350385 (+345971us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:06.361899 (+ 11514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.361969 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.473774 (+111805us) raft_consensus.cc:1685] finished
0709 13:10:06.473814 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.474006 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":538030,"raft.queue_time_us":72407,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":19860,"thread_start_us":205125,"threads_started":1,"wal-append.queue_time_us":344239}
I20260709 13:10:07.247455 28750 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:07.173430 28742 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:07.245045 26502 pending_rounds.cc:107] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:10:07.213796 28802 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:07.213672 28791 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:10:07.262214 28591 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:07.213521 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:07.263847 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:06.968360 27269 rpcz_store.cc:269] 0709 13:10:04.974488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.976795 (+  2307us) service_pool.cc:224] Handling call
0709 13:10:06.697889 (+1721094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:07.221088 26501 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:07.265175 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:07.024889 28804 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:07.230378 26504 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:07.022858 28792 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:07.214176 28787 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:07.200816 28774 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:07.176079 28672 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:10:07.209611 28638 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:07.242384 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:07.220074 27271 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:07.247093 28543 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.772722 28737 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:07.025311 28783 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.524s
I20260709 13:10:07.178056 28394 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:07.172621 28500 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:07.250298 26502 raft_consensus.cc:2889] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:07.183594 28657 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:07.224048 27270 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:07.256143 28748 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:07.258689 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:07.249979 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:07.261631 28802 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:07.273264 28754 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.273952 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:07.289352 27273 raft_consensus.cc:2368] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4.
I20260709 13:10:07.199421 28789 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:10:07.219334 28743 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:10:07.324117 26505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.006s	sys 0.033s
I20260709 13:10:07.261464 28573 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:07.286294 28780 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:10:07.403266 26579 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:07.352386 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:07.299665 28500 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:07.250298 28663 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:07.576948 27241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.010s	sys 0.046s
W20260709 13:10:07.880424 27241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.013s	sys 0.062s
I20260709 13:10:07.351748 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:07.881361 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:07.883512 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:07.649161 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 477156us
I20260709 13:10:07.889586 26655 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
W20260709 13:10:07.612599 26584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.004s	sys 0.021s
W20260709 13:10:07.784009 26476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.014s	sys 0.015s
W20260709 13:10:07.809088 26548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.010s	sys 0.013s
W20260709 13:10:08.538774 26548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.018s	sys 0.032s
W20260709 13:10:07.741480 26653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.010s	sys 0.011s
I20260709 13:10:08.511264 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1833) took 1877 ms. Trace:
I20260709 13:10:08.540226 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1605) took 1277 ms. Trace:
W20260709 13:10:08.540496 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 678002us
I20260709 13:10:08.540908 26655 rpcz_store.cc:276] 0709 13:10:07.262798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.351407 (+ 88609us) service_pool.cc:224] Handling call
0709 13:10:08.540166 (+1188759us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:07.669531 26473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.005s	sys 0.015s
I20260709 13:10:07.351404 26581 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
W20260709 13:10:08.218127 26549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.015s	sys 0.014s
I20260709 13:10:07.876673 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:08.315032 26550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.014s	sys 0.008s
W20260709 13:10:07.612293 26577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.004s	sys 0.021s
W20260709 13:10:08.053515 26580 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.001s	sys 0.015s
W20260709 13:10:08.539844 26653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.316s	user 0.010s	sys 0.024s
W20260709 13:10:07.688649 28772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.007s	sys 0.006s
W20260709 13:10:08.049319 26510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.025s	sys 0.024s
W20260709 13:10:08.306217 26474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.407s	user 0.000s	sys 0.027s
I20260709 13:10:07.299875 28774 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:08.539323 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 1.36495e+06us
I20260709 13:10:07.331408 28737 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:08.543078 26476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.648s	user 0.025s	sys 0.028s
I20260709 13:10:07.326598 28802 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:07.351197 26505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.006s	sys 0.034s
W20260709 13:10:08.561066 26474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.665s	user 0.004s	sys 0.031s
W20260709 13:10:08.649686 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 1.7979e+06us
I20260709 13:10:08.650705 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:07.465436 28799 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.363s	user 0.003s	sys 0.000s
I20260709 13:10:08.631458 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.632604 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1596) took 1673 ms. Trace:
I20260709 13:10:08.652343 27273 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:10:08.652438 26474 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:08.652662 26653 rpcz_store.cc:276] 0709 13:10:06.958796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.167742 (+208946us) service_pool.cc:224] Handling call
0709 13:10:07.178977 (+ 11235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.179388 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.179426 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.180485 (+  1059us) log.cc:844] Serialized 508 byte log entry
0709 13:10:08.626329 (+1445844us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:08.626385 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.626479 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.632410 (+  5931us) raft_consensus.cc:1685] finished
0709 13:10:08.632425 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.632537 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1402417,"threads_started":1,"wal-append.queue_time_us":1177115}
I20260709 13:10:08.633760 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:08.542330 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:08.560737 26510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.039s	sys 0.031s
W20260709 13:10:08.544121 26584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.639s	user 0.011s	sys 0.047s
I20260709 13:10:07.419314 28638 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:07.741693 28758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.004s	sys 0.024s
W20260709 13:10:07.878149 28684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.012s	sys 0.029s
I20260709 13:10:08.559404 28500 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:08.011803 28787 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:08.299633 28739 consensus_meta.cc:287] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.056s	user 0.012s	sys 0.001s
I20260709 13:10:07.433456 28679 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.643839 28729 consensus_meta.cc:287] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.419s	user 0.009s	sys 0.004s
W20260709 13:10:08.544732 26502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.009s	sys 0.000s
W20260709 13:10:08.684536 26502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.012s	sys 0.001s
I20260709 13:10:07.568764 28746 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:07.525321 28795 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:07.795953 28657 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:07.874325 28394 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:07.735149 28508 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:08.005147 28668 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:07.332350 28665 consensus_queue.cc:1175] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ef2886777a8f45e69e213b02a22ecec7" responder_term: 5 status { last_received { term: 4 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:07.331465 28804 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:08.559862 26473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.665s	user 0.021s	sys 0.022s
W20260709 13:10:08.692951 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 1.85471e+06us
W20260709 13:10:08.544075 26549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.018s	sys 0.019s
W20260709 13:10:08.625044 26548 connection.cc:256] RPC call timeout handler was delayed by -1.7119994710000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 13:10:08.625741 26580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.627s	user 0.009s	sys 0.024s
W20260709 13:10:08.506009 28543 consensus_meta.cc:287] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.180s	user 0.006s	sys 0.005s
I20260709 13:10:07.351030 26650 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:07.418215 28761 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:08.693641 26548 connection.cc:256] RPC call timeout handler was delayed by -1.7038994709999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:10:08.626086 26550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.016s	sys 0.015s
I20260709 13:10:08.694073 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1602) took 1455 ms. Trace:
W20260709 13:10:08.593950 28768 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.004s	sys 0.012s
W20260709 13:10:08.696604 28768 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.004s	sys 0.013s
I20260709 13:10:07.529464 28793 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:08.697832 28775 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:08.698967 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1838) took 1993 ms. Trace:
I20260709 13:10:08.698947 28543 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:08.699486 26502 rpcz_store.cc:276] 0709 13:10:06.705157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.316675 (+611518us) service_pool.cc:224] Handling call
0709 13:10:07.317055 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.317311 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.317350 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.341911 (+ 24561us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.684950 (+1343039us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:08.684989 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.685067 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.698769 (+ 13702us) raft_consensus.cc:1685] finished
0709 13:10:08.698786 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.698913 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":805265,"threads_started":1,"wal-append.queue_time_us":1208334}
I20260709 13:10:08.643285 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1830) took 2032 ms. Trace:
W20260709 13:10:08.317919 28796 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.293s	user 0.001s	sys 0.042s
W20260709 13:10:08.700843 28796 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.676s	user 0.004s	sys 0.042s
I20260709 13:10:08.701232 28543 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:07.879892 28779 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:08.581000 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:08.710714 27271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 626) took 1359 ms (client timeout 1588 ms). Trace:
W20260709 13:10:08.711292 27271 rpcz_store.cc:269] 0709 13:10:07.351603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.580581 (+1228978us) service_pool.cc:224] Handling call
0709 13:10:08.710631 (+130050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:08.712491 28774 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:08.712781 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.657346 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2437) took 1781 ms. Trace:
I20260709 13:10:08.638135 28598 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:08.661003 28758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.511s	user 0.006s	sys 0.033s
I20260709 13:10:08.634763 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.632895 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.661289 28638 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:07.351912 28754 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:08.631117 28663 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:08.661357 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.664314 28399 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:08.632149 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.656306 28819 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:08.723102 28536 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.671038 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:08.717849 28823 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:08.671999 26509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 1832) took 2043 ms (client timeout 2231 ms). Trace:
I20260709 13:10:08.724480 28821 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:08.641352 27270 consensus_meta.cc:287] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.289s	user 0.017s	sys 0.000s
I20260709 13:10:08.540071 26503 rpcz_store.cc:276] 0709 13:10:06.633694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.174737 (+541043us) service_pool.cc:224] Handling call
0709 13:10:07.191468 (+ 16731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.191764 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.191801 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.192347 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.875733 (+683386us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:07.875779 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.875862 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.510976 (+635114us) raft_consensus.cc:1685] finished
0709 13:10:08.511002 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.511184 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":401019,"threads_started":1,"wal-append.queue_time_us":1077142}
W20260709 13:10:08.659353 26655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1607) took 1396 ms (client timeout 1853 ms). Trace:
W20260709 13:10:08.770668 26655 rpcz_store.cc:269] 0709 13:10:07.263369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.542054 (+1278685us) service_pool.cc:224] Handling call
0709 13:10:08.659291 (+117237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:08.657810 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2344) took 1963 ms. Trace:
I20260709 13:10:08.771579 26510 rpcz_store.cc:276] 0709 13:10:06.694710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.245844 (+551134us) service_pool.cc:224] Handling call
0709 13:10:07.260158 (+ 14314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.260507 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.260532 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.261058 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.657479 (+1396421us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:08.657506 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.657550 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.657658 (+   108us) raft_consensus.cc:1685] finished
0709 13:10:08.657666 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.657743 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":142,"thread_start_us":1396058,"threads_started":1,"wal-append.queue_time_us":1378915}
I20260709 13:10:08.203910 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 479) took 3228 ms. Trace:
I20260709 13:10:08.773834 26654 rpcz_store.cc:276] 0709 13:10:04.975230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.708874 (+733644us) service_pool.cc:224] Handling call
0709 13:10:05.709340 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.253074 (+543734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.253122 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.298365 (+ 45243us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.543676 (+245311us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:06.543726 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.543847 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.203596 (+1659749us) raft_consensus.cc:1685] finished
0709 13:10:08.203617 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.203825 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76430,"raft.queue_time_us":538086,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9580,"thread_start_us":155554,"threads_started":1,"wal-append.queue_time_us":579036}
I20260709 13:10:08.776285 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:08.777112 26654 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:08.656559 28825 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:08.676270 28679 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:08.678788 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:08.680287 27240 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:08.682963 28542 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:08.639315 28742 consensus_meta.cc:287] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.362s	user 0.009s	sys 0.002s
W20260709 13:10:08.660735 28684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.024s	sys 0.054s
I20260709 13:10:08.685918 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.691622 28508 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:08.694101 26548 connection.cc:256] RPC call timeout handler was delayed by -1.6498994710000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 13:10:08.625653 26577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.990s	user 0.015s	sys 0.047s
W20260709 13:10:08.700258 26658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 490) took 3689 ms (client timeout 1886 ms). Trace:
W20260709 13:10:08.868223 26548 connection.cc:256] RPC call timeout handler was delayed by -1.6464770610000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
I20260709 13:10:07.548264 28792 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:08.702068 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1839) took 1996 ms. Trace:
I20260709 13:10:08.638516 27275 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:08.703356 28804 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:08.700719 26508 rpcz_store.cc:276] 0709 13:10:06.611150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.611513 (+   363us) service_pool.cc:224] Handling call
0709 13:10:06.627268 (+ 15755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.831394 (+204126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.831424 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.831465 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:06.831494 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.643059 (+1811565us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540027ddd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:08.643122 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.643233 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468983168}
I20260709 13:10:08.694651 26650 rpcz_store.cc:276] 0709 13:10:07.238377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.247778 (+  9401us) service_pool.cc:224] Handling call
0709 13:10:08.694011 (+1446233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:08.629940 28557 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:08.719106 26584 rpcz_store.cc:276] 0709 13:10:06.876205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.877292 (+  1087us) service_pool.cc:224] Handling call
0709 13:10:06.877708 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.877962 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:06.905097 (+ 27135us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.657015 (+1751918us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.657071 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:08.657119 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.657206 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.657300 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":607,"prepare.queue_time_us":90025,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":74,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":13119,"thread_start_us":1751518,"threads_started":1,"wal-append.queue_time_us":1413290}
I20260709 13:10:08.880514 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:08.881736 26584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1582) took 1727 ms (client timeout 1771 ms). Trace:
W20260709 13:10:08.725740 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.882851 26473 connection.cc:256] RPC call timeout handler was delayed by -1.627821286999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:10:08.883246 26473 connection.cc:256] RPC call timeout handler was delayed by -1.4964212869998619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 13:10:08.883602 26473 connection.cc:256] RPC call timeout handler was delayed by -1.4649212869999246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:10:08.883904 26473 connection.cc:256] RPC call timeout handler was delayed by -1.3776212869998972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 13:10:08.884225 26473 connection.cc:256] RPC call timeout handler was delayed by -1.1894070639999654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 13:10:08.884359 28638 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:08.884570 26473 connection.cc:256] RPC call timeout handler was delayed by -1.1571212869998817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 13:10:08.642287 28544 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:08.885264 28508 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:08.742447 26653 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
W20260709 13:10:08.625538 28772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.631s	user 0.008s	sys 0.024s
I20260709 13:10:08.745683 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.660512 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1824) took 2057 ms. Trace:
I20260709 13:10:08.729799 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:08.743870 26509 rpcz_store.cc:269] 0709 13:10:06.628474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.628626 (+   152us) service_pool.cc:224] Handling call
0709 13:10:08.671818 (+2043192us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540008cd54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:08.671916 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255584128}
I20260709 13:10:08.727144 28543 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:08.728593 28768 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.732441 28831 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:08.734139 27272 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:08.885885 28544 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:08.909024 26583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1580) took 1757 ms (client timeout 1590 ms). Trace:
W20260709 13:10:08.909783 26583 rpcz_store.cc:269] 0709 13:10:07.151406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.908758 (+1757352us) service_pool.cc:211] Skipping call since client already timed out
0709 13:10:08.908925 (+   167us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:10:08.910384 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.910781 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.901870 28542 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:08.911849 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.911826 28542 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:08.887382 28799 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:08.778200 27270 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:08.753016 27269 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:08.770375 28823 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:08.778903 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:08.862098 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:08.851500 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 310579us
I20260709 13:10:08.862718 28825 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:08.963256 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:08.794451 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36124 (request call id 76) took 7008 ms. Trace:
I20260709 13:10:08.842783 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:09.003451 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:09.008644 26510 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:09.009196 26509 raft_consensus.cc:2410] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:10:08.863973 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 210706us
I20260709 13:10:08.754760 28536 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:08.742014 28819 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:08.824910 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:08.868896 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1611) took 1604 ms. Trace:
I20260709 13:10:09.016347 26656 rpcz_store.cc:276] 0709 13:10:07.264432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.678480 (+1414048us) service_pool.cc:224] Handling call
0709 13:10:08.868841 (+190361us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:08.869361 27275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 625) took 1593 ms (client timeout 1610 ms). Trace:
W20260709 13:10:08.868703 26658 rpcz_store.cc:269] 0709 13:10:05.010380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.706861 (+696481us) service_pool.cc:224] Handling call
0709 13:10:08.700041 (+2993180us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400143054. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:08.700172 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3742865280}
I20260709 13:10:08.869120 26502 rpcz_store.cc:276] 0709 13:10:06.705493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.700966 (+1995473us) service_pool.cc:224] Handling call
0709 13:10:08.701265 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.701433 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.701457 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.701502 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:08.701532 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.701906 (+   374us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.702009 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:09.017330 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 192523us
I20260709 13:10:09.018407 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:08.873260 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 193046us
I20260709 13:10:08.879283 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:09.019256 26502 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:08.886157 26653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1609) took 1622 ms (client timeout 1909 ms). Trace:
I20260709 13:10:09.019498 26508 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
W20260709 13:10:09.019675 26653 rpcz_store.cc:269] 0709 13:10:07.263912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.654078 (+1390166us) service_pool.cc:224] Handling call
0709 13:10:08.886095 (+232017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:08.886693 26505 rpcz_store.cc:276] 0709 13:10:06.603372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.603670 (+   298us) service_pool.cc:224] Handling call
0709 13:10:06.604010 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.657031 (+2053021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.657064 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.660202 (+  3138us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:08.660247 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.660316 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.660444 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14250,"raft.queue_time_us":291336,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":43999,"thread_start_us":2050122,"threads_started":1}
W20260709 13:10:08.882174 26584 rpcz_store.cc:269] 0709 13:10:07.154187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.880285 (+1726098us) service_pool.cc:224] Handling call
0709 13:10:08.881653 (+  1368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:08.900889 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:08.885535 26473 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.021524 26503 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:09.021971 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 136504us
I20260709 13:10:08.907138 28754 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:08.907725 28774 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:08.886816 28557 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:08.907601 28768 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:08.909265 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.843199 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:08.824246 28758 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:08.960083 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2346) took 2264 ms. Trace:
I20260709 13:10:09.027504 27241 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:08.794674 28500 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:09.040232 26501 rpcz_store.cc:276] 0709 13:10:06.695458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.265787 (+570329us) service_pool.cc:224] Handling call
0709 13:10:07.266066 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.408203 (+142137us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:07.408250 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:07.408320 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:07.408369 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.585725 (+1177356us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b48000030d8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8831852aa1 00007f8831849b37 00007f88318499ca 00007f883194126f 00007f8831940f37 00007f883195555c 00007f8831955508 00007f8831955488 00007f8831955443 00007f88319546ec 00007f883087ea96
0709 13:10:08.959762 (+374037us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540008d9d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:08.959832 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.960001 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9650,"raft.run_cpu_time_us":2366,"raft.run_wall_time_us":1152264,"spinlock_wait_cycles":373280896}
W20260709 13:10:08.962177 26506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2351) took 2265 ms (client timeout 2043 ms). Trace:
W20260709 13:10:09.005434 26583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1583) took 1837 ms (client timeout 1801 ms). Trace:
I20260709 13:10:09.005648 27273 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:08.986547 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2438) took 2090 ms. Trace:
I20260709 13:10:09.017366 28779 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:08.739723 27274 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:09.070765 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:09.071991 27274 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:10:09.048219 28758 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:09.035395 28792 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:08.883055 28770 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:09.011588 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:08.868896 26548 connection.cc:256] RPC call timeout handler was delayed by -1.6464770610000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
W20260709 13:10:09.021339 26584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 444) took 1855 ms (client timeout 1855 ms). Trace:
W20260709 13:10:09.017341 27275 rpcz_store.cc:269] 0709 13:10:07.276428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.302005 (+ 25577us) service_pool.cc:224] Handling call
0709 13:10:08.869304 (+1567299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.025532 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:09.036541 26473 leader_election.cc:400] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4.
I20260709 13:10:09.037377 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:09.037530 26654 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:09.037814 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.037539 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:09.026261 28841 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:09.039249 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.088119 28841 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:09.088244 26653 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:10:09.040637 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1841) took 2334 ms. Trace:
I20260709 13:10:09.089251 26502 rpcz_store.cc:276] 0709 13:10:06.706064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.039761 (+2333697us) service_pool.cc:224] Handling call
0709 13:10:09.040118 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.040293 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.040318 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.040373 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:09.040408 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.040463 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.040580 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:08.880667 28742 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:09.045864 26583 rpcz_store.cc:269] 0709 13:10:07.168048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.005212 (+1837164us) service_pool.cc:211] Skipping call since client already timed out
0709 13:10:09.005363 (+   151us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:10:09.007222 28762 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:09.045820 26506 rpcz_store.cc:269] 0709 13:10:06.697171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.898780 (+201609us) service_pool.cc:224] Handling call
0709 13:10:08.961984 (+2063204us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000a91d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:08.962101 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284108544}
I20260709 13:10:08.963898 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.100935 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2356) took 2307 ms. Trace:
I20260709 13:10:09.101435 26508 rpcz_store.cc:276] 0709 13:10:06.793429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.084187 (+2290758us) service_pool.cc:224] Handling call
0709 13:10:09.100450 (+ 16263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.100595 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.100623 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.100659 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:09.100688 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.100754 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.100873 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.046350 26580 rpcz_store.cc:276] 0709 13:10:06.896287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.896553 (+   266us) service_pool.cc:224] Handling call
0709 13:10:06.901934 (+  5381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.902221 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:08.694960 (+1792739us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.986037 (+291077us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.986115 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:08.986189 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.986291 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.986466 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65841,"prepare.queue_time_us":163899,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2867,"raft.queue_time_us":137,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5299,"thread_start_us":1986119,"threads_started":2}
W20260709 13:10:09.103164 26580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1577) took 1952 ms (client timeout 1904 ms). Trace:
W20260709 13:10:09.103597 26580 rpcz_store.cc:269] 0709 13:10:07.150631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.102940 (+1952309us) service_pool.cc:211] Skipping call since client already timed out
0709 13:10:09.103091 (+   151us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:10:09.050697 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:09.051909 28500 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:09.052475 28707 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:09.051914 26576 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:09.023183 28819 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:09.085108 28836 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:10:09.017598 27270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 617) took 2017 ms (client timeout 1956 ms). Trace:
I20260709 13:10:09.061532 28823 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:09.047188 28679 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:09.008247 26507 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:09.075186 26549 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:09.213258 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 138181us
I20260709 13:10:09.215926 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:08.772961 28821 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.081965 28770 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:08.918517 28543 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:09.082957 26584 rpcz_store.cc:269] 0709 13:10:07.165481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.021163 (+1855682us) service_pool.cc:211] Skipping call since client already timed out
0709 13:10:09.021274 (+   111us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:10:09.224640 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:09.224647 26657 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:10:09.225462 26584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1588) took 2041 ms (client timeout 2234 ms). Trace:
W20260709 13:10:09.225907 26584 rpcz_store.cc:269] 0709 13:10:07.184332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.224401 (+2040069us) service_pool.cc:224] Handling call
0709 13:10:09.225407 (+  1006us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.226740 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:09.083755 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 54593.6us
I20260709 13:10:09.227928 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:09.084649 26505 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:09.038801 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.086102 27241 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:09.049911 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:09.087524 28758 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:09.091809 26548 connection.cc:256] RPC call timeout handler was delayed by -1.2464835350000385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 13:10:09.233439 26548 connection.cc:256] RPC call timeout handler was delayed by -1.2464835350000385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 13:10:09.233814 26548 connection.cc:256] RPC call timeout handler was delayed by -1.2045770610000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2722s for a response
I20260709 13:10:09.233848 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1840) took 2528 ms. Trace:
I20260709 13:10:09.186101 28707 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:09.093321 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.015348 28701 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:10:09.095276 26583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1581) took 1941 ms (client timeout 1868 ms). Trace:
I20260709 13:10:09.167472 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:09.168290 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:09.038506 28786 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:10:09.036798 28842 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:10:09.235378 28804 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:09.220069 28544 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:09.186002 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.056768 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:09.186679 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:09.088845 28536 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:09.251884 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:09.079898 28792 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:09.166630 28841 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:09.216614 26658 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:09.084937 28692 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:09.073129 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:08.912891 28831 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.215071 26549 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:09.230058 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 144061us
I20260709 13:10:09.229460 26656 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
W20260709 13:10:09.211376 27270 rpcz_store.cc:269] 0709 13:10:06.994242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.997787 (+  3545us) service_pool.cc:224] Handling call
0709 13:10:09.007865 (+2010078us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.222949 28638 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:09.241698 26654 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:09.242548 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:09.245546 27275 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:09.186113 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.252580 27273 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
W20260709 13:10:09.254438 26580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1585) took 2082 ms (client timeout 2095 ms). Trace:
W20260709 13:10:09.279072 26580 rpcz_store.cc:269] 0709 13:10:07.172110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.104311 (+1932201us) service_pool.cc:224] Handling call
0709 13:10:09.254355 (+150044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.255055 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1587) took 2072 ms. Trace:
I20260709 13:10:09.279886 26584 rpcz_store.cc:276] 0709 13:10:07.182888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.226518 (+2043630us) service_pool.cc:224] Handling call
0709 13:10:09.254979 (+ 28461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.280686 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.244926 28804 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:09.281339 26654 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:10:09.234241 26509 rpcz_store.cc:276] 0709 13:10:06.705792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.037133 (+2331341us) service_pool.cc:224] Handling call
0709 13:10:09.050607 (+ 13474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.050841 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:09.051163 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.233500 (+182337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.233549 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:09.233626 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.233693 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.233804 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1049,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":6884,"thread_start_us":181982,"threads_started":1}
I20260709 13:10:09.223901 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:09.270959 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 55961.1us
I20260709 13:10:09.232177 26473 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:09.285966 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 53856.8us
I20260709 13:10:09.235589 28739 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:09.272789 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.293145 26652 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:10:09.240732 28707 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.274101 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.244448 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:09.278707 26653 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:09.263607 28792 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:09.241816 26583 rpcz_store.cc:269] 0709 13:10:07.153913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.095042 (+1941129us) service_pool.cc:211] Skipping call since client already timed out
0709 13:10:09.095193 (+   151us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:10:09.280102 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.275471 28638 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.283372 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:09.290788 27274 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:09.291465 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:09.299511 26473 leader_election.cc:336] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.610s (SENT)
I20260709 13:10:09.275098 28536 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:09.310981 26584 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:09.314818 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.300604 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.315145 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:09.315433 26656 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:09.315671 26654 raft_consensus.cc:2393] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:09.279932 28469 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:09.277040 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:09.302587 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.311272 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.284843 28804 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.320297 26653 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:09.321821 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:09.311756 26473 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:09.233866 28825 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.320299 26548 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:09.301627 28847 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:09.307547 28638 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.327508 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:09.327786 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.328845 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.328604 26653 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:09.329702 26656 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:09.321589 26549 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:09.313122 28536 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.275525 28770 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.330550 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.367573 26653 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:09.331254 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.008401 28729 rpcz_store.cc:276] 0709 13:10:01.793230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.793347 (+   117us) service_pool.cc:224] Handling call
0709 13:10:01.978855 (+185508us) log.cc:844] Serialized 508 byte log entry
0709 13:10:02.415140 (+436285us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b1800439180. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:08.793351 (+6378211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16594,"raft.queue_time_us":2348,"raft.run_cpu_time_us":1326,"raft.run_wall_time_us":21901,"spinlock_wait_cycles":4444544,"thread_start_us":115517,"threads_started":1,"wal-append.queue_time_us":296987,"wal-append.run_cpu_time_us":1804,"wal-append.run_wall_time_us":1035036}
I20260709 13:10:09.357684 28536 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.358497 27269 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:09.360859 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1604) took 2098 ms. Trace:
I20260709 13:10:09.374265 26656 rpcz_store.cc:276] 0709 13:10:07.262477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.355814 (+2093337us) service_pool.cc:224] Handling call
0709 13:10:09.360227 (+  4413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.360397 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.360424 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.360466 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:09.360496 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.360548 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.360666 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.361284 28469 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:09.355355 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.322032 28542 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:09.370205 28729 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:09.379982 28729 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:09.380468 28729 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.380605 28778 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:09.370247 28543 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:09.323083 28684 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:09.365823 27270 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:10:09.353890 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 54435.8us
I20260709 13:10:09.378001 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1603) took 2116 ms. Trace:
W20260709 13:10:09.386386 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 64888.8us
I20260709 13:10:09.327090 28847 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:09.396339 26655 rpcz_store.cc:276] 0709 13:10:07.262090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.374150 (+2112060us) service_pool.cc:224] Handling call
0709 13:10:09.374457 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.377544 (+  3087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.377602 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.377663 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:09.377714 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.377789 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.377931 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.426941 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:09.375581 26654 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:09.355527 28739 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:09.376402 28469 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:09.389846 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:09.432472 26658 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
W20260709 13:10:09.428769 26473 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.771s (SENT) [suppressed 47 similar messages]
I20260709 13:10:09.430850 26655 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:09.433630 28469 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.433741 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 495) took 2106 ms. Trace:
I20260709 13:10:09.434163 26655 rpcz_store.cc:276] 0709 13:10:07.327508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.428275 (+2100767us) service_pool.cc:224] Handling call
0709 13:10:09.429422 (+  1147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.433456 (+  4034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.433669 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.431017 26549 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:09.439778 26473 leader_election.cc:336] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.918s (SENT)
I20260709 13:10:09.441851 26509 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:09.395911 28684 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:09.442471 28684 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.444406 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:09.386965 28770 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.389178 28768 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:09.464993 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 111329us
I20260709 13:10:09.432507 28847 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.475891 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:09.476549 26583 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:10:09.468745 28543 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.469905 28789 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:09.516584 28848 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:10:09.535605 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:09.517148 28789 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.546139 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:09.530571 28831 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:09.519343 28543 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.569088 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:09.575191 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1612) took 2310 ms. Trace:
I20260709 13:10:09.544302 28789 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.575834 26653 rpcz_store.cc:276] 0709 13:10:07.264680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.376164 (+2111484us) service_pool.cc:224] Handling call
0709 13:10:09.376623 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.390464 (+ 13841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.390510 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.430163 (+ 39653us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.538225 (+108062us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:09.538290 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.538396 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.574859 (+ 36463us) raft_consensus.cc:1685] finished
0709 13:10:09.574894 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.575107 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8864,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6685,"thread_start_us":68643,"threads_started":1,"wal-append.queue_time_us":112809}
I20260709 13:10:09.593649 26474 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.600294 26474 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.602058 26474 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.604277 26474 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.607223 28842 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:09.610440 26474 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.614267 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.595362 28680 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:09.616250 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.604167 28739 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:09.620292 28739 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:09.620736 28739 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.621276 28536 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.613586 28762 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:09.625900 28762 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:09.626343 28762 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.619467 28751 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:09.611650 28842 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:09.613807 28692 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:09.632661 28692 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:09.633178 28692 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:09.634820 28638 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:09.625386 28784 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:09.637974 28842 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.639885 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1601) took 2417 ms. Trace:
I20260709 13:10:09.640305 26650 rpcz_store.cc:276] 0709 13:10:07.222512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.036209 (+1813697us) service_pool.cc:224] Handling call
0709 13:10:09.089235 (+ 53026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.233977 (+144742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.240154 (+  6177us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.306254 (+ 66100us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.503600 (+197346us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:09.512775 (+  9175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.519092 (+  6317us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.639632 (+120540us) raft_consensus.cc:1685] finished
0709 13:10:09.639663 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.639821 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":211,"raft.queue_time_us":1689,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":9206,"thread_start_us":117216,"threads_started":1,"wal-append.queue_time_us":261822}
I20260709 13:10:09.606530 28778 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:09.642452 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.627964 28850 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:10:09.647389 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.631259 28751 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:09.630825 28399 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:09.662640 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.646417 28778 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:09.670526 26474 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.662786 28751 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:09.670403 28802 consensus_meta.cc:287] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.012s	user 0.011s	sys 0.005s
I20260709 13:10:09.662011 28399 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.669540 28778 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.686328 28868 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:09.687040 28868 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.687634 28868 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.695600 28868 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:09.705386 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2353) took 2913 ms. Trace:
I20260709 13:10:09.706817 26501 rpcz_store.cc:276] 0709 13:10:06.792193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.045100 (+2252907us) service_pool.cc:224] Handling call
0709 13:10:09.045474 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.045877 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.045910 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.079944 (+ 34034us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.308610 (+228666us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:09.308657 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.308731 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.703472 (+394741us) raft_consensus.cc:1685] finished
0709 13:10:09.703493 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.705329 (+  1836us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1051,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":25080,"thread_start_us":88665,"threads_started":1,"wal-append.queue_time_us":161082}
I20260709 13:10:09.680564 28638 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:09.668380 28469 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.715416 28469 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:09.720062 28860 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:09.685436 28536 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:09.684852 28399 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.744788 28684 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:09.665254 26650 raft_consensus.cc:2955] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:09.754597 28399 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.754890 28804 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:09.756438 28739 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:09.757877 28847 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:09.758576 28742 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:09.759747 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 89335.7us
W20260709 13:10:09.773053 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.703225 28802 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:09.774730 28868 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:09.768334 28842 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.791260 28739 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:09.786350 28557 consensus_meta.cc:287] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.001s
I20260709 13:10:09.800603 28868 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:09.800362 28692 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.801941 26474 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:09.803045 28779 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:09.796877 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:09.794927 28863 log.cc:927] Time spent T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:10:09.734243 28729 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:09.806360 26504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2354) took 3013 ms (client timeout 2327 ms). Trace:
I20260709 13:10:09.795735 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:10.031667 26581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 441) took 3399 ms (client timeout 1886 ms). Trace:
W20260709 13:10:10.136534 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 334657us
W20260709 13:10:10.101714 26578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2434) took 3230 ms (client timeout 1932 ms). Trace:
W20260709 13:10:10.026747 26476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.337s	user 0.027s	sys 0.064s
I20260709 13:10:09.834000 26582 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:09.833302 26585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2425) took 4899 ms (client timeout 1767 ms). Trace:
I20260709 13:10:10.137359 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1600) took 1277 ms. Trace:
I20260709 13:10:10.138720 26474 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:10.135967 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:10.138690 26578 rpcz_store.cc:269] 0709 13:10:06.871471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.101432 (+3229961us) service_pool.cc:211] Skipping call since client already timed out
0709 13:10:10.101603 (+   171us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:10:09.822644 26583 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:09.924717 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 354) took 1288 ms. Trace:
I20260709 13:10:10.143168 26580 rpcz_store.cc:276] 0709 13:10:08.860080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.795332 (+935252us) service_pool.cc:224] Handling call
0709 13:10:10.137296 (+341964us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:10.153110 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.153435 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:10.139213 26476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.449s	user 0.027s	sys 0.073s
I20260709 13:10:10.158558 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:10.151006 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:10.156845 27276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 616) took 3180 ms (client timeout 1588 ms). Trace:
I20260709 13:10:10.146174 26653 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:10.150375 26584 raft_consensus.cc:2410] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:10:10.137537 26581 rpcz_store.cc:269] 0709 13:10:06.632564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.636887 (+  4323us) service_pool.cc:224] Handling call
0709 13:10:10.031366 (+3394479us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b5400252e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:10.031546 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536604544}
I20260709 13:10:10.186136 26580 raft_consensus.cc:2410] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:10:10.140232 26585 rpcz_store.cc:269] 0709 13:10:04.933689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.933822 (+   133us) service_pool.cc:224] Handling call
0709 13:10:09.833013 (+4899191us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540015bb54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:09.833200 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3209403136}
I20260709 13:10:10.214473 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1598) took 1435 ms. Trace:
I20260709 13:10:10.214952 26580 rpcz_store.cc:276] 0709 13:10:08.779277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.152376 (+1373099us) service_pool.cc:224] Handling call
0709 13:10:10.214408 (+ 62032us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.215826 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:09.995000 28707 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.684s	user 0.005s	sys 0.004s
W20260709 13:10:10.032612 28819 consensus_meta.cc:287] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.818s	user 0.006s	sys 0.010s
W20260709 13:10:10.237061 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.128284 28856 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.608s	user 0.002s	sys 0.000s
I20260709 13:10:10.237948 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 494) took 2948 ms. Trace:
W20260709 13:10:10.131058 28792 consensus_meta.cc:287] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.820s	user 0.023s	sys 0.036s
I20260709 13:10:09.791661 28804 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:10.155391 26476 connection.cc:256] RPC call timeout handler was delayed by -1.5809018529998866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:10:10.029855 28816 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.380s	user 0.005s	sys 0.000s
I20260709 13:10:10.017831 28763 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:10.203697 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1592) took 1489 ms. Trace:
I20260709 13:10:10.187315 28739 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:09.808923 28751 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:10.216033 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:10.222420 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:10.214124 27276 rpcz_store.cc:269] 0709 13:10:06.959215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.959333 (+   118us) service_pool.cc:224] Handling call
0709 13:10:10.105498 (+3146165us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400284454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:10.139804 (+ 34306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655369472}
W20260709 13:10:10.136895 26504 rpcz_store.cc:269] 0709 13:10:06.792617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.999869 (+207252us) service_pool.cc:224] Handling call
0709 13:10:09.806101 (+2806232us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b540008edd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:09.806246 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194167680}
I20260709 13:10:10.223753 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:09.823608 28778 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:10.232513 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:10.235289 28770 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:10.235795 28692 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:10.236389 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1610) took 2972 ms. Trace:
I20260709 13:10:09.807089 28765 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:10.137240 28779 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:10.238961 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:09.791316 28847 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:09.811668 28684 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:10.238351 26656 rpcz_store.cc:276] 0709 13:10:07.289670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.375226 (+2085556us) service_pool.cc:224] Handling call
0709 13:10:09.396587 (+ 21361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.455581 (+ 58994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.455622 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.471534 (+ 15912us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.552614 (+ 81080us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:09.552679 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.552796 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.237735 (+684939us) raft_consensus.cc:1685] finished
0709 13:10:10.237751 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.237891 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":327,"raft.queue_time_us":94,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":7476,"thread_start_us":38892,"threads_started":1,"wal-append.queue_time_us":129505}
I20260709 13:10:10.154749 28802 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:09.994741 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:10.154492 28543 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:09.840821 28782 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.131934 28842 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:10.151544 27275 rpcz_store.cc:276] 0709 13:10:08.636763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.838959 (+1202196us) service_pool.cc:224] Handling call
0709 13:10:09.839322 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.924236 (+ 84914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.924284 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.924356 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:09.924403 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.924492 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.924644 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73562,"raft.queue_time_us":76519,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":14405}
I20260709 13:10:10.247336 28739 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:10.243247 26578 rpcz_store.cc:276] 0709 13:10:08.714514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.150689 (+1436175us) service_pool.cc:224] Handling call
0709 13:10:10.203595 (+ 52906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.279165 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 686) took 1273 ms. Trace:
I20260709 13:10:10.279656 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:10.280328 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1602) took 1385 ms. Trace:
I20260709 13:10:10.222123 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1605) took 1179 ms. Trace:
I20260709 13:10:10.156390 28868 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.281227 28868 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:10.157747 28825 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:10.281075 26584 rpcz_store.cc:276] 0709 13:10:09.042544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.796551 (+754007us) service_pool.cc:224] Handling call
0709 13:10:10.222066 (+425515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.280701 26578 rpcz_store.cc:276] 0709 13:10:08.894497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.279448 (+1384951us) service_pool.cc:224] Handling call
0709 13:10:10.280284 (+   836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.276119 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 437) took 3690 ms. Trace:
I20260709 13:10:10.245852 28792 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:10.230559 28729 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:09.808320 28762 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:10.259754 26581 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:10.260725 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:10.241876 28819 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:10.260749 26652 rpcz_store.cc:276] 0709 13:10:07.264164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.358368 (+2094204us) service_pool.cc:224] Handling call
0709 13:10:09.358678 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.358887 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.358910 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.359405 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.453145 (+ 93740us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:09.466474 (+ 13329us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.466678 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.466748 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.798395 (+331647us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b1800220480. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882980a2a6 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1
0709 13:10:09.800147 (+  1752us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b1800220480. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:10.029454 (+229307us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b1800220480. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:10.236161 (+206707us) raft_consensus.cc:1685] finished
0709 13:10:10.236184 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.236316 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13607,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":244,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2248,"spinlock_wait_cycles":29232384,"thread_start_us":93362,"threads_started":1,"wal-append.queue_time_us":115469}
I20260709 13:10:10.266964 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:10.251216 28399 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:10.250948 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:10.268752 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 81864.4us
I20260709 13:10:10.286331 28739 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:10.318017 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 176140us
W20260709 13:10:10.242600 26476 connection.cc:256] RPC call timeout handler was delayed by -1.4423018529998899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:10:10.186808 28557 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:10.282377 26578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:10:10.279584 27278 rpcz_store.cc:276] 0709 13:10:09.006045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.297653 (+291608us) service_pool.cc:224] Handling call
0709 13:10:09.312293 (+ 14640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.314797 (+  2504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.314828 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.321144 (+  6316us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.451459 (+130315us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:09.451500 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.451568 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.127614 (+676046us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:10.278889 (+151275us) raft_consensus.cc:1685] finished
0709 13:10:10.278911 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.279105 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":962,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3871,"spinlock_wait_cycles":19243264,"thread_start_us":93594,"threads_started":1,"wal-append.queue_time_us":182927}
I20260709 13:10:10.330361 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:10.330698 28557 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:10.331805 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:10.188942 28591 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:10.333788 28591 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.334282 28591 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:10.282310 26577 rpcz_store.cc:276] 0709 13:10:06.586078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.586595 (+   517us) service_pool.cc:224] Handling call
0709 13:10:06.586883 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.587077 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.587103 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.602663 (+ 15560us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.868415 (+2265752us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:08.868458 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.868520 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.026014 (+1157494us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:10.275734 (+249720us) raft_consensus.cc:1685] finished
0709 13:10:10.275783 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.276040 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5868416,"thread_start_us":2232836,"threads_started":1,"wal-append.queue_time_us":1855852}
I20260709 13:10:10.338536 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:10.340111 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:10.340974 26577 raft_consensus.cc:2368] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:10.304168 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:10.342700 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:10.306471 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:10.307578 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1595) took 1574 ms. Trace:
I20260709 13:10:10.345588 26581 rpcz_store.cc:276] 0709 13:10:08.733329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.214708 (+1481379us) service_pool.cc:224] Handling call
0709 13:10:10.307513 (+ 92805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.310490 26580 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:10.347404 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1603) took 1334 ms. Trace:
I20260709 13:10:10.347816 26580 rpcz_store.cc:276] 0709 13:10:09.017048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.260739 (+1243691us) service_pool.cc:224] Handling call
0709 13:10:10.347323 (+ 86584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.349689 26655 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:10.329262 26578 raft_consensus.cc:606] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:10.352542 26580 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:10.353757 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:10.355711 26577 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:10:10.358392 26577 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:10.275484 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:10.325666 27274 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:10.240612 28707 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:10.327859 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 171924us
W20260709 13:10:10.328519 26476 connection.cc:256] RPC call timeout handler was delayed by -1.4180018529999643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:10:10.421916 26476 connection.cc:256] RPC call timeout handler was delayed by -1.3307018529999368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 13:10:10.422374 26476 connection.cc:256] RPC call timeout handler was delayed by -1.2983018529998844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 13:10:10.269971 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:10.423118 26585 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:10.333333 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:10.424587 27278 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:10.318845 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:10.367908 28871 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:10:10.286906 28825 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.374706 27240 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:10.375101 28778 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:10.376418 28751 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:10.376880 28852 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:10.377991 28819 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:10.383000 28792 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:10.383466 26503 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:10.265014 28770 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:10.274266 28782 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:10.384841 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 504) took 1067 ms. Trace:
I20260709 13:10:10.417927 26577 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:10.426242 27275 raft_consensus.cc:2410] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:10.366247 28591 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:09.995008 28774 raft_consensus.cc:2955] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:10.478245 28802 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:10.622071 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:10.447016 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.469349 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:10.419678 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 230274us
I20260709 13:10:10.449203 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.582540 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.761708 26654 rpcz_store.cc:276] 0709 13:10:09.317389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.727145 (+409756us) service_pool.cc:224] Handling call
0709 13:10:09.760875 (+ 33730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.761355 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.761400 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.763801 (+  2401us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.265436 (+501635us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:10.265473 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.265536 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.384631 (+119095us) raft_consensus.cc:1685] finished
0709 13:10:10.384650 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.384778 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":718,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":4234,"thread_start_us":111643,"threads_started":1,"wal-append.queue_time_us":576156}
I20260709 13:10:10.763434 26502 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:10.584367 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:10.756955 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 363360us
W20260709 13:10:10.431612 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 57011.4us
I20260709 13:10:10.765404 26509 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:10.759336 26501 raft_consensus.cc:2393] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 2: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:10.766026 27240 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:10.767375 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:10.762854 26506 raft_consensus.cc:2393] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:10.635705 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.448913 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:10.644013 28789 consensus_meta.cc:287] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.046s	user 0.008s	sys 0.003s
I20260709 13:10:10.780367 28789 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:10.784340 28789 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:10.659507 27270 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:10.793929 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1622) took 1491 ms. Trace:
I20260709 13:10:10.692512 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.583971 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.935235 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.806558 26549 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:10.805723 28802 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:10.936174 28802 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:10.936390 26509 raft_consensus.cc:2393] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 2: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:10.936715 28591 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:10.826550 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:10.937422 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:10.938205 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 90931.5us
I20260709 13:10:10.842252 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:10.922855 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:10.941084 26585 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:10.941015 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:10.938282 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 131814us
I20260709 13:10:10.915482 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:10.943957 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 117624us
I20260709 13:10:10.947907 26510 raft_consensus.cc:2410] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:10.870589 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:10.950407 26508 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:10.807564 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2439) took 3904 ms. Trace:
I20260709 13:10:10.953672 26584 rpcz_store.cc:276] 0709 13:10:06.902874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.343757 (+3440883us) service_pool.cc:224] Handling call
0709 13:10:10.344105 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.344403 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:10.344736 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.807095 (+462359us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.807164 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:10.807234 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.807344 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.807489 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23560,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":17474,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":73126,"thread_start_us":461991,"threads_started":1}
I20260709 13:10:10.938378 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.840883 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.966666 26505 raft_consensus.cc:2368] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:10.969301 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 693) took 1046 ms. Trace:
I20260709 13:10:10.969756 27278 rpcz_store.cc:276] 0709 13:10:09.923105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.818284 (+895179us) service_pool.cc:224] Handling call
0709 13:10:10.969239 (+150955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.970263 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:10.974088 26506 raft_consensus.cc:2368] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5.
I20260709 13:10:10.450228 28825 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:10.580966 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:10.983016 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.986498 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.987426 26509 raft_consensus.cc:1813] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Handling vote request from an unknown peer af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:10.984285 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:10.988283 26509 raft_consensus.cc:2410] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:10:10.413787 28779 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:10.989676 26585 raft_consensus.cc:2393] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:10.989897 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:10.985308 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:10.939025 28570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.037s	sys 0.060s
I20260709 13:10:10.840823 28743 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:10.993350 26510 raft_consensus.cc:2393] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:10.993470 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:10.818154 28566 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:10.994284 26576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1579) took 3843 ms (client timeout 1771 ms). Trace:
I20260709 13:10:10.998174 26584 raft_consensus.cc:2393] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:10.998272 26576 rpcz_store.cc:269] 0709 13:10:07.151162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.883211 (+732049us) service_pool.cc:224] Handling call
0709 13:10:10.994041 (+3110830us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54003d1654. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:10.994207 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1173664512}
I20260709 13:10:10.432152 27269 raft_consensus.cc:2376] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4. Re-sending same reply.
I20260709 13:10:10.995395 27275 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 1.
I20260709 13:10:11.003212 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1586) took 3825 ms. Trace:
I20260709 13:10:11.003790 26580 rpcz_store.cc:276] 0709 13:10:07.177451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.348570 (+3171119us) service_pool.cc:224] Handling call
0709 13:10:10.348940 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.352996 (+  4056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.002843 (+649847us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5400100754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:11.003132 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7558528}
I20260709 13:10:10.957868 28742 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:10.956772 28821 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:11.010644 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:11.011620 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1598) took 3853 ms. Trace:
I20260709 13:10:10.968501 28880 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:11.016362 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:10.993410 28570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.037s	sys 0.060s
I20260709 13:10:11.074812 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:11.020313 28880 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.083318 28880 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.019762 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 689) took 1145 ms. Trace:
I20260709 13:10:11.023166 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 641) took 1011 ms. Trace:
I20260709 13:10:11.028672 27276 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:11.101879 27278 rpcz_store.cc:276] 0709 13:10:10.011426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.983526 (+972100us) service_pool.cc:224] Handling call
0709 13:10:11.023071 (+ 39545us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.995800 28743 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:11.105715 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:11.096588 28762 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:11.059412 28742 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:10:11.107812 28743 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.112349 28707 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:11.134599 28782 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:11.139111 28868 consensus_meta.cc:287] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.000s
I20260709 13:10:11.139747 28868 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:11.142889 28868 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:11.142496 28802 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:11.146081 28887 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.211s	user 0.000s	sys 0.004s
I20260709 13:10:11.146557 28802 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:11.150009 28894 raft_consensus.cc:3055] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:11.150501 28894 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:11.151497 28894 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:10.982327 26505 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:11.193735 26504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.017s	sys 0.025s
I20260709 13:10:11.190860 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:11.194802 26504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.017s	sys 0.025s
I20260709 13:10:11.191679 26507 raft_consensus.cc:2393] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:11.192819 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 222410us
I20260709 13:10:11.203408 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:11.208537 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:11.205017 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 266) took 2492 ms. Trace:
I20260709 13:10:11.215330 26503 rpcz_store.cc:276] 0709 13:10:08.712701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.025540 (+312839us) service_pool.cc:224] Handling call
0709 13:10:11.204454 (+2178914us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400194e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:11.204781 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2481323904}
I20260709 13:10:11.223893 26404 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34762 (request call id 320) took 8612 ms. Trace:
I20260709 13:10:11.224638 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:11.225355 26506 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:11.225751 26508 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:11.226257 26504 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:11.227345 26502 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:11.234308 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:11.235072 26476 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:11.235394 26505 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.234630 26504 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:11.235415 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:11.237970 26476 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:11.238663 26509 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.231655 26503 raft_consensus.cc:2955] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:11.250196 26476 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:11.021816 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.253351 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 443) took 4566 ms. Trace:
I20260709 13:10:11.253379 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 447) took 1437 ms. Trace:
I20260709 13:10:11.265077 26579 rpcz_store.cc:276] 0709 13:10:06.686720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.686957 (+   237us) service_pool.cc:224] Handling call
0709 13:10:06.687412 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.542836 (+1855424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.252641 (+2709805us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54001c34d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:11.253124 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645590272}
I20260709 13:10:11.265738 26585 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:11.235805 26402 catalog_manager.cc:5697] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.254267 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.265894 26578 rpcz_store.cc:276] 0709 13:10:09.815323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.351604 (+536281us) service_pool.cc:224] Handling call
0709 13:10:10.351963 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.383463 (+ 31500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.383492 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:10.383910 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.820116 (+436206us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:10.820166 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.820236 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.252588 (+432352us) raft_consensus.cc:1685] finished
0709 13:10:11.252681 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.253154 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30848,"raft.queue_time_us":30931,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":435851,"threads_started":1,"wal-append.queue_time_us":695734}
I20260709 13:10:11.267777 26476 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:11.255770 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.268437 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.268153 26402 catalog_manager.cc:5697] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 3 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.266839 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.270216 26580 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:11.271059 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 455) took 1453 ms. Trace:
I20260709 13:10:11.257349 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1584) took 4088 ms. Trace:
I20260709 13:10:11.271448 26580 rpcz_store.cc:276] 0709 13:10:09.817438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.269156 (+1451718us) service_pool.cc:224] Handling call
0709 13:10:11.269919 (+   763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.270708 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.270987 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.272037 26581 rpcz_store.cc:276] 0709 13:10:07.168334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.346418 (+3178084us) service_pool.cc:224] Handling call
0709 13:10:10.346785 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.382188 (+ 35403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.382216 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:10.382668 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.760279 (+377611us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:10.760335 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.760422 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.145291 (+384869us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:11.256616 (+111325us) raft_consensus.cc:1685] finished
0709 13:10:11.256669 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.257134 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34938,"raft.queue_time_us":35470,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":73952000,"thread_start_us":238576,"threads_started":1,"wal-append.queue_time_us":552042}
I20260709 13:10:11.259516 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 433) took 4700 ms. Trace:
I20260709 13:10:11.276175 26582 rpcz_store.cc:276] 0709 13:10:06.559183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.559384 (+   201us) service_pool.cc:224] Handling call
0709 13:10:09.833525 (+3274141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.139626 (+306101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.259072 (+1119446us) spinlock_profiling.cc:243] Waited 3.25 s on lock 0x7b540015bb50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:11.259328 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7468186880}
I20260709 13:10:11.268198 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.271713 26402 catalog_manager.cc:5697] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.284628 26402 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 2 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 3 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:11.260993 26583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1596) took 2526 ms (client timeout 1961 ms). Trace:
W20260709 13:10:11.297263 26583 rpcz_store.cc:269] 0709 13:10:08.740090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.548816 (+808726us) service_pool.cc:224] Handling call
0709 13:10:11.260565 (+1711749us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54003d1154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:11.260756 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580666752}
I20260709 13:10:11.260679 26405 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34738 (request call id 295) took 8863 ms. Trace:
I20260709 13:10:11.298990 26395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 057c1e97d7fb407aaf9cf119a0b63a37 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.262831 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:11.300300 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.264248 26576 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:11.266602 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:11.290226 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 338219us
I20260709 13:10:11.301971 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 454) took 1484 ms. Trace:
I20260709 13:10:11.302377 26576 rpcz_store.cc:276] 0709 13:10:09.817171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.999733 (+1182562us) service_pool.cc:224] Handling call
0709 13:10:11.263577 (+263844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.301047 (+ 37470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.301767 (+   720us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54002aadd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:11.301886 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605523712}
I20260709 13:10:11.298897 26405 rpcz_store.cc:276] 0709 13:10:02.397530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.398767 (+  1237us) service_pool.cc:224] Handling call
0709 13:10:11.260434 (+8861667us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:03.928409 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:04.033734 (+105325us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:04.033790 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:10:04.033812 (+    22us) tablet.cc:662] Decoding operations
0709 13:10:04.209166 (+175354us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:04.209272 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:04.209321 (+    49us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:10:04.210342 (+  1021us) tablet.cc:701] Row locks acquired
0709 13:10:04.210406 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:10:04.210644 (+   238us) write_op.cc:270] Start()
0709 13:10:04.210824 (+   180us) write_op.cc:276] Timestamp: P: 1783602604210544 usec, L: 0
0709 13:10:04.210854 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:10:04.211781 (+   927us) log.cc:844] Serialized 3262 byte log entry
0709 13:10:05.851617 (+1639836us) op_driver.cc:464] REPLICATION: finished
0709 13:10:06.528681 (+677064us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b540013f2a8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832ce59e1 00007f8832ce464c 00007f883035fe28 00007f8830360489 00007f883036271a 00007f88303626a8 00007f8830362628 00007f88303625e3 00007f88303617fc 00007f8832794626 00007f883278edd8
0709 13:10:06.810484 (+281803us) write_op.cc:301] APPLY: starting
0709 13:10:06.823381 (+ 12897us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:06.968114 (+144733us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:06.976729 (+  8615us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:07.138099 (+161370us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:07.138395 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:10:07.138461 (+    66us) write_op.cc:312] APPLY: finished
0709 13:10:07.138804 (+   343us) log.cc:844] Serialized 65 byte log entry
0709 13:10:07.139008 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:07.139143 (+   135us) write_op.cc:454] Released schema lock
0709 13:10:07.139206 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:07.140840 (+  1634us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:07.140882 (+    42us) write_op.cc:454] Released schema lock
0709 13:10:07.496315 (+355433us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b540013f454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92632a 00007f882c8abf14 00007f882c8abec3 00007f882c8abe38 00007f882c8abdf3 00007f882c8ab0dc 00007f882c8d4e16 00007f882c8bccbb 00007f882c8a739d 00007f882c8aad75
Metrics: {"mutex_wait_us":5037,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":178443,"apply.run_cpu_time_us":4443,"apply.run_wall_time_us":341458,"num_ops":8,"prepare.queue_time_us":1105824,"prepare.run_cpu_time_us":68531,"prepare.run_wall_time_us":1821010,"raft.queue_time_us":744218,"raft.run_cpu_time_us":44298,"raft.run_wall_time_us":1835808,"replication_time_us":1514864,"spinlock_wait_cycles":132427904,"thread_start_us":2415084,"threads_started":4,"wal-append.queue_time_us":676378,"wal-append.run_cpu_time_us":30946,"wal-append.run_wall_time_us":1345457}]]}
I20260709 13:10:11.296249 26505 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:11.304097 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:11.306668 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:11.326543 27240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.061s	sys 0.054s
W20260709 13:10:11.327082 27240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.061s	sys 0.054s
I20260709 13:10:11.327690 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:11.328563 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 561253us
I20260709 13:10:11.328768 26651 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:11.328871 26659 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:11.307734 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.337746 26653 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:11.101647 27269 rpcz_store.cc:276] 0709 13:10:09.874718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.275168 (+400450us) service_pool.cc:224] Handling call
0709 13:10:11.014608 (+739440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.340184 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:11.341320 27271 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:11.341892 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:11.343006 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 646) took 1094 ms. Trace:
I20260709 13:10:11.343160 27270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 637) took 1501 ms. Trace:
I20260709 13:10:11.343423 27269 rpcz_store.cc:276] 0709 13:10:10.248590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.341078 (+1092488us) service_pool.cc:224] Handling call
0709 13:10:11.342911 (+  1833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.343546 27270 rpcz_store.cc:276] 0709 13:10:09.841773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.916235 (+ 74462us) service_pool.cc:224] Handling call
0709 13:10:09.935824 (+ 19589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.968224 (+1032400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.342688 (+374464us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54005f1c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:11.342976 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423717632}
I20260709 13:10:11.344720 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:11.345641 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 695) took 1160 ms. Trace:
I20260709 13:10:11.345679 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.346072 27269 rpcz_store.cc:276] 0709 13:10:10.185670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.344291 (+1158621us) service_pool.cc:224] Handling call
0709 13:10:11.345584 (+  1293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.308145 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.348302 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.309418 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.309924 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.350363 26658 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.351069 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.352046 26654 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:11.314343 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.353976 26656 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.354179 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.355495 26653 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:11.356578 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.014539 26657 rpcz_store.cc:276] 0709 13:10:07.157902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.161321 (+  3419us) service_pool.cc:224] Handling call
0709 13:10:07.178140 (+ 16819us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.225348 (+2047208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.011254 (+1785906us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b5400168354. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:11.011534 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4696321792}
I20260709 13:10:11.358706 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.359463 26657 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:10.949767 26650 rpcz_store.cc:276] 0709 13:10:09.302782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.646194 (+343412us) service_pool.cc:224] Handling call
0709 13:10:09.664847 (+ 18653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.665104 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:10.266570 (+601466us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.792970 (+526400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.793384 (+   414us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:10.793471 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.793629 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.793824 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9076,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":62397,"thread_start_us":175717,"threads_started":1,"wal-append.queue_time_us":832969}
I20260709 13:10:11.307716 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 503) took 1990 ms. Trace:
I20260709 13:10:11.330144 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.366384 26651 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:11.365980 26655 rpcz_store.cc:276] 0709 13:10:09.316816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.719171 (+402355us) service_pool.cc:224] Handling call
0709 13:10:09.719459 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.350253 (+630794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.307165 (+956912us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540039b7d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:11.307518 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448775040}
I20260709 13:10:11.349484 26652 raft_consensus.cc:2410] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:11.353169 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.330432 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:11.331885 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:11.332849 27240 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:11.331697 26402 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 3, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 3 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.371627 26505 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:11.372413 26402 catalog_manager.cc:5697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:11.375015 26659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1595) took 4471 ms (client timeout 2014 ms). Trace:
I20260709 13:10:11.374462 26402 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:11.375435 26659 rpcz_store.cc:269] 0709 13:10:06.903163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.903391 (+   228us) service_pool.cc:224] Handling call
0709 13:10:11.040528 (+4137137us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54003f5320. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8a0dc0 00007f882c92ce18 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6
0709 13:10:11.374828 (+334300us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400103bd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:11.374936 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4112165120}
I20260709 13:10:11.224529 26404 rpcz_store.cc:276] 0709 13:10:02.615387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.648220 (+ 32833us) service_pool.cc:224] Handling call
0709 13:10:11.223562 (+8575342us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:06.264047 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:06.362271 (+ 98224us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:06.362320 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:10:06.362347 (+    27us) tablet.cc:662] Decoding operations
0709 13:10:06.363336 (+   989us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:06.363400 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:06.363444 (+    44us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:10:06.364189 (+   745us) tablet.cc:701] Row locks acquired
0709 13:10:06.364222 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:10:06.364418 (+   196us) write_op.cc:270] Start()
0709 13:10:06.364551 (+   133us) write_op.cc:276] Timestamp: P: 1783602606364352 usec, L: 0
0709 13:10:06.364580 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:10:06.676500 (+311920us) log.cc:844] Serialized 2485 byte log entry
0709 13:10:09.087838 (+2411338us) op_driver.cc:464] REPLICATION: finished
0709 13:10:09.221271 (+133433us) write_op.cc:301] APPLY: starting
0709 13:10:09.226150 (+  4879us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:09.283534 (+ 57384us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:09.303848 (+ 20314us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:09.464670 (+160822us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:09.510797 (+ 46127us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:10:09.516232 (+  5435us) write_op.cc:312] APPLY: finished
0709 13:10:09.543834 (+ 27602us) log.cc:844] Serialized 53 byte log entry
0709 13:10:09.551428 (+  7594us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:09.555674 (+  4246us) write_op.cc:454] Released schema lock
0709 13:10:09.557411 (+  1737us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:09.638621 (+ 81210us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540013f454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c924e28 00007f883035f581 00007f883035ed58 00007f88303639f1 00007f88303639a9 00007f8830363939 00007f8830363901 00007f8830362b2d 000000000038f354 000000000038f199
0709 13:10:09.638863 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:09.638906 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1590091,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":11093,"apply.run_cpu_time_us":5109,"apply.run_wall_time_us":375970,"num_ops":6,"prepare.queue_time_us":1002367,"prepare.run_cpu_time_us":57776,"prepare.run_wall_time_us":3786700,"raft.queue_time_us":309188,"raft.run_cpu_time_us":6792,"raft.run_wall_time_us":51035,"replication_time_us":2717290,"spinlock_wait_cycles":532878464,"thread_start_us":255188,"threads_started":3,"wal-append.queue_time_us":354051,"wal-append.run_cpu_time_us":90053,"wal-append.run_wall_time_us":3527212}]]}
I20260709 13:10:11.379417 26509 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:11.390000 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.391103 26652 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.393487 26657 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:11.397960 26656 raft_consensus.cc:2410] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:10:11.403352 27272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 635) took 2354 ms (client timeout 1639 ms). Trace:
I20260709 13:10:11.403921 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:11.404072 27272 rpcz_store.cc:269] 0709 13:10:09.049167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.402768 (+2353601us) service_pool.cc:211] Skipping call since client already timed out
0709 13:10:11.403056 (+   288us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:10:11.404953 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 640) took 1475 ms. Trace:
I20260709 13:10:11.405356 27275 rpcz_store.cc:276] 0709 13:10:09.929831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.112057 (+1182226us) service_pool.cc:224] Handling call
0709 13:10:11.404864 (+292807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.406042 28399 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:11.407212 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 697) took 1167 ms. Trace:
I20260709 13:10:11.407464 28399 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:11.407625 27276 rpcz_store.cc:276] 0709 13:10:10.239636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.306251 (+ 66615us) service_pool.cc:224] Handling call
0709 13:10:11.406797 (+1100546us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54006f2f54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:11.407010 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570535680}
I20260709 13:10:11.408169 28399 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:11.408713 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 619) took 4360 ms. Trace:
I20260709 13:10:11.408820 28399 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.409219 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:11.409171 27277 rpcz_store.cc:276] 0709 13:10:07.047933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.048094 (+   161us) service_pool.cc:224] Handling call
0709 13:10:07.152989 (+104895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.355977 (+202988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.356026 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:07.356086 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:07.356132 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.408279 (+4052147us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400667454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:11.408351 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.408537 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48000,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":25180,"spinlock_wait_cycles":465765248}
I20260709 13:10:11.410282 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 644) took 1180 ms. Trace:
I20260709 13:10:11.410909 27278 rpcz_store.cc:276] 0709 13:10:10.230021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.107318 (+877297us) service_pool.cc:224] Handling call
0709 13:10:11.410207 (+302889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.414108 28591 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:11.414811 28591 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:11.415474 28591 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.403441 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:11.422632 27274 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:11.125514 28739 consensus_meta.cc:287] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.000s
I20260709 13:10:11.423831 28739 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:11.424288 28742 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:11.414261 28508 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.425637 26507 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:11.425843 28508 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:11.413278 28566 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:10:11.428184 28739 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:11.428702 28566 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:11.429278 28566 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:11.429941 28566 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.432307 28508 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:11.432893 28739 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:11.434033 28739 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.434404 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.435216 28739 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:11.435773 28739 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:11.436259 28739 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.436759 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.375741 26658 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:11.440008 26652 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:11.421152 27272 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:11.497720 28751 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:11.503422 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.507119 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.508302 28792 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.509157 28792 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:11.520500 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.521950 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.523712 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.521198 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.525799 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.526328 28770 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:11.527064 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.529220 26577 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:11.533151 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.530176 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.534025 26580 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:11.531217 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.531562 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.536063 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.538550 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.539409 26656 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:11.540228 28779 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:11.545919 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.546881 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.547214 26656 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:11.546917 26576 raft_consensus.cc:2410] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:11.520638 28894 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:11.549283 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.498648 27271 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
W20260709 13:10:11.618749 28854 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.086s	user 0.011s	sys 0.006s
W20260709 13:10:11.619379 28854 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.098s	user 0.011s	sys 0.006s
I20260709 13:10:11.547312 27272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 698) took 1258 ms. Trace:
I20260709 13:10:11.549901 28792 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:11.647043 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:11.655616 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.658550 26578 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:11.653887 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 699) took 1399 ms. Trace:
I20260709 13:10:11.685997 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:11.687525 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:11.689786 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 387630us
I20260709 13:10:11.645509 27272 rpcz_store.cc:276] 0709 13:10:10.244282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.405146 (+1160864us) service_pool.cc:224] Handling call
0709 13:10:11.420590 (+ 15444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.489058 (+ 68468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.503063 (+ 14005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.697432 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:11.703220 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:11.709867 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:11.670118 27271 rpcz_store.cc:276] 0709 13:10:10.249057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.099495 (+850438us) service_pool.cc:224] Handling call
0709 13:10:11.616795 (+517300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.708406 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:11.728173 26509 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:11.728205 26505 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:11.729354 26503 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:11.725399 26507 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:11.734292 26508 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:11.726985 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2447) took 1281 ms. Trace:
I20260709 13:10:11.745679 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:11.752907 26504 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:11.731330 28785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.024s	sys 0.077s
I20260709 13:10:11.742834 28875 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:11.770772 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 307271us
W20260709 13:10:11.781816 26473 leader_election.cc:336] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.771s (SENT)
W20260709 13:10:11.773941 28785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.024s	sys 0.078s
I20260709 13:10:11.782549 26473 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:11.784046 28904 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:11.785099 28904 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:11.787161 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:11.787966 26510 raft_consensus.cc:2376] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5. Re-sending same reply.
I20260709 13:10:11.788443 28743 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:11.788971 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:11.790984 28880 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.005s
I20260709 13:10:11.791473 28880 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:11.794081 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.797686 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 392969us
I20260709 13:10:11.797830 28875 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:11.801048 28875 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:11.806056 26582 raft_consensus.cc:2368] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:11.807370 28566 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:11.784148 26473 leader_election.cc:336] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.501s (SENT)
I20260709 13:10:11.735479 26585 rpcz_store.cc:276] 0709 13:10:10.445280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.270750 (+825470us) service_pool.cc:224] Handling call
0709 13:10:11.271199 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.271712 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:11.272236 (+   524us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.721456 (+449220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.721525 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:11.726661 (+  5136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.726734 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.726926 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174647,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":7320,"raft.queue_time_us":14175,"thread_start_us":434509,"threads_started":1}
W20260709 13:10:11.821167 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 51587.8us
I20260709 13:10:11.817577 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:11.829638 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:11.829640 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.837610 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.839828 26504 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:11.841753 26476 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:11.843025 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:11.784046 28762 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:11.848393 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 515825us
W20260709 13:10:11.863817 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 85474.1us
I20260709 13:10:11.793371 28591 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:11.863808 28880 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:11.869716 28907 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:11.870030 28825 consensus_meta.cc:287] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.827s	user 0.008s	sys 0.004s
I20260709 13:10:11.870571 28825 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:11.861406 28878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.025s	sys 0.075s
W20260709 13:10:11.871989 28878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.025s	sys 0.076s
I20260709 13:10:11.872100 27274 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:11.873000 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.873160 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:11.846730 28823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.241s	user 0.013s	sys 0.015s
W20260709 13:10:11.874300 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 90219us
I20260709 13:10:11.847952 28875 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.876138 26501 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:11.876567 26506 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:11.876577 26510 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:11.822381 28739 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:11.909727 26505 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:11.911868 26658 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:11.888206 28823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.424s	user 0.013s	sys 0.015s
I20260709 13:10:11.880075 28825 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:11.921675 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.975811 26653 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 1.
I20260709 13:10:11.895108 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 642) took 1744 ms. Trace:
I20260709 13:10:11.980391 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:11.930672 28852 consensus_queue.cc:1059] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:11.922830 28905 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:11.929992 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 55622.6us
I20260709 13:10:11.934072 28915 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:11.944518 28591 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:11.933758 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 66973.7us
I20260709 13:10:11.934778 26509 raft_consensus.cc:2393] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:11.927795 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 684) took 2815 ms. Trace:
I20260709 13:10:11.941027 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:12.008612 26654 raft_consensus.cc:2410] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:10:11.936426 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50309.1us
W20260709 13:10:11.927410 28900 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:10:11.922989 28774 consensus_meta.cc:287] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.072s	user 0.011s	sys 0.006s
I20260709 13:10:11.889616 28904 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:11.932986 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 91295.5us
I20260709 13:10:11.939049 28879 consensus_queue.cc:1059] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:11.938071 26548 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:11.931277 28566 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:11.991066 26657 raft_consensus.cc:2376] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5. Re-sending same reply.
I20260709 13:10:11.992358 26659 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.997447 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:11.886381 28399 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:12.001922 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:12.004377 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 87880.5us
I20260709 13:10:11.982650 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 643) took 1753 ms. Trace:
I20260709 13:10:12.017725 26658 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:11.983311 27274 rpcz_store.cc:276] 0709 13:10:10.151186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.100466 (+949280us) service_pool.cc:224] Handling call
0709 13:10:11.880516 (+780050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.036456 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:12.037142 26652 raft_consensus.cc:1813] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Handling vote request from an unknown peer b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:12.047569 26652 raft_consensus.cc:2410] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:12.038568 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:12.039287 26549 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:12.041157 28399 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:12.036152 27269 rpcz_store.cc:276] 0709 13:10:10.229660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.346804 (+1117144us) service_pool.cc:224] Handling call
0709 13:10:11.347266 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.347701 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:11.716507 (+368806us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.792232 (+ 75725us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b18003bcc80. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:11.895220 (+102988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.902981 (+  7761us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:11.916284 (+ 13303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.955175 (+ 38891us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.982588 (+ 27413us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22265,"prepare.queue_time_us":365782,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":46171,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":18191,"spinlock_wait_cycles":6914432,"thread_start_us":443436,"threads_started":2}
I20260709 13:10:12.042622 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:12.043258 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:12.044402 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 106632us
I20260709 13:10:12.045610 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:12.045425 28842 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:12.051326 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:12.066907 26657 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:12.012215 27270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 688) took 2175 ms. Trace:
W20260709 13:10:12.445204 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 391718us
I20260709 13:10:12.007889 27273 rpcz_store.cc:276] 0709 13:10:09.005329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.840441 (+1835112us) service_pool.cc:224] Handling call
0709 13:10:10.840910 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.841412 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.841449 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:10.947035 (+105586us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.402268 (+455233us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:11.684775 (+282507us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.709036 (+ 24261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.723231 (+ 14195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.813800 (+ 90569us) raft_consensus.cc:1685] finished
0709 13:10:11.813821 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.820925 (+  7104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7997,"prepare.queue_time_us":351433,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":13178,"raft.run_cpu_time_us":630,"raft.run_wall_time_us":115916,"thread_start_us":655899,"threads_started":2,"wal-append.queue_time_us":730065}
W20260709 13:10:12.204103 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 109824us
I20260709 13:10:12.083477 26651 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.141839 26549 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:12.450078 26503 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.053174 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:12.223618 26659 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
W20260709 13:10:12.337806 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 122224us
W20260709 13:10:12.085888 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 56825.8us
W20260709 13:10:12.065719 26474 leader_election.cc:336] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.658s (SENT)
I20260709 13:10:12.067659 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:12.228952 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 127359us
I20260709 13:10:12.625316 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:12.458410 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:12.457343 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:12.547494 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 59962.9us
I20260709 13:10:12.472790 27243 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:12.506083 27241 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:12.631434 26651 raft_consensus.cc:2410] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:12.633721 28773 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:12.628083 26658 raft_consensus.cc:2410] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:12.505540 26622 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:12.633975 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 182535us
I20260709 13:10:12.639031 27243 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:12.473254 26474 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:12.634094 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:12.083890 28879 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:12.645273 26651 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:12.474224 28922 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
I20260709 13:10:12.081820 28823 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:12.649175 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 143801us
W20260709 13:10:12.647797 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 191398us
I20260709 13:10:12.651328 26657 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:12.655334 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:12.652262 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:12.653699 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:12.473666 28893 raft_consensus.cc:3055] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:12.253588 28852 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.403s
I20260709 13:10:12.215003 28779 consensus_queue.cc:1059] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.441s
I20260709 13:10:12.656302 26658 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.625742 28739 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:12.658643 26657 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:12.245639 28566 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.405s
I20260709 13:10:12.680507 26655 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:12.648553 28879 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:12.690944 26651 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:12.083010 28676 consensus_queue.cc:1059] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.592s
I20260709 13:10:12.657768 28894 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:12.702801 26657 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:12.654359 28842 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:12.472713 28918 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.471s
I20260709 13:10:12.208007 28907 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.472s
I20260709 13:10:12.657159 28893 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:12.710258 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 71308.6us
W20260709 13:10:12.711014 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 214908us
I20260709 13:10:12.712150 26655 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:12.687505 28743 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:12.697067 28879 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.719785 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:12.720459 26652 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:12.706334 28894 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:12.675928 28823 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:12.726329 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 658958us
W20260709 13:10:12.727382 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 48270.7us
I20260709 13:10:12.727569 26503 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:12.716982 28915 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:12.729386 28573 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:12.729651 26622 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:12.733418 26658 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:12.726065 28894 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:12.735139 26656 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:12.728890 28823 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:12.732721 28774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36124 (request call id 77) took 10930 ms. Trace:
W20260709 13:10:12.745910 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 57017.5us
I20260709 13:10:12.737207 28904 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:12.737133 28893 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:12.736052 28573 raft_consensus.cc:697] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:12.751771 28944 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:12.752249 28893 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:12.752784 28944 consensus_queue.cc:1059] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:12.752710 28573 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:12.760499 28921 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 13:10:12.764943 26625 leader_election.cc:400] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:12.765506 26625 leader_election.cc:403] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:12.762972 26549 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:12.456476 27270 rpcz_store.cc:276] 0709 13:10:09.874185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.344793 (+1470608us) service_pool.cc:224] Handling call
0709 13:10:11.345270 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.368199 (+ 22929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.368255 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.369063 (+   808us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.681080 (+312017us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:11.686086 (+  5006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.695910 (+  9824us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.992333 (+296423us) raft_consensus.cc:1685] finished
0709 13:10:11.994162 (+  1829us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.005329 (+ 11167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":300262,"threads_started":1,"wal-append.queue_time_us":518719}
I20260709 13:10:12.734350 28852 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:10:12.787062 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 736763us
W20260709 13:10:12.794507 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 60288.2us
W20260709 13:10:12.798843 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 86411.7us
W20260709 13:10:12.818579 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 89005us
I20260709 13:10:12.817181 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:12.848302 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 111492us
W20260709 13:10:12.858050 28938 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
W20260709 13:10:12.859248 28937 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:10:12.852193 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:12.867211 26474 leader_election.cc:336] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.659s (SENT)
I20260709 13:10:12.819420 28742 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
W20260709 13:10:12.877216 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 67943.3us
W20260709 13:10:12.884919 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 85100.6us
I20260709 13:10:12.887295 26652 raft_consensus.cc:2410] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:12.882680 28916 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:12.891681 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 74668.6us
I20260709 13:10:12.893987 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:12.895234 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:12.900274 26473 leader_election.cc:336] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.639s (SENT)
W20260709 13:10:12.901533 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 49438.4us
I20260709 13:10:12.903555 28948 raft_consensus.cc:3055] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:12.906489 28948 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:12.907657 28742 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:12.910531 28901 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:12.911017 28901 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:12.911650 28879 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:12.912011 28901 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:12.907437 28948 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:12.915860 26474 leader_election.cc:336] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.744s (SENT)
W20260709 13:10:12.921808 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.749600 28774 rpcz_store.cc:276] 0709 13:10:01.796797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.796923 (+   126us) service_pool.cc:224] Handling call
0709 13:10:01.882391 (+ 85468us) log.cc:844] Serialized 508 byte log entry
0709 13:10:02.413546 (+531155us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b540017cb20. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8a9b26 00007f882c8a349a 00007f882c8a2714 00007f882c882eaa 00007f882c889d53 00007f882c889cd9 00007f882c889c69 00007f882c889c31 00007f882c888dfd 000000000038f354
0709 13:10:12.724438 (+10310892us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34428,"raft.run_cpu_time_us":4054,"raft.run_wall_time_us":586563,"spinlock_wait_cycles":76158848,"thread_start_us":65878,"threads_started":1,"wal-append.queue_time_us":131517,"wal-append.run_cpu_time_us":2696,"wal-append.run_wall_time_us":1008162}
I20260709 13:10:12.922796 28773 raft_consensus.cc:3055] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:12.926707 28773 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:12.927739 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:12.928311 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:12.928565 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:12.930097 26578 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:10:12.933161 26476 leader_election.cc:336] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.659s (SENT)
I20260709 13:10:12.927955 28773 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:12.924959 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:12.935618 28916 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:12.913501 28901 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:12.922690 28943 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:12.998273 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 74141.4us
I20260709 13:10:12.939167 28869 raft_consensus.cc:3055] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:12.942749 28508 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:12.943989 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 1866) took 1129 ms. Trace:
I20260709 13:10:12.946561 26625 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:12.947994 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 203638us
I20260709 13:10:12.999778 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:12.914319 28948 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:12.951892 28894 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:12.955348 28939 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
W20260709 13:10:12.957211 28927 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.381s	user 0.000s	sys 0.002s
I20260709 13:10:12.958357 28942 raft_consensus.cc:3055] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:12.959463 28941 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:10:12.958302 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:12.958300 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:12.998703 28762 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:12.971946 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:12.926903 26652 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:12.993216 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.015694 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:12.995838 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 67347.3us
I20260709 13:10:12.938246 28879 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:12.948714 28952 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:13.000856 26510 raft_consensus.cc:2410] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:10:13.001797 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:13.006546 28893 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.006731 26549 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:13.008401 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 61924.3us
I20260709 13:10:12.971205 26476 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:13.012082 28773 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.000816 28943 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:13.000691 28869 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:12.999775 26509 rpcz_store.cc:276] 0709 13:10:11.814922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.820853 (+  5931us) service_pool.cc:224] Handling call
0709 13:10:12.943741 (+1122888us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b540008cd54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:12.943894 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210415360}
I20260709 13:10:13.019392 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:13.024868 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 138991us
I20260709 13:10:13.019991 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:13.010407 28916 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:13.010221 28942 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.023074 26653 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:13.025724 26548 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:13.019326 28932 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.515s	user 0.003s	sys 0.000s
I20260709 13:10:13.033098 26508 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:13.031428 28905 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:13.039844 28894 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:13.019331 28952 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:13.040891 28952 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:13.041359 28879 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:13.042119 28942 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.043663 28942 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.043817 26505 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:13.047104 28812 raft_consensus.cc:3055] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:13.047744 28812 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:13.024977 28893 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.052603 28893 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:13.053499 28949 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.055794 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1870) took 1231 ms. Trace:
W20260709 13:10:13.052831 28933 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.477s	user 0.002s	sys 0.000s
I20260709 13:10:13.056239 26507 rpcz_store.cc:276] 0709 13:10:11.824484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.867946 (+ 43462us) service_pool.cc:224] Handling call
0709 13:10:11.882668 (+ 14722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.882965 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.882991 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.883484 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.990012 (+106528us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:12.016044 (+ 26032us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.032743 (+ 16699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.032823 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.087123 (+ 54300us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b180008eba0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c522 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:13.006756 (+919633us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b180008eba0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:13.055523 (+ 48767us) raft_consensus.cc:1685] finished
0709 13:10:13.055545 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.055695 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7563,"prepare.queue_time_us":25271,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":17354,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":131,"spinlock_wait_cycles":40233600,"thread_start_us":104840,"threads_started":1,"wal-append.queue_time_us":158567}
I20260709 13:10:13.057674 28707 consensus_queue.cc:1059] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:10:13.025830 28943 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.058921 28707 raft_consensus.cc:3055] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:13.059500 28707 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:13.060253 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 162827us
W20260709 13:10:13.061066 26474 leader_election.cc:336] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.771s (SENT)
I20260709 13:10:13.049124 28812 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.062925 28812 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:13.062988 26474 leader_election.cc:336] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.801s (SENT)
I20260709 13:10:13.060925 28707 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.066416 26503 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:13.067042 28707 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.032739 28743 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:10:13.074568 28743 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:13.075040 28743 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:13.075539 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 142412us
I20260709 13:10:13.075996 28743 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.076711 26625 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:13.078001 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 49525.7us
I20260709 13:10:13.079632 26625 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:13.083997 26473 leader_election.cc:336] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.694s (SENT)
I20260709 13:10:13.084578 26473 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:13.085361 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:13.090119 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 58601.6us
I20260709 13:10:13.090404 28904 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:13.100153 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:13.101101 26659 raft_consensus.cc:2410] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:13.077283 28743 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.100179 28762 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.109911 28742 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:13.112831 28742 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:13.113399 28742 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:13.118723 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.112128 28956 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:13.121726 28784 raft_consensus.cc:3055] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:13.122246 28784 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:13.123283 28784 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.124867 28784 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.110177 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:13.128216 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 48669.5us
I20260709 13:10:13.135661 28894 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:13.141733 28904 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:13.100279 28905 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:13.155757 26473 leader_election.cc:336] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.925s (SENT)
I20260709 13:10:13.156469 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:13.157545 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 47064.5us
I20260709 13:10:13.162531 26657 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:13.175489 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 149846us
I20260709 13:10:13.167026 28774 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:13.170133 28905 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:13.203015 26653 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:13.203884 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1630) took 1163 ms. Trace:
I20260709 13:10:13.204084 26652 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:13.112219 28762 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.204348 26653 rpcz_store.cc:276] 0709 13:10:12.040157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.443808 (+403651us) service_pool.cc:224] Handling call
0709 13:10:12.941404 (+497596us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b5800024c98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:10:13.203800 (+262396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9133440}
I20260709 13:10:13.217128 28508 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:13.218891 26654 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:13.219489 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:13.213445 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 57743us
W20260709 13:10:13.221100 26473 leader_election.cc:336] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.984s (SENT)
W20260709 13:10:13.223510 26474 leader_election.cc:336] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 2.840s (SENT)
I20260709 13:10:13.224078 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:13.224997 28842 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:13.229398 28943 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.231890 26473 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:13.225390 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.235181 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.236516 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 67257.3us
I20260709 13:10:13.192252 28852 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:10:13.233880 28842 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:13.265990 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 44898.5us
I20260709 13:10:13.290614 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:13.273602 28823 consensus_meta.cc:287] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.006s
I20260709 13:10:13.270013 28901 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:13.294275 26548 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:13.277855 28943 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:13.298362 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:13.283100 28905 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.302567 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:13.303444 26585 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:13.309903 28915 raft_consensus.cc:3055] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:13.310560 28915 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:13.312426 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:13.312624 28894 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.313148 28894 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.314724 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.315304 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.315361 26653 raft_consensus.cc:2376] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2. Re-sending same reply.
I20260709 13:10:13.315697 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.316279 26659 raft_consensus.cc:2410] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:13.316231 26657 raft_consensus.cc:2376] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3. Re-sending same reply.
I20260709 13:10:13.315181 28894 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:13.317523 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:13.317762 28573 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:13.318181 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.318360 26659 raft_consensus.cc:2410] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:13.318423 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.319238 26653 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:13.319444 26656 raft_consensus.cc:2376] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4. Re-sending same reply.
I20260709 13:10:13.320824 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.321636 26625 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:13.322374 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 321995us
I20260709 13:10:13.328282 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.331686 26584 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:13.331957 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:13.295631 28879 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.299965 28953 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:13.338445 26474 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:13.290534 28944 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:10:13.300602 28901 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:13.348062 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 57787.1us
W20260709 13:10:13.348692 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 318104us
I20260709 13:10:13.348945 26548 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:13.345311 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.363188 26579 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:13.296321 28823 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:13.368237 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 46718.5us
I20260709 13:10:13.370786 27273 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:13.346679 28949 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:13.382591 26584 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:13.324946 28905 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.380786 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:13.385643 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.327461 28842 consensus_queue.cc:1059] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:10:13.359084 28508 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.385648 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.364375 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.374389 26625 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:13.388490 26622 leader_election.cc:400] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:13.387478 26653 raft_consensus.cc:2410] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:13.363154 28960 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:13.318418 28573 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.393898 27276 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:13.394573 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.398160 28948 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:13.398937 28779 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:13.402827 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.408075 28907 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:13.408494 28956 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:13.372812 28893 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:13.391752 26549 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:13.392607 26658 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:10:13.418841 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 119195us
W20260709 13:10:13.420717 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 51027us
I20260709 13:10:13.358740 28953 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.423763 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.422503 27271 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:13.421447 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 72584.6us
W20260709 13:10:13.423588 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 50890.9us
I20260709 13:10:13.427940 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:13.429103 28508 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:13.429771 28904 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:13.399035 28762 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:13.429340 26622 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:13.418632 28779 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:13.431491 26474 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:13.415967 28948 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:13.430541 28762 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:13.432400 28948 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.432891 28762 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:13.431879 28904 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:13.430822 28924 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.927s	user 0.000s	sys 0.004s
I20260709 13:10:13.405110 28742 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.386766 28852 consensus_queue.cc:1059] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:10:13.419554 28894 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:13.383004 28943 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:10:13.430855 26656 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
W20260709 13:10:13.438827 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 49851.4us
W20260709 13:10:13.468312 26476 leader_election.cc:336] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.801s (SENT)
W20260709 13:10:13.489954 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 58708.6us
I20260709 13:10:13.490507 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:13.497004 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.487649 27274 raft_consensus.cc:2410] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:10:13.481338 28934 log.cc:927] Time spent T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.904s	user 0.001s	sys 0.002s
I20260709 13:10:13.480070 28742 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:13.502465 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47602.7us
I20260709 13:10:13.441780 27269 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:10:13.507215 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.506335 28508 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:10:13.509886 28943 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:13.510576 28943 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.511544 28943 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.512895 28943 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:13.458024 27272 raft_consensus.cc:2955] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:13.514962 26549 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:13.516554 28963 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:13.517117 28963 raft_consensus.cc:697] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.519205 28963 consensus_queue.cc:237] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.501892 28972 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:10:13.520752 28972 raft_consensus.cc:3055] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:13.520844 28946 raft_consensus.cc:3055] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:13.521183 28972 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.521548 28946 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:13.522570 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:13.523409 28960 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:13.522949 28946 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.524315 28960 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:13.524828 28960 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.524974 28946 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:13.525898 28962 raft_consensus.cc:3055] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:13.526293 28962 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.441685 28956 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:13.526834 28956 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:13.491982 28894 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.527244 26650 raft_consensus.cc:1240] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:13.527114 28962 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.441444 28964 consensus_queue.cc:1059] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:10:13.528450 28962 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:13.528506 28964 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:13.517793 26622 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:13.527626 28894 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:13.530575 28842 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:13.530977 28960 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.531567 28916 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:13.530261 28915 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.478366 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:13.532368 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99186.2us
I20260709 13:10:13.522162 28972 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.529006 28964 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:13.517158 26549 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:13.538928 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.545718 28944 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:13.545821 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.546545 28944 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.547452 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.547588 28944 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.548636 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.431885 28779 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.549749 26549 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:13.550763 28823 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:13.550786 28774 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:13.551679 28972 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.551735 28774 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:13.553258 28952 consensus_meta.cc:287] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 13:10:13.552847 28774 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.518018 28968 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:13.554517 28936 log.cc:927] Time spent T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.977s	user 0.000s	sys 0.005s
I20260709 13:10:13.549834 28779 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:13.558378 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:13.435384 28901 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.560928 27273 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:13.527287 28956 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.563725 27275 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:13.541623 28762 raft_consensus.cc:697] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:13.570106 28942 consensus_meta.cc:287] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.002s
I20260709 13:10:13.571269 28842 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:13.573354 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.574757 27276 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:13.442866 28879 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.540068 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:13.581030 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 94585.6us
I20260709 13:10:13.544262 28905 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:13.556402 28915 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.597970 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.626736 27275 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
W20260709 13:10:13.623477 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 155217us
I20260709 13:10:13.586452 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.598089 26622 leader_election.cc:400] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5.
I20260709 13:10:13.598513 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:13.627374 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 70962.7us
I20260709 13:10:13.586905 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:13.630752 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 72487us
I20260709 13:10:13.629616 26622 leader_election.cc:403] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:13.636096 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.636737 27273 raft_consensus.cc:2376] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3. Re-sending same reply.
I20260709 13:10:13.545758 28964 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.563725 28952 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.639084 28964 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:13.639441 27271 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:13.640724 28952 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:13.641470 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:13.642021 28743 consensus_meta.cc:287] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.531s	user 0.000s	sys 0.010s
I20260709 13:10:13.642592 27270 raft_consensus.cc:2410] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:13.642686 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.643477 27273 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 2: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:13.589721 28950 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:13.591403 28971 raft_consensus.cc:3055] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:13.652032 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.653620 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.653512 26656 raft_consensus.cc:1240] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:13.660688 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.652709 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:13.665499 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.630944 27274 raft_consensus.cc:2376] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3. Re-sending same reply.
I20260709 13:10:13.584751 28823 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:13.690021 26585 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:13.692021 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:13.636853 28937 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:13.687455 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:13.688535 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 61874.5us
W20260709 13:10:13.688766 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 90358.3us
I20260709 13:10:13.701373 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.690646 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:13.701915 26652 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:13.643566 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.704378 26654 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:13.701376 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:13.717590 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.719897 26578 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:13.703317 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:13.725391 26579 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.651099 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.662997 28950 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.589545 28894 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.724290 26580 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:13.745236 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:13.745395 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:13.745836 26505 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.649839 28904 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5.
I20260709 13:10:13.739799 26508 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:13.586511 28973 consensus_queue.cc:1059] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 13:10:13.736807 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:13.743650 27272 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:13.743848 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:13.744221 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.738811 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:13.757393 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.758023 26578 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:13.686335 28971 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:13.759965 27276 raft_consensus.cc:2410] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:13.744853 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.747555 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:13.744982 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.760916 27275 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:13.701311 28842 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:13.764693 26503 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:13.685705 28573 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:13.746181 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 148216us
I20260709 13:10:13.764299 26506 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:13.718802 28953 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:13.761018 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:13.737574 28823 raft_consensus.cc:697] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.764050 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:13.782197 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.783085 27275 raft_consensus.cc:2410] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:13.773614 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.773583 28962 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:13.650257 28762 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.777858 28842 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:13.778642 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:13.718982 28972 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:10:13.797917 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.792016 26507 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:13.810614 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 64087.3us
I20260709 13:10:13.811398 26548 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:13.814109 26579 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:10:13.826398 26506 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:13.833359 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.834218 27275 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:13.835632 26503 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:13.837218 26508 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.765793 28942 consensus_queue.cc:1059] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:10:13.847342 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:13.843124 26505 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:13.772516 28973 consensus_queue.cc:1059] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 13:10:13.854579 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 108548us
W20260709 13:10:13.853004 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 129603us
I20260709 13:10:13.814306 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.860684 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.859571 28774 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:13.867093 26577 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:13.859414 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.882158 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:13.902433 28942 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:10:13.905380 28977 raft_consensus.cc:3055] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:13.924573 28977 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.924818 28949 raft_consensus.cc:3055] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:13.925410 28949 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:13.925738 28977 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.926622 28949 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.884806 28879 consensus_queue.cc:1059] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:10:13.927501 28977 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.928370 28949 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.934016 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.934437 28894 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:13.935364 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:13.907160 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.936652 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.924615 27272 raft_consensus.cc:2410] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:13.838992 28970 consensus_queue.cc:1059] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.255s
W20260709 13:10:13.938055 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 55994.6us
I20260709 13:10:13.938301 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.939055 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.939786 27271 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:13.940470 28869 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.941943 28944 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:13.867129 28973 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:13.942554 28944 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.942684 28973 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.943849 26505 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:13.943606 28944 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.944332 26395 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01228e22d88047b6bc2f5a6b74aa2b51 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:13.945212 26503 raft_consensus.cc:1240] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:13.945986 28879 raft_consensus.cc:3055] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:13.946372 28879 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:13.946408 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:13.947230 26507 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:13.947436 28879 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.948904 28879 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:13.950232 26510 pending_rounds.cc:85] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 1
I20260709 13:10:13.950850 26510 pending_rounds.cc:107] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:10:13.917447 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.934180 28893 consensus_queue.cc:1059] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:13.942094 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.881686 28918 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:13.952839 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.939188 27272 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:13.857723 28950 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.957824 28973 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:13.958505 28984 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.959383 28959 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:13.960726 28976 raft_consensus.cc:3055] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:13.961687 28823 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:13.963716 28963 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:10:13.965876 26548 connection.cc:256] RPC call timeout handler was delayed by -1.3691299800000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 13:10:14.032701 26548 connection.cc:256] RPC call timeout handler was delayed by -1.306129980000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 13:10:14.033114 26548 connection.cc:256] RPC call timeout handler was delayed by -1.3043299800000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 13:10:13.967742 26652 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:13.968693 26656 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:13.950143 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.972757 28956 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:13.996387 28980 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:13.973611 26657 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:13.976028 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.885083 28842 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.981201 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:13.865054 28948 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:13.985246 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:13.922981 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 64287.5us
I20260709 13:10:14.015342 28869 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.000646 28952 raft_consensus.cc:3055] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.004927 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:13.995826 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.992019 26507 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:14.014905 26508 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:14.000597 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:13.981271 26659 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.016438 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:14.017493 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:14.018647 27240 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.026640 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:14.026252 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:14.028460 26580 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.028844 26473 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:14.033437 26548 connection.cc:256] RPC call timeout handler was delayed by -1.2062299800001028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 13:10:14.061168 26548 connection.cc:256] RPC call timeout handler was delayed by -1.1486299800000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 13:10:14.061648 26548 connection.cc:256] RPC call timeout handler was delayed by -1.116229980000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 13:10:14.061851 26548 connection.cc:256] RPC call timeout handler was delayed by -1.1081299800000579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 13:10:14.062002 26548 connection.cc:256] RPC call timeout handler was delayed by -1.07842998000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:10:14.062142 26548 connection.cc:256] RPC call timeout handler was delayed by -1.0532299800000828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
W20260709 13:10:14.062296 26548 connection.cc:256] RPC call timeout handler was delayed by -1.0028299800000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:10:14.042161 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.043619 26476 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.045091 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:14.062837 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.986691 26510 raft_consensus.cc:2889] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:14.063252 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.063261 27276 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:13.999084 28774 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:14.064779 26585 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:14.064934 26583 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.017951 28976 raft_consensus.cc:740] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:13.907474 26653 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:14.099555 26580 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:14.069949 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.070852 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 207382us
I20260709 13:10:14.065054 28893 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.071133 28984 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.071698 28573 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:14.073508 26506 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:14.073535 26402 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48166 (request call id 194) took 11365 ms (client timeout 15000 ms). Trace:
I20260709 13:10:14.032603 28963 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:14.082366 26584 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.016705 27270 raft_consensus.cc:2376] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4. Re-sending same reply.
I20260709 13:10:14.040155 28986 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.094249 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:14.096626 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 396886us
W20260709 13:10:14.104545 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 75764.6us
I20260709 13:10:14.135951 27276 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:14.137554 26503 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:14.055873 28952 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:14.039290 28959 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.119858 27240 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:14.117543 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:14.111131 27271 raft_consensus.cc:2410] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:14.105495 28975 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:14.123114 26657 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:14.137933 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:14.124900 26402 rpcz_store.cc:269] 0709 13:10:02.708015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.716049 (+  8034us) service_pool.cc:224] Handling call
0709 13:10:14.073473 (+11357424us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:11.873624 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:11.874454 (+   830us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:11.874512 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:10:11.874531 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:11.875526 (+   995us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:11.875608 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:11.875636 (+    28us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:10:11.876413 (+   777us) tablet.cc:701] Row locks acquired
0709 13:10:11.876467 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:10:11.876629 (+   162us) write_op.cc:270] Start()
0709 13:10:11.876774 (+   145us) write_op.cc:276] Timestamp: P: 1783602611876560 usec, L: 0
0709 13:10:11.876794 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:10:11.984801 (+108007us) log.cc:844] Serialized 2856 byte log entry
0709 13:10:13.074733 (+1089932us) op_driver.cc:464] REPLICATION: finished
0709 13:10:13.268975 (+194242us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882981f0ac 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f883035fef0
0709 13:10:13.434298 (+165323us) write_op.cc:301] APPLY: starting
0709 13:10:13.438325 (+  4027us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:13.438582 (+   257us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:13.443679 (+  5097us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:13.555860 (+112181us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:13.558039 (+  2179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:10:13.558091 (+    52us) write_op.cc:312] APPLY: finished
0709 13:10:13.558420 (+   329us) log.cc:844] Serialized 59 byte log entry
0709 13:10:13.558598 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:13.558713 (+   115us) write_op.cc:454] Released schema lock
0709 13:10:13.558775 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:13.569190 (+ 10415us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:13.569227 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":12,"spinlock_wait_cycles":5248,"child_traces":[["op",{"apply.queue_time_us":359230,"apply.run_cpu_time_us":3508,"apply.run_wall_time_us":124956,"num_ops":7,"prepare.queue_time_us":480806,"prepare.run_cpu_time_us":19951,"prepare.run_wall_time_us":585224,"raft.queue_time_us":213842,"raft.run_cpu_time_us":32616,"raft.run_wall_time_us":307602,"replication_time_us":1197750,"spinlock_wait_cycles":37817216,"thread_start_us":916177,"threads_started":4,"wal-append.queue_time_us":716805}]]}
I20260709 13:10:14.235267 26508 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:14.126612 26401 catalog_manager.cc:5697] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 4 to 5, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 5 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:14.129730 28946 consensus_meta.cc:287] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.591s	user 0.003s	sys 0.007s
I20260709 13:10:14.140405 27275 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:14.124553 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:14.134231 28779 consensus_queue.cc:1059] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
W20260709 13:10:14.218915 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 175351us
I20260709 13:10:14.243546 26476 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:14.219414 28894 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:14.225121 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.015980 28962 consensus_queue.cc:1175] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "af1b5d6d444447b7a580afb4aff33320" responder_term: 5 status { last_received { term: 4 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:14.139168 26474 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.241609 26503 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:14.252377 26509 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:14.219950 28893 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.253971 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:14.263046 27275 raft_consensus.cc:2410] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:14.137898 28990 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:14.257521 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.256038 26401 catalog_manager.cc:5697] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.266677 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:14.283077 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.277112 26501 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
W20260709 13:10:14.291797 26473 leader_election.cc:336] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 2.227s (SENT)
W20260709 13:10:14.292747 26473 leader_election.cc:336] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 2.232s (SENT)
I20260709 13:10:14.293146 26473 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.144450 28986 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:14.307583 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 64105.4us
I20260709 13:10:14.308137 26401 catalog_manager.cc:5697] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 4, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 4 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.325863 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:14.327137 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:14.323210 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 184077us
I20260709 13:10:14.328418 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:14.324231 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 210718us
I20260709 13:10:14.329762 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:14.227978 28985 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:10:14.325667 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 275564us
I20260709 13:10:14.260927 28894 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.349344 26503 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:14.296066 28918 raft_consensus.cc:3055] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.274374 28946 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:14.326750 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.351625 26401 catalog_manager.cc:5697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:14.354244 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 61523us
W20260709 13:10:14.360854 26473 leader_election.cc:336] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 2.364s (SENT)
I20260709 13:10:14.361420 26473 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:14.356592 26507 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:14.349808 28573 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.297412 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:14.349941 28968 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:14.372231 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 227839us
W20260709 13:10:14.373711 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 44051.7us
I20260709 13:10:14.325359 28970 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.328326 28975 raft_consensus.cc:2764] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:14.379081 26659 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:14.367805 26401 catalog_manager.cc:5697] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 4, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 4 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.379081 26658 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:14.276337 28893 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.358366 28918 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:14.382907 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:14.371034 28573 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.387733 27275 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:14.390882 26401 catalog_manager.cc:5697] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.392714 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:14.393668 28993 log.cc:927] Time spent T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:10:14.328212 28743 consensus_queue.cc:1059] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:10:14.394373 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 267709us
I20260709 13:10:14.236123 28976 consensus_queue.cc:260] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:14.394945 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 68269.2us
I20260709 13:10:14.474856 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:14.328017 28963 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.380683 28905 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:14.376350 28968 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.365142 28992 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.288664 28774 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.399240 28946 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:14.473615 27273 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
W20260709 13:10:14.477780 26476 leader_election.cc:336] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.868s (SENT)
I20260709 13:10:14.509264 26476 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.492041 27270 raft_consensus.cc:2410] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:14.401216 28762 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:14.350045 28952 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.411405 28956 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:14.413229 28948 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:14.500444 26401 catalog_manager.cc:5697] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.412833 27269 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:14.477294 28975 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:14.372753 28983 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.499840 28743 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:14.511420 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 133923us
I20260709 13:10:14.527329 28983 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:14.528038 28994 log.cc:927] Time spent T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:10:14.529136 28987 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.529676 28987 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.530704 27240 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:14.514601 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 153775us
W20260709 13:10:14.520183 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 191827us
I20260709 13:10:14.532925 26474 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:14.501942 28968 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.535741 28893 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:14.538926 28960 raft_consensus.cc:3055] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:14.539381 28960 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:14.547992 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.535758 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 58059.6us
I20260709 13:10:14.489755 28942 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:10:14.555596 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:14.562587 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:14.563462 27240 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.565645 26501 raft_consensus.cc:2410] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:10:14.566283 26622 connection.cc:256] RPC call timeout handler was delayed by -3.41798125899993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 13:10:14.568825 26622 connection.cc:256] RPC call timeout handler was delayed by -3.372981258999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:10:14.569357 26622 connection.cc:256] RPC call timeout handler was delayed by -3.2640812590000223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:10:14.569794 26622 connection.cc:256] RPC call timeout handler was delayed by -3.2433812589999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 13:10:14.522521 26401 catalog_manager.cc:5697] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.517581 28976 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:14.571254 26504 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:14.570165 26622 connection.cc:256] RPC call timeout handler was delayed by -3.219981258999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 13:10:14.573588 26622 connection.cc:256] RPC call timeout handler was delayed by -3.1245812590000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:10:14.522681 28970 raft_consensus.cc:697] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:14.576179 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:14.618923 26508 raft_consensus.cc:2393] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:14.576808 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:14.577715 26506 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:14.574002 26622 connection.cc:256] RPC call timeout handler was delayed by -3.1002812589999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:10:14.619872 26622 connection.cc:256] RPC call timeout handler was delayed by -2.9211812589999226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 13:10:14.620194 26622 connection.cc:256] RPC call timeout handler was delayed by -2.8833812589999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 13:10:14.592072 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:14.620462 26622 connection.cc:256] RPC call timeout handler was delayed by -1.8222812589999648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33610000000000007s for a response
W20260709 13:10:14.596014 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 63152us
I20260709 13:10:14.548467 28946 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.574004 28918 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.598568 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:14.595314 28869 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:14.602547 28949 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:14.605679 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:14.606570 29009 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.651396 26474 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:14.607677 28894 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:14.575204 28893 raft_consensus.cc:3055] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:14.521521 28953 consensus_queue.cc:1059] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:10:14.511030 28997 consensus_queue.cc:1059] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 13:10:14.616472 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 185219us
I20260709 13:10:14.659386 26474 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.648988 28946 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.567718 28959 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:14.666513 26501 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:14.566727 28842 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.572724 28952 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.565047 28905 raft_consensus.cc:697] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:14.679049 29010 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.679344 28905 consensus_queue.cc:237] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.680258 29010 raft_consensus.cc:3055] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.680624 29010 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:14.681802 28869 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.648568 26502 raft_consensus.cc:2368] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:14.683897 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:14.684495 26502 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:14.597289 28743 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:14.606709 26401 catalog_manager.cc:5697] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.686848 26401 catalog_manager.cc:5697] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:14.654927 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.688449 26401 catalog_manager.cc:5697] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.655586 29007 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:14.653538 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 179718us
I20260709 13:10:14.691901 29007 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.692444 28987 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:14.692966 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:14.669281 28949 raft_consensus.cc:697] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:14.694536 28960 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.694737 28949 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.656987 26504 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:14.548756 28992 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.662184 26503 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:14.572995 28956 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:10:14.664201 26474 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.644280 28984 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:14.666553 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.676582 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:14.820578 26501 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:14.685369 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:14.821692 26502 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:14.820710 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.697546 26548 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:14.702153 29017 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:14.823969 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.697865 28968 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.704661 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1654) took 1025 ms. Trace:
I20260709 13:10:14.658666 28893 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:14.706861 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:14.825736 26653 rpcz_store.cc:276] 0709 13:10:13.679486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.679635 (+   149us) service_pool.cc:224] Handling call
0709 13:10:14.704466 (+1024831us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54001031d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:14.704590 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296577280}
W20260709 13:10:14.827692 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 163560us
I20260709 13:10:14.831415 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.825950 26401 catalog_manager.cc:5697] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.670094 28973 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:14.847030 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 283653us
I20260709 13:10:14.850239 27240 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:14.860249 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 164537us
W20260709 13:10:14.860766 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 188830us
I20260709 13:10:14.821416 28918 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.867210 28740 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:14.867619 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:14.868046 28740 raft_consensus.cc:697] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:14.868213 28842 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:14.869379 28740 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.661782 29009 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.821549 28986 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:14.660394 29003 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.865639 26474 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:14.834671 28869 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:14.821143 28985 consensus_queue.cc:1059] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:10:14.862545 28984 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:14.856379 28992 raft_consensus.cc:697] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:14.888643 28915 consensus_meta.cc:287] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.291s	user 0.012s	sys 0.006s
I20260709 13:10:14.904911 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:14.880184 28973 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:14.918885 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:14.920337 27278 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:14.887814 28573 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:14.913329 27240 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:14.922452 26548 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:14.923383 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 57830.3us
I20260709 13:10:14.937026 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1629) took 1258 ms. Trace:
I20260709 13:10:14.937495 26582 rpcz_store.cc:276] 0709 13:10:13.682593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.697424 (+ 14831us) service_pool.cc:224] Handling call
0709 13:10:14.936809 (+1239385us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b540015f4d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:14.936960 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064014208}
I20260709 13:10:14.916637 29006 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:14.938597 29001 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.939203 29001 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.916900 29013 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.681433 29010 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.923211 28975 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:14.933831 28987 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:14.920260 28743 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:10:14.967952 27276 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:14.972465 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:14.924993 28968 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:14.974308 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 97068.5us
I20260709 13:10:14.970304 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1876) took 1027 ms. Trace:
I20260709 13:10:14.939438 28879 raft_consensus.cc:3055] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:10:14.983999 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.984544 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.957736 28976 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:14.912650 28893 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.976473 26510 rpcz_store.cc:276] 0709 13:10:13.943099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.949684 (+  6585us) service_pool.cc:224] Handling call
0709 13:10:13.950032 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.074676 (+124644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.074720 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.226613 (+151893us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b2c000014c8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882b222a11 00007f882b232372 00007f882c964a01 00007f882c92943a 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2
0709 13:10:14.227028 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.505708 (+278680us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:14.505744 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.505810 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.950091 (+444281us) raft_consensus.cc:1685] finished
0709 13:10:14.950111 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.970211 (+ 20100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17211136,"thread_start_us":278299,"threads_started":1,"wal-append.queue_time_us":686140}
I20260709 13:10:14.987656 29010 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.961408 28915 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:14.899799 29003 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:14.899688 28970 consensus_queue.cc:237] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:14.953375 28573 consensus_queue.cc:1059] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:10:14.959908 29011 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:14.980561 28879 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:14.990900 28976 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.005280 28973 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.007448 28997 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.008882 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:15.033703 26583 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.009770 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:15.029801 26473 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.592s (SENT) [suppressed 55 similar messages]
W20260709 13:10:15.035871 26473 leader_election.cc:336] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.802s (SENT)
I20260709 13:10:15.010597 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.011123 26548 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:10:15.012228 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.997735 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:14.979575 29022 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:15.013047 29015 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:14.955709 29013 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:15.068944 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 57905.7us
I20260709 13:10:15.010052 26584 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:14.976105 28975 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:15.033193 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.031595 28983 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:15.029853 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.009938 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:15.012451 29019 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:10:15.075110 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.037384 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:15.037410 26473 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:14.988511 28894 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:15.002545 28915 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:15.021086 26501 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:14.939976 28992 consensus_queue.cc:237] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.029844 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:15.040395 29022 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:15.040040 28946 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.040670 29015 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.081596 28905 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:14.980288 28971 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:15.086903 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 51236.1us
I20260709 13:10:15.075982 26577 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.067889 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:15.098243 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.106639 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:15.094307 26583 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
W20260709 13:10:15.111475 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 81712.9us
I20260709 13:10:15.112368 26476 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:15.109134 26502 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:15.114485 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:15.112368 26622 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.119837 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:15.076777 28984 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:15.079416 28915 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:15.124948 26473 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.038772 28997 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.082432 29022 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.081641 28784 raft_consensus.cc:3055] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:15.084059 28983 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.084685 29003 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.132663 26473 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.127895 27275 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:15.145313 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.084208 29015 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.081818 28869 consensus_queue.cc:1059] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 13:10:15.133711 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 61779.4us
I20260709 13:10:15.133832 28784 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:15.126940 29024 log.cc:927] Time spent T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:15.152360 27275 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:15.122423 28984 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:15.122447 28905 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:15.151180 27271 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:10:15.154532 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:15.154016 28784 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.131048 28968 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:15.150703 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:15.159277 28984 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.126147 27270 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:15.134079 28894 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:15.164166 26577 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:15.165632 28976 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:15.170742 29016 raft_consensus.cc:3055] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:15.155603 29004 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:15.175222 28997 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.176882 29026 raft_consensus.cc:3055] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:15.178483 29021 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:15.180361 28869 raft_consensus.cc:3055] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:15.181762 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:15.190025 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 57393.7us
I20260709 13:10:15.090296 28975 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.198503 28986 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:15.200322 29013 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.157688 29003 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.204973 28990 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.129420 28879 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.212813 28962 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.258314 28990 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.258646 28962 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.259999 29001 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.260879 28962 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.212961 29009 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.209630 29022 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.246162 29021 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:15.262316 29003 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.214104 29015 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.264410 29003 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:15.254705 28508 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.265381 29015 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.265729 28987 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.266373 28742 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.266201 28987 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.266860 28742 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.267270 27274 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:15.268333 28987 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:15.268824 28742 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:15.269106 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:15.269980 28823 raft_consensus.cc:3055] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:15.270177 26656 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:15.270429 28823 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:15.222872 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.229782 27271 pending_rounds.cc:85] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 5
I20260709 13:10:15.224227 27276 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:15.232820 28784 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.271364 28823 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.272274 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 660) took 1561 ms. Trace:
I20260709 13:10:15.272575 28823 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:15.272676 27269 rpcz_store.cc:276] 0709 13:10:13.710955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.936381 (+225426us) service_pool.cc:224] Handling call
0709 13:10:15.272100 (+1335719us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400668d54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:15.272215 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064118144}
W20260709 13:10:15.232892 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 82256.2us
I20260709 13:10:15.255354 28983 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:15.274631 26548 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:15.245282 28869 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:15.169354 28950 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.275847 28869 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.277179 28869 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.271368 27271 pending_rounds.cc:107] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:10:15.238998 29016 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:15.278105 28997 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.277948 27271 raft_consensus.cc:2889] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.278844 29016 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.280113 29016 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.246431 28944 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:15.246582 29026 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:15.282099 29026 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.283092 28971 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.220700 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:15.262339 29007 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:15.283928 27277 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:15.284473 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 667) took 1570 ms. Trace:
I20260709 13:10:15.284783 27277 rpcz_store.cc:276] 0709 13:10:13.713939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.254834 (+540895us) service_pool.cc:224] Handling call
0709 13:10:15.220520 (+965686us) spinlock_profiling.cc:243] Waited 8.94 ms on lock 0x7b5800161a98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:10:15.284417 (+ 63897us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20553472}
W20260709 13:10:15.233706 27273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 652) took 1598 ms (client timeout 2000 ms). Trace:
I20260709 13:10:15.285292 26473 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:15.285718 27273 rpcz_store.cc:269] 0709 13:10:13.635273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.652489 (+ 17216us) service_pool.cc:224] Handling call
0709 13:10:15.233389 (+1580900us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400720e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:15.233508 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357917056}
W20260709 13:10:15.274849 27278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 372) took 1908 ms (client timeout 2192 ms). Trace:
W20260709 13:10:15.288092 27278 rpcz_store.cc:269] 0709 13:10:13.366777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.366901 (+   124us) service_pool.cc:224] Handling call
0709 13:10:15.274695 (+1907794us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54005703d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:15.274792 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3527985280}
I20260709 13:10:15.289005 28508 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.291280 28508 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:15.263274 29022 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.233717 28905 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:15.280026 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.293582 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:15.293679 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.294292 26655 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:15.274943 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 93324.3us
I20260709 13:10:15.295261 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.296022 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.296509 26657 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:15.297447 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.297151 28905 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.297696 28508 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:15.298329 28508 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.296913 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.299593 26656 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:15.299849 29007 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.299932 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.300827 26653 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:15.275807 26548 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:15.302314 26657 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:15.283151 29026 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.307396 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:15.307689 26584 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:15.308542 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.309193 26580 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:15.312923 26580 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:15.313870 28998 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.314255 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.314953 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:15.315429 29007 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.315816 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.316071 29007 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.316807 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:15.315442 26658 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:15.317761 28984 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.319429 29007 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:15.319443 26548 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:15.320803 28997 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:15.320956 28963 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.321523 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:15.321884 28959 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:15.322562 28950 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:15.323412 28950 raft_consensus.cc:697] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:15.315816 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.326558 28960 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.326655 26650 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:15.324769 28950 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.328521 26650 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:15.330154 26585 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:15.331440 28842 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:15.331334 28986 consensus_queue.cc:1059] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:15.331980 28842 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.332461 28842 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.332537 29004 raft_consensus.cc:3055] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:15.333050 29004 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:15.333201 28990 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.334280 28774 raft_consensus.cc:3055] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:15.334023 29004 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.334694 26474 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.316111 28508 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:15.335407 28986 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.336316 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.369549 26501 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:15.369907 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.338052 26576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:10:15.371038 26576 raft_consensus.cc:606] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:15.371372 26576 raft_consensus.cc:614] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:15.339777 28879 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.340580 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.374142 26577 raft_consensus.cc:2410] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:10:15.341059 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 45133.5us
I20260709 13:10:15.342092 26653 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:10:15.343194 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.315490 26656 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:15.345220 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 113665us
W20260709 13:10:15.353933 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.320128 28984 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:15.361763 29009 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.361346 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.365994 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.366282 27273 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:15.367533 26580 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:15.367568 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.372675 26503 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:10:15.379364 26651 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:15.381088 26503 pending_rounds.cc:85] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 3
I20260709 13:10:15.381134 26658 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:15.381498 26503 pending_rounds.cc:107] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:10:15.381840 26503 raft_consensus.cc:2889] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.382007 26622 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.330268 28893 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.376796 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:15.376902 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:15.382866 26652 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:15.354497 28962 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:15.379225 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:15.386087 27278 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:15.387112 26580 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:15.355556 28774 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:15.392381 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:15.393155 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.370546 28904 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.376935 28968 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:15.393993 26654 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:15.402017 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.397616 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.408227 26651 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:15.378927 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:15.405858 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.406407 26510 raft_consensus.cc:1275] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:15.407284 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.409981 26652 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:15.410073 26577 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:10:15.373340 29012 consensus_queue.cc:1175] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "af1b5d6d444447b7a580afb4aff33320" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:10:15.389025 28974 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:15.437245 26508 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:15.388821 29004 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:15.412638 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.412333 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:15.392556 28973 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:15.442543 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.443444 26576 raft_consensus.cc:2393] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:15.443279 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.444482 26582 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:15.444804 26580 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:15.329277 29021 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.445919 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.445982 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.446942 26582 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:15.447463 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:15.447898 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.448519 26581 raft_consensus.cc:2393] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:15.449707 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.450127 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.439457 27271 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:15.451866 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:15.452587 29025 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.448s	user 0.005s	sys 0.000s
I20260709 13:10:15.453632 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.454018 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.454164 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:15.454887 29008 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.455322 29036 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.455399 29008 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.454200 26576 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:10:15.439975 26548 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:15.458772 26548 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:15.377416 28990 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:10:15.402144 28943 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.407063 28977 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.402421 28944 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.465528 29008 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.471052 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:15.460711 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:15.406757 28972 consensus_queue.cc:1059] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:10:15.436069 28998 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.432206 29022 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.407837 28968 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.440186 28974 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.431913 28784 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:15.392431 28976 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:10:15.472589 26506 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:15.522102 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:15.436734 28508 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:15.402956 29006 consensus_queue.cc:1059] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:10:15.470577 29011 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.532940 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:15.529735 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 58607.6us
I20260709 13:10:15.482048 29036 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:15.483476 28983 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:15.484136 26504 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:15.484402 28742 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.446025 29021 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.480674 26622 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.487560 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:15.490942 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99308.5us
I20260709 13:10:15.522892 26510 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:15.525236 26625 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:15.528714 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:15.530226 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:15.530949 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:15.431593 28904 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.481320 26656 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:15.485867 29015 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:15.468842 28915 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.491600 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.487011 27270 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:15.523509 28968 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:15.557606 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:15.559904 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:15.542213 26507 raft_consensus.cc:2410] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:15.525123 28974 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.542498 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:15.563674 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.527057 27269 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:15.525950 28984 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.531987 27274 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:15.553242 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:15.473798 28977 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.532817 29000 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:15.556157 29015 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.479168 28956 consensus_queue.cc:1059] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:15.555016 26654 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:15.556070 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:15.557520 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.531418 28784 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.566104 26655 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:15.562448 27241 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:15.611658 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 49283.4us
I20260709 13:10:15.612709 27241 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:15.536664 29036 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:15.615917 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.575659 26656 raft_consensus.cc:1240] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:15.576174 26507 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:15.579836 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:15.618022 26510 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:15.580026 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.480690 28944 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.618782 26652 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:15.544934 28508 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:15.598668 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.621085 26579 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:15.473255 28943 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.603240 26659 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:15.554585 28972 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:10:15.562743 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:15.542250 28952 consensus_queue.cc:1059] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:10:15.533247 29009 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:10:15.526273 29022 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.497733 28774 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.619011 26507 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:15.652050 28508 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.652554 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:15.653308 26507 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:15.654644 26507 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:15.667081 28784 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.667842 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:15.668577 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.669178 28943 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:15.622131 28743 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:15.669884 28743 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.670099 27276 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:15.522083 28998 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.671152 28904 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:15.671923 28904 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:15.673036 28998 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.638140 27275 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.609242 29015 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.579289 26650 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:15.644411 26510 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:15.616429 28779 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:15.636772 27272 raft_consensus.cc:2393] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:15.645905 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:15.673061 28904 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:15.647347 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:15.710983 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.585110 29007 consensus_queue.cc:1059] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:10:15.616852 28975 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:15.668828 26584 raft_consensus.cc:2393] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:15.719156 27243 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:15.606139 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 50158.9us
I20260709 13:10:15.723531 27240 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:15.619992 29036 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.585651 28984 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.692708 27275 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:15.641654 29000 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:15.694525 27273 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:15.617260 29003 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:15.749908 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:15.706358 27241 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.643973 28905 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.670231 28743 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:15.734997 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:15.745230 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.767973 28742 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.770090 28962 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:15.770795 28742 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.748546 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:15.750800 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 225647us
I20260709 13:10:15.772223 26655 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:15.773032 26625 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:15.673425 29045 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 13:10:15.767741 28943 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.768095 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:15.728202 28975 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.747350 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:15.782900 26658 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:15.768687 28998 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:15.737464 28784 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:15.710302 28774 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:15.775486 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 69255.8us
I20260709 13:10:15.774112 28983 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:15.785132 29000 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.788079 28949 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:15.789772 28972 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:15.790112 28904 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.790419 28997 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:15.774923 26625 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:15.763377 26656 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:15.880053 26656 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:15.740161 28779 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.750263 29003 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.776960 27270 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:15.886111 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 144551us
I20260709 13:10:15.751637 29043 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.805797 26549 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:15.813771 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 333140us
W20260709 13:10:15.893632 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 88166.3us
I20260709 13:10:15.893837 26622 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.894613 26549 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:15.739302 28842 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:15.794215 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:15.792488 28975 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:15.804345 28742 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:15.801416 28983 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:15.897056 29026 consensus_meta.cc:287] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.001s
I20260709 13:10:15.897687 28915 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:15.899035 28971 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.000s
I20260709 13:10:15.810451 28949 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.814601 28972 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:15.906196 29016 consensus_meta.cc:287] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:10:15.815049 28960 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:15.906685 28943 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:15.893693 29003 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.895435 26549 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:16.011927 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 237051us
W20260709 13:10:16.012064 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 116690us
I20260709 13:10:16.013314 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:16.013618 26474 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:15.778939 28905 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:15.835597 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.886900 26656 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:15.885844 28992 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:10:15.931160 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:15.934527 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.944366 26510 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:15.881456 28977 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:15.950966 26504 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:15.900496 28950 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:15.882817 28973 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:15.931802 28879 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 13:10:15.918877 29049 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:16.007764 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:15.942399 29006 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:16.012737 29041 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.004972 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:15.941854 28983 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.011318 28943 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.943591 28842 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.029109 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:16.010492 26505 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:15.943615 26650 raft_consensus.cc:2376] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6. Re-sending same reply.
I20260709 13:10:16.000386 28742 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:10:16.037621 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 500843us
I20260709 13:10:16.000212 28972 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:16.044541 26584 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:16.012377 28949 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.024329 26656 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.009370 28960 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:16.029165 28963 consensus_meta.cc:287] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.000s
I20260709 13:10:16.047699 26583 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
W20260709 13:10:16.049456 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.045228 29006 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:16.090828 26585 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:16.029809 28962 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:16.045081 29046 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:10:16.034101 28944 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.038378 28950 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.041944 29049 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.046917 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:16.081118 26655 raft_consensus.cc:1275] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:16.029786 29051 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:16.081278 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.048331 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.086776 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.087443 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.056049 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:16.062709 28943 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.062732 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:16.107825 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.064355 29012 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:16.085587 26622 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:16.064092 28894 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.121397 26503 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
W20260709 13:10:16.029858 29050 consensus_queue.cc:1175] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ef2886777a8f45e69e213b02a22ecec7" responder_term: 4 status { last_received { term: 4 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:10:16.125128 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.121488 26658 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:16.141809 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.151485 26504 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:15.928272 29043 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.094702 28962 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.091897 28508 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.144532 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.122912 29051 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.097529 28984 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.176599 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.121486 26625 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:16.116770 28950 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:16.111109 28842 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:16.062017 29052 consensus_queue.cc:1059] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:10:16.082305 28956 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:16.059522 29041 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.118517 29065 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:16.166980 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.166600 26548 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:16.086098 28997 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:10:16.168799 26656 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:16.167553 28962 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.141469 29026 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:16.180411 29048 log.cc:927] Time spent T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:10:16.209986 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:16.308840 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 98918.3us
I20260709 13:10:16.180804 28905 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.118238 28963 consensus_queue.cc:1059] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:10:16.152086 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:16.189203 26507 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:16.151876 29022 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.117946 29049 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.176918 27269 raft_consensus.cc:2393] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:16.225966 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.170943 29012 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:16.172808 29051 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.153187 28894 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.209339 29057 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.349774 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.350430 26503 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
W20260709 13:10:16.318800 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 233286us
W20260709 13:10:16.281020 29053 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:10:16.281317 29047 log.cc:927] Time spent T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:10:16.286350 28977 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:16.174827 28508 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.205745 28915 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.280603 29058 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:16.358642 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.167894 29017 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.136s
I20260709 13:10:16.158839 28960 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.338836 28985 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:10:16.360559 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:16.281282 28998 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:10:16.281100 29061 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:16.398113 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.366575 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:16.374354 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 252939us
I20260709 13:10:16.348433 29063 raft_consensus.cc:2764] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:10:16.399976 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.402384 26578 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:10:16.409162 26578 pending_rounds.cc:85] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 5
I20260709 13:10:16.409411 26578 pending_rounds.cc:107] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:10:16.409714 26578 raft_consensus.cc:2889] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.359875 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:16.387684 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:16.383740 28968 consensus_meta.cc:287] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.826s	user 0.009s	sys 0.002s
I20260709 13:10:16.282222 28997 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:10:16.385778 29060 raft_consensus.cc:3055] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:16.390130 28960 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.205283 28842 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.280679 29065 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.319137 28944 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.382123 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.312175 29026 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.358642 28963 consensus_queue.cc:1243] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer b1f40e8672c549d3b4be7862ac07b7e2 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:16.150748 28973 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.172945 29006 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.453846 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:16.419421 28893 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.031s	user 0.010s	sys 0.000s
I20260709 13:10:16.427495 29043 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.432049 26576 raft_consensus.cc:3055] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:16.358160 29010 raft_consensus.cc:3055] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.433406 27277 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:16.375797 29022 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.387449 29058 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.393623 29056 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:16.436265 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 82826.4us
I20260709 13:10:16.477156 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:16.399398 28984 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:16.435632 29052 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:10:16.436022 28977 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:16.451824 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 536) took 1109 ms. Trace:
I20260709 13:10:16.365044 29057 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.454644 26501 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:16.383971 28915 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.437821 29060 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:16.458384 26503 raft_consensus.cc:1813] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Handling vote request from an unknown peer af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:16.439222 28968 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.485610 26657 rpcz_store.cc:276] 0709 13:10:15.342832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.344182 (+  1350us) service_pool.cc:224] Handling call
0709 13:10:15.372451 (+ 28269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.372799 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.372827 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.380650 (+  7823us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.695014 (+314364us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:15.695058 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.695923 (+   865us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.451588 (+755665us) raft_consensus.cc:1685] finished
0709 13:10:16.451607 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.451761 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1960,"raft.queue_time_us":438,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7302,"thread_start_us":261957,"threads_started":1,"wal-append.queue_time_us":527766}
I20260709 13:10:16.460330 28956 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.460781 28998 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.457882 26576 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:16.464762 29064 consensus_queue.cc:1175] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9c3761688a64982ae1c4aeb758e09ef" responder_term: 6 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:16.468225 29022 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.471031 28950 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.457512 28963 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.471786 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 542) took 1066 ms. Trace:
I20260709 13:10:16.472010 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 293) took 2333 ms. Trace:
I20260709 13:10:16.503752 26653 rpcz_store.cc:276] 0709 13:10:15.404879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.405034 (+   155us) service_pool.cc:224] Handling call
0709 13:10:16.471463 (+1066429us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400168354. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:16.471592 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104189824}
I20260709 13:10:16.463233 29010 raft_consensus.cc:740] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:16.440250 26502 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:16.503865 26505 rpcz_store.cc:276] 0709 13:10:14.138690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.138872 (+   182us) service_pool.cc:224] Handling call
0709 13:10:14.220267 (+ 81395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.061420 (+1841153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.471768 (+410348us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b5400352ad4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:16.471917 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4014633088}
W20260709 13:10:16.437381 29004 consensus_meta.cc:287] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.974s	user 0.004s	sys 0.006s
I20260709 13:10:16.425328 28983 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.459761 29016 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:16.510783 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:16.374212 29012 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.499538 29062 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:16.534533 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.508235 28823 consensus_meta.cc:287] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.235s	user 0.014s	sys 0.000s
I20260709 13:10:16.473336 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:16.553923 26650 raft_consensus.cc:2410] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:10:16.555382 28508 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:16.555583 28983 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:16.485339 28977 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.557586 28977 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.558862 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 397) took 1191 ms. Trace:
I20260709 13:10:16.559221 27277 rpcz_store.cc:276] 0709 13:10:15.367882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.368008 (+   126us) service_pool.cc:224] Handling call
0709 13:10:16.558707 (+1190699us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54005abc54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:16.558807 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451393408}
I20260709 13:10:16.478356 28894 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:16.478642 28984 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.490243 29063 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.566432 26657 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:16.502677 26508 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:16.495870 29026 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.494129 29006 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.492789 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.576299 26501 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 2.
I20260709 13:10:16.509184 26576 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.504875 29067 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.515442 28842 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.516127 29065 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:16.516702 29010 consensus_queue.cc:260] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:16.507130 29055 log.cc:927] Time spent T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:10:16.519889 29074 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:16.521888 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1664) took 1257 ms. Trace:
W20260709 13:10:16.523962 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.507987 28963 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.502090 28998 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.573751 27272 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:16.521922 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 401) took 1131 ms. Trace:
I20260709 13:10:16.595544 27276 rpcz_store.cc:276] 0709 13:10:15.391009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.391314 (+   305us) service_pool.cc:224] Handling call
0709 13:10:15.412041 (+ 20727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.670826 (+258785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.521726 (+850900us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b5400284454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:16.521873 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593010560}
I20260709 13:10:16.527140 28968 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.527809 29041 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:16.519460 28986 consensus_meta.cc:287] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.140s	user 0.010s	sys 0.000s
I20260709 13:10:16.537043 26622 leader_election.cc:400] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:16.537840 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 404) took 1133 ms. Trace:
I20260709 13:10:16.482029 29056 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.493203 26503 raft_consensus.cc:2410] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:10:16.541764 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.546489 28974 consensus_meta.cc:287] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.966s	user 0.012s	sys 0.000s
I20260709 13:10:16.548693 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1880) took 1192 ms. Trace:
I20260709 13:10:16.549546 29008 raft_consensus.cc:3055] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.550845 29022 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.551949 28962 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:16.529853 28743 consensus_meta.cc:287] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.000s
I20260709 13:10:16.557054 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:16.562043 26656 raft_consensus.cc:1240] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:16.599265 29021 consensus_meta.cc:287] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.052s	user 0.006s	sys 0.006s
I20260709 13:10:16.568178 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:16.585419 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.586282 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:16.610340 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.587201 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:16.574194 28975 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.001s
I20260709 13:10:16.525003 28987 raft_consensus.cc:3055] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.573966 28984 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.593313 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:16.620266 26585 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:16.620671 26504 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:16.591240 26659 rpcz_store.cc:276] 0709 13:10:15.264770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.268837 (+  4067us) service_pool.cc:224] Handling call
0709 13:10:16.521726 (+1252889us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54002dad54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:16.521828 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427213184}
I20260709 13:10:16.592582 26549 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:16.512534 29016 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.582479 29026 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.601329 27275 rpcz_store.cc:276] 0709 13:10:15.404162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.404384 (+   222us) service_pool.cc:224] Handling call
0709 13:10:15.453998 (+ 49614us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b5800161a98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:10:16.537529 (+1083531us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400428e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:16.537773 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431512704}
I20260709 13:10:16.603878 26502 rpcz_store.cc:276] 0709 13:10:15.356060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.356186 (+   126us) service_pool.cc:224] Handling call
0709 13:10:15.356488 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.504891 (+1148403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.548451 (+ 43560us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000023d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:16.548630 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2491989376}
I20260709 13:10:16.498039 28956 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.606920 26652 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:16.599778 29010 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.612871 26473 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:16.575328 29060 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:16.623121 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 109368us
I20260709 13:10:16.603093 28986 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:16.596295 28842 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:10:16.636376 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:16.636965 27275 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.626156 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:16.605970 29008 raft_consensus.cc:740] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:16.628465 26659 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:10:16.629067 29068 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.457s	user 0.004s	sys 0.000s
I20260709 13:10:16.595052 28823 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:10:16.632767 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:16.638592 26622 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:16.642673 27240 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:16.644133 27275 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:16.613688 28987 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:16.604943 29051 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:16.631114 29071 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:10:16.634724 29043 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.651338 29074 consensus_queue.cc:1059] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:16.591125 29067 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.651677 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:16.655539 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:16.651556 29078 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.661336 27271 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:16.662257 26474 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:16.651743 29008 consensus_queue.cc:260] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:16.663375 29070 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:10:16.663462 29000 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:16.664332 28987 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.606134 28974 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.635229 28774 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:10:16.668993 28943 consensus_meta.cc:287] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.000s
I20260709 13:10:16.619602 28975 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.709827 28975 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.699396 28869 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:16.711167 28869 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.711589 28869 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:16.692071 28950 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.676306 29065 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:16.611196 28743 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.671104 28962 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.673532 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:16.635035 28952 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:16.635160 29021 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.648414 28915 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:16.692868 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.695248 29000 raft_consensus.cc:697] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:16.696053 28987 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.629791 29026 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.700861 28974 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.701001 28956 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.701618 29016 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.701365 28943 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:16.698731 29003 consensus_meta.cc:287] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.665s	user 0.004s	sys 0.006s
I20260709 13:10:16.702237 29008 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.703383 26501 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:16.747581 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:16.704109 28977 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.704387 29067 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.705166 29077 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:16.686203 28893 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:16.707660 29051 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:16.707870 28972 consensus_meta.cc:287] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.000s
I20260709 13:10:16.787243 29063 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.787441 28972 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.788043 28869 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.669665 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:16.713837 26506 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
W20260709 13:10:16.690034 29036 consensus_meta.cc:287] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.938s	user 0.011s	sys 0.000s
I20260709 13:10:16.691121 29052 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:16.725962 26650 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:16.722621 29015 consensus_meta.cc:287] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.017s	user 0.011s	sys 0.000s
I20260709 13:10:16.720028 29078 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.705888 29056 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.737146 27278 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:16.739719 28949 consensus_meta.cc:287] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.649s	user 0.006s	sys 0.005s
I20260709 13:10:16.739382 29000 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.742723 29057 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.732195 29021 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.735555 28915 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.728878 28952 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.746598 29003 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.748425 26503 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
W20260709 13:10:16.756891 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 83953.6us
I20260709 13:10:16.758077 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:16.727694 29065 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:16.838440 29065 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:16.840493 28743 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.805662 28956 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:16.847100 26622 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:16.848424 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:16.721853 28986 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:10:16.789961 27276 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.790014 28963 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.823377 28893 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.796247 29026 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:16.797973 28972 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.822698 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1893) took 1137 ms. Trace:
I20260709 13:10:16.834801 27272 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:16.836330 29021 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.836459 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:16.774847 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.807936 29052 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:16.820971 28949 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.858543 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:16.795194 28998 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.821430 29066 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:16.832830 28952 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.875348 29063 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.875591 29051 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:10:16.873070 29077 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.875808 26510 rpcz_store.cc:276] 0709 13:10:15.685479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.685770 (+   291us) service_pool.cc:224] Handling call
0709 13:10:15.697684 (+ 11914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.032913 (+335229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.821930 (+789017us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400358c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:16.822399 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566826368}
I20260709 13:10:16.883167 26654 raft_consensus.cc:2393] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:16.902410 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:16.883697 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:16.902434 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:16.789898 29049 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.903618 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:16.810765 29015 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.904753 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:16.905439 26580 raft_consensus.cc:2393] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:16.886437 26652 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.859097 29078 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.800505 29036 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.866876 28779 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:16.833382 28915 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.878823 28977 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.964097 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:17.031008 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:17.031863 26510 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:16.876583 28893 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.872993 29062 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:16.885310 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.907567 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:16.876121 29085 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.960309 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:17.071888 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:16.961171 26622 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:17.074821 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 113736us
I20260709 13:10:17.074916 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:17.075579 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:17.075789 26580 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:16.965705 26582 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:16.966910 29036 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.967376 28970 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.968050 26651 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:16.868882 28956 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.099205 28956 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:16.965194 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:17.035727 29088 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
W20260709 13:10:17.035645 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 54380.3us
I20260709 13:10:17.036322 28986 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:17.037454 28915 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:17.037611 29067 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.964105 29056 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:17.040462 27276 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:17.035786 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:17.167636 26655 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:17.167830 27275 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:10:17.102475 29062 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:17.168877 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:17.051255 29049 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:17.054093 28949 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:17.055078 29003 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:16.959368 29015 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:17.075685 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.965174 27270 raft_consensus.cc:2393] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:16.887229 27273 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:16.890391 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:17.094534 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:17.181093 26510 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:17.094218 28970 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.095700 29036 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:17.077538 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:17.121685 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.972303 29057 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.188163 29057 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:16.896077 29066 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.101802 29085 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.056708 28842 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:10:17.204118 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:17.081805 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:17.214344 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:17.218294 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:17.231799 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:17.117921 28984 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.158058 28975 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:17.160792 29067 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:17.158000 28974 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:17.169806 26654 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:17.079154 28977 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.962520 29077 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.157018 29007 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.185521 26474 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:17.175160 29056 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:17.187356 29036 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:17.241400 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 159677us
I20260709 13:10:17.152753 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:16.971817 29052 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:17.179913 28956 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.269469 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:17.298615 27273 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:17.299912 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:17.300676 27273 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
W20260709 13:10:17.229499 29088 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:17.252045 29062 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:17.272226 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:17.156927 29043 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:17.228365 28949 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.285836 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:17.297231 29036 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:17.350461 26510 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:17.268694 28974 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.282662 28977 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:17.365070 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.193500 29066 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:17.302690 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:17.307399 29062 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.294222 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:17.269019 28975 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:17.362231 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 545) took 1827 ms. Trace:
I20260709 13:10:17.363304 26505 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:17.363428 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:17.371321 26651 rpcz_store.cc:276] 0709 13:10:15.534468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.535479 (+  1011us) service_pool.cc:224] Handling call
0709 13:10:17.362015 (+1826536us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002d9e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:17.362171 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3191668480}
I20260709 13:10:17.377000 26505 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:17.379705 26502 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
W20260709 13:10:17.316018 29010 consensus_meta.cc:287] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.004s
I20260709 13:10:17.368023 26655 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:17.367323 29000 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:17.344079 29015 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.348827 28949 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:17.372696 29008 consensus_meta.cc:287] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.004s
I20260709 13:10:17.287563 29007 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.306767 28956 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.368378 29043 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:17.310962 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:17.374114 29066 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:17.380945 29049 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:17.402535 28977 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:17.406369 26510 raft_consensus.cc:1240] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:10:17.365751 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.408501 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:17.409425 26580 raft_consensus.cc:2410] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:17.411693 26655 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:17.412981 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:17.388468 29077 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:17.371495 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 79066.5us
I20260709 13:10:17.393358 28998 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.401787 29086 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:10:17.425829 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:17.426550 28975 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:17.429951 28974 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:17.420996 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:17.432273 29093 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:17.435194 29007 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:17.453434 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:17.487552 26582 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:17.487674 26580 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:17.373157 29062 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:17.462682 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.457084 26581 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:17.515970 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:17.405725 29066 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.406100 29049 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.491261 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:17.522959 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:17.419173 28977 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.403558 29043 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.492449 27273 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:17.531900 29003 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:17.533864 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:17.533129 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1674) took 1064 ms. Trace:
I20260709 13:10:17.538226 27241 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:17.397194 29015 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.544451 29007 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.544963 29006 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:17.545785 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1887) took 2105 ms. Trace:
I20260709 13:10:17.590931 26580 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:17.455389 28842 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.399446 29000 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.516098 29064 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.521910 28974 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.526575 29008 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:17.525207 29049 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:17.525396 29066 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.542632 29067 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:17.550509 29003 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.538431 28984 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:17.593066 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:17.550871 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 365144us
I20260709 13:10:17.634083 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:17.581873 26508 rpcz_store.cc:276] 0709 13:10:15.440247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.440376 (+   129us) service_pool.cc:224] Handling call
0709 13:10:15.466541 (+ 26165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.568008 (+1101467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.545342 (+977334us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000b36d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:17.545531 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2382481152}
I20260709 13:10:17.597383 27273 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:17.545706 29043 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:17.636791 27271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 683) took 2211 ms (client timeout 1592 ms). Trace:
W20260709 13:10:17.637246 27271 rpcz_store.cc:269] 0709 13:10:15.415023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.451606 (+ 36583us) service_pool.cc:224] Handling call
0709 13:10:17.625814 (+2174208us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54006f1154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:17.625960 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2671931648}
W20260709 13:10:17.619444 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.634773 26578 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
W20260709 13:10:17.489697 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 71472.6us
W20260709 13:10:17.625852 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.641078 26622 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:17.615226 29063 consensus_meta.cc:287] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.000s
I20260709 13:10:17.650427 26577 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:17.598212 29056 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:17.632054 27277 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:17.559684 28915 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:17.633163 29003 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:17.599351 29006 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.487972 28998 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:17.652043 27273 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:17.546557 28977 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.637847 29067 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.653548 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:17.723862 26578 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:17.654615 27243 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:17.515851 29093 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.635892 26474 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:17.593380 29007 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:17.628361 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:17.726863 26580 raft_consensus.cc:2393] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:17.603689 28974 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.600610 28842 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:17.644748 29077 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:17.725623 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 71108.1us
I20260709 13:10:17.652776 29063 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:17.727444 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 183327us
W20260709 13:10:17.673166 28952 consensus_meta.cc:287] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.775s	user 0.008s	sys 0.001s
I20260709 13:10:17.626375 29064 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:17.735589 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99756.7us
I20260709 13:10:17.627408 29008 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.737073 26474 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:17.735890 27273 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:17.550314 26650 rpcz_store.cc:276] 0709 13:10:16.468696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.668770 (+200074us) service_pool.cc:224] Handling call
0709 13:10:16.669108 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.808605 (+139497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.532723 (+724118us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b54001f5c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:17.533037 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104286592}
I20260709 13:10:17.672837 28949 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:17.737903 26583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1643) took 2602 ms (client timeout 3253 ms). Trace:
W20260709 13:10:17.743340 26583 rpcz_store.cc:269] 0709 13:10:15.130733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.130883 (+   150us) service_pool.cc:224] Handling call
0709 13:10:17.732467 (+2601584us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b5400020dd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:17.732587 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068341504}
I20260709 13:10:17.670691 28956 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:17.741454 26508 raft_consensus.cc:2955] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:17.753943 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:17.754803 26583 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.761499 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:17.740015 29094 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:17.742921 29056 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:17.772678 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.778658 27273 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:17.783990 27273 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:17.730758 29067 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.756311 29063 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.796236 27273 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:17.766244 28949 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:17.738838 28952 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:17.771780 29094 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.777786 27274 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:17.808748 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 167810us
I20260709 13:10:17.801921 28949 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.804939 29063 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.837441 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:17.850327 29022 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.811960 29102 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.897513 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:17.907374 27273 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:17.908330 29117 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:17.908408 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:17.911856 27273 raft_consensus.cc:2393] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:17.779323 26583 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:17.811527 29094 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:17.814244 28915 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.830245 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:17.921669 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1679) took 1164 ms. Trace:
I20260709 13:10:17.893412 28949 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:17.924119 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 688) took 1291 ms. Trace:
I20260709 13:10:17.940973 27277 rpcz_store.cc:276] 0709 13:10:16.632853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.632977 (+   124us) service_pool.cc:224] Handling call
0709 13:10:17.626218 (+993241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.655350 (+ 29132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.923922 (+268572us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54006f1150. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:17.924062 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2283508608}
I20260709 13:10:17.919402 28998 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:17.931669 26654 rpcz_store.cc:276] 0709 13:10:16.759275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.425530 (+666255us) service_pool.cc:224] Handling call
0709 13:10:17.425860 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.426067 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:17.783572 (+357505us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.921323 (+137751us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.921369 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:17.921411 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.921471 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.921605 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":379031,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":494528,"threads_started":2}
I20260709 13:10:17.894582 29104 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:17.948133 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:17.956162 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:17.899376 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 708) took 1946 ms. Trace:
I20260709 13:10:17.956789 26510 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:17.959666 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:17.960306 27277 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:17.920593 29015 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:17.922791 29000 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:17.922688 29056 raft_consensus.cc:697] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:17.965875 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:17.955838 29104 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.974835 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:17.910156 29022 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.946758 28915 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.912220 29102 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:17.987792 29117 raft_consensus.cc:3055] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:17.971024 29006 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:18.006639 28842 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:17.995301 29064 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:18.010219 29096 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:10:18.034003 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1678) took 1276 ms. Trace:
I20260709 13:10:18.034148 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 412) took 1179 ms. Trace:
I20260709 13:10:18.034451 26651 rpcz_store.cc:276] 0709 13:10:16.757248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.375404 (+618156us) service_pool.cc:224] Handling call
0709 13:10:17.390230 (+ 14826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.390596 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.390630 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.392065 (+  1435us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.595259 (+203194us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:17.595307 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.595397 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.033765 (+438368us) raft_consensus.cc:1685] finished
0709 13:10:18.033788 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.033936 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":872,"raft.queue_time_us":76,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5237,"thread_start_us":198165,"threads_started":1,"wal-append.queue_time_us":398693}
I20260709 13:10:18.034948 27271 rpcz_store.cc:276] 0709 13:10:16.854981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.643683 (+788702us) service_pool.cc:224] Handling call
0709 13:10:17.644087 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.900973 (+256886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.901016 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.901659 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.959994 (+ 58335us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:17.960033 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.960103 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.033819 (+ 73716us) raft_consensus.cc:1685] finished
0709 13:10:18.033851 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.034049 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27207,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"thread_start_us":314315,"threads_started":2,"wal-append.queue_time_us":128541}
I20260709 13:10:18.036983 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.011996 29067 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:17.986430 29104 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.040068 28915 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:18.014108 28952 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:17.960033 27274 rpcz_store.cc:276] 0709 13:10:15.952712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.960752 (+  8040us) service_pool.cc:224] Handling call
0709 13:10:17.738137 (+1777385us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b5800161a98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804eee 0000000000375939 00007f88318781e0 00007f88319410c4 00007f8831941131 00007f8831902fc0 00007f88318ed929 00007f88318ed3d2 00007f882ae64bd4
0709 13:10:17.747196 (+  9059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.815888 (+ 68692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.896383 (+ 80495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10108672}
I20260709 13:10:18.014008 29056 consensus_queue.cc:237] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.013875 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:18.043337 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:18.044220 26650 raft_consensus.cc:2393] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:18.045409 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.014933 29007 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:18.016031 29063 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:18.019059 29102 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:18.019903 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.063041 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.020503 29043 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.066838 29060 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:18.068339 29043 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:18.022743 29022 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:18.069690 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:17.977854 28977 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:18.070226 26504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 1898) took 1950 ms (client timeout 1759 ms). Trace:
I20260709 13:10:18.070377 26582 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
W20260709 13:10:18.070708 26504 rpcz_store.cc:269] 0709 13:10:16.119621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.166085 (+ 46464us) service_pool.cc:224] Handling call
0709 13:10:18.070050 (+1903965us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54002fc954. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:18.070160 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019111808}
I20260709 13:10:18.071972 26625 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:18.072098 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:18.072798 26504 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:18.029258 29093 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:18.046635 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:17.975819 29008 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:18.027089 29101 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:18.050637 29036 consensus_meta.cc:287] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
W20260709 13:10:18.055455 26506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 300) took 2567 ms (client timeout 2690 ms). Trace:
I20260709 13:10:18.056679 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.026846 29051 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.077489 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:18.081909 29066 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.087368 26657 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:18.087255 29051 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.064635 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:18.067063 26658 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:18.090090 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1686) took 2020 ms. Trace:
I20260709 13:10:18.090556 26658 rpcz_store.cc:276] 0709 13:10:16.070187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.150520 (+ 80333us) service_pool.cc:224] Handling call
0709 13:10:18.066514 (+1915994us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b5800024c98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f8831902fc0 00007f88318ed929 00007f88318ed3d2 00007f882ae64bd4
0709 13:10:18.066734 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.089787 (+ 23053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.090013 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6518016}
I20260709 13:10:18.091830 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.093088 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.079919 29085 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:18.076488 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1666) took 1956 ms. Trace:
I20260709 13:10:18.094108 29120 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:18.094199 26656 rpcz_store.cc:276] 0709 13:10:16.120255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.209219 (+ 88964us) service_pool.cc:224] Handling call
0709 13:10:16.280591 (+ 71372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.606895 (+326304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.076221 (+1469326us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400169c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:18.076421 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646845184}
I20260709 13:10:18.095176 29051 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:18.094830 29120 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.095932 26510 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:18.095791 29101 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.097002 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.075229 29106 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:18.098178 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.097716 29036 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:18.086530 26506 rpcz_store.cc:269] 0709 13:10:15.488232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.528469 (+ 40237us) service_pool.cc:224] Handling call
0709 13:10:18.055282 (+2526813us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001833d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:18.055391 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2517609856}
I20260709 13:10:18.133075 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.133891 26506 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:18.134578 28977 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.134845 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.135138 28977 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.136193 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:18.095504 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.097289 29120 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:18.102555 28949 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.086953 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 406) took 1233 ms. Trace:
I20260709 13:10:18.152917 27275 rpcz_store.cc:276] 0709 13:10:16.853300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.853483 (+   183us) service_pool.cc:224] Handling call
0709 13:10:17.167485 (+314002us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.168513 (+  1028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.086756 (+918243us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54005aafd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:18.086894 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711071488}
I20260709 13:10:18.074420 29003 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.086206 28943 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:18.083794 29084 log.cc:927] Time spent T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 1.111s	user 0.002s	sys 0.005s
I20260709 13:10:18.076862 29049 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.047683 26651 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
W20260709 13:10:18.091861 26473 connection.cc:256] RPC call timeout handler was delayed by -1.2450279800000317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260709 13:10:18.115195 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.121996 29101 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:18.074188 29063 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.122929 26510 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:18.074972 29074 raft_consensus.cc:2955] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:18.124289 29066 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:18.073495 26625 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:18.124547 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1905) took 1594 ms. Trace:
I20260709 13:10:18.125039 26658 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:18.125773 29008 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:18.127225 26476 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:18.127799 26650 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:18.130766 26657 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:18.131664 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.132073 29036 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:18.098344 29106 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:18.137022 29062 consensus_meta.cc:287] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.606s	user 0.005s	sys 0.005s
W20260709 13:10:18.059607 29090 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.989s	user 0.013s	sys 0.012s
I20260709 13:10:18.137737 27243 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:18.137332 28977 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:18.138741 28952 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.140373 29064 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:18.142916 26576 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:18.144027 28869 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:18.144224 26504 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:18.404243 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:18.145342 28893 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:18.149326 29108 log.cc:927] Time spent T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 13:10:18.151471 26506 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.152163 26656 raft_consensus.cc:2410] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:18.084841 29057 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:18.154760 29051 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:18.429988 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:18.185765 26548 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:18.048704 29117 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:18.269932 27278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 707) took 2317 ms (client timeout 3018 ms). Trace:
I20260709 13:10:18.251436 29110 consensus_queue.cc:1059] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.175s
I20260709 13:10:18.241607 29043 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:18.380716 29085 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:18.250455 29049 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:18.156343 29120 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:18.240094 26473 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:18.262370 27270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 710) took 2298 ms (client timeout 2142 ms). Trace:
I20260709 13:10:18.186812 28984 consensus_queue.cc:1059] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.196s
I20260709 13:10:18.248996 26655 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:18.308323 29050 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.272509 27269 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:18.258527 27272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 686) took 1626 ms. Trace:
I20260709 13:10:18.256536 29104 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.254778 29003 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:18.239266 29094 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:18.381444 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 243770us
W20260709 13:10:18.342566 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.274058 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:18.347599 26502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 304) took 1735 ms (client timeout 1674 ms). Trace:
I20260709 13:10:18.272240 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:18.388139 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 260963us
I20260709 13:10:18.257649 27241 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:10:18.191569 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.391479 29106 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:18.244903 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.259366 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1901) took 2139 ms. Trace:
I20260709 13:10:18.242417 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.261540 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1672) took 1850 ms. Trace:
I20260709 13:10:18.362298 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1896) took 2248 ms. Trace:
I20260709 13:10:18.401960 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:18.402964 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 329516us
I20260709 13:10:18.396878 26505 rpcz_store.cc:276] 0709 13:10:16.530099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.383897 (+853798us) service_pool.cc:224] Handling call
0709 13:10:17.384230 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.384660 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.384700 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.385163 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.640283 (+255120us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:17.640323 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.640386 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.124363 (+483977us) raft_consensus.cc:1685] finished
0709 13:10:18.124382 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.124494 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1560,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":235308,"threads_started":1,"wal-append.queue_time_us":727844}
I20260709 13:10:18.395682 27240 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:18.415163 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:18.417725 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.224289 29063 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.421890 29036 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:18.422585 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:18.392218 29022 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:18.393668 28976 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:18.426437 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:18.427239 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:18.158341 29010 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:18.157883 29000 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.300s
W20260709 13:10:18.628033 29056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.005s	sys 0.014s
W20260709 13:10:18.834442 29056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.008s	sys 0.014s
I20260709 13:10:18.458889 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:18.834244 29050 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.834614 29107 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:18.835805 29107 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.836274 29107 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:18.836333 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:18.836794 29036 raft_consensus.cc:697] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:18.837046 26510 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.837450 26503 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:18.837841 29036 consensus_queue.cc:237] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:18.602264 27277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.043s	sys 0.058s
W20260709 13:10:18.839107 27277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.045s	sys 0.072s
I20260709 13:10:18.838999 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.840196 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.840070 27277 raft_consensus.cc:2955] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:18.178467 28959 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.663s
W20260709 13:10:18.667089 28968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.506s	user 0.008s	sys 0.019s
I20260709 13:10:18.841970 28959 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:18.842470 28959 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:18.669309 29066 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.843683 29094 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:18.843350 29066 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.404016 29062 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.845067 28893 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:18.845260 26654 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:18.845463 28893 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.845831 29066 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:18.845909 28893 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:18.846071 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 606024us
I20260709 13:10:16.561285 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.452764 28977 raft_consensus.cc:3055] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:18.847422 29085 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.847592 28977 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:18.847954 29085 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:18.848644 28977 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.847111 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 553) took 1098 ms. Trace:
I20260709 13:10:18.850096 29062 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:18.850216 26652 rpcz_store.cc:276] 0709 13:10:16.411598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.675821 (+264223us) service_pool.cc:224] Handling call
0709 13:10:16.698710 (+ 22889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.905932 (+207222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.261251 (+1355319us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54002da854. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:18.261464 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417157376}
I20260709 13:10:18.851073 26501 rpcz_store.cc:276] 0709 13:10:16.120439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.577137 (+456698us) service_pool.cc:224] Handling call
0709 13:10:16.577510 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.748100 (+170590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.259076 (+1510976us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400359b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:18.259293 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288650496}
W20260709 13:10:18.847241 27278 rpcz_store.cc:269] 0709 13:10:15.952420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.952846 (+   426us) service_pool.cc:224] Handling call
0709 13:10:18.269624 (+2316778us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b5400681ad4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:18.269847 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652687744}
I20260709 13:10:18.854251 26654 rpcz_store.cc:276] 0709 13:10:17.749021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.951290 (+202269us) service_pool.cc:224] Handling call
0709 13:10:18.846914 (+895624us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54002db754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:18.847032 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017990400}
I20260709 13:10:18.855085 27275 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:18.847115 26473 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:18.855409 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.851900 29120 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:18.818158 28986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.444s	user 0.011s	sys 0.015s
I20260709 13:10:18.488094 26576 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:10:18.783079 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.844429 26659 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:18.862985 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1686) took 1802 ms. Trace:
I20260709 13:10:18.863560 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 563) took 1039 ms. Trace:
I20260709 13:10:18.253188 28949 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:18.849648 26507 rpcz_store.cc:276] 0709 13:10:16.114201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.554045 (+439844us) service_pool.cc:224] Handling call
0709 13:10:16.748852 (+194807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.751681 (+  2829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.751715 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.751764 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:16.751807 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.751875 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.362026 (+1610151us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400193f50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:18.362210 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447293824}
W20260709 13:10:18.852705 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 457151us
I20260709 13:10:18.856702 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:18.866550 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 680840us
I20260709 13:10:18.867969 26473 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:18.781586 29012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.242s	user 0.014s	sys 0.021s
I20260709 13:10:18.857180 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:18.837239 29050 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:18.431321 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:18.872545 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:18.672580 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2413) took 1702 ms. Trace:
W20260709 13:10:18.836367 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.819056 26402 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:18.874667 26504 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.832911 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.255239 28974 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:18.206777 29006 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:18.864044 26659 rpcz_store.cc:276] 0709 13:10:17.824276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.386411 (+562135us) service_pool.cc:224] Handling call
0709 13:10:18.863496 (+477085us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.631052 29052 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:18.842592 26651 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:18.887398 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.863502 26655 rpcz_store.cc:276] 0709 13:10:17.060396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.489461 (+429065us) service_pool.cc:224] Handling call
0709 13:10:17.568449 (+ 78988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.853023 (+1284574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.862750 (+  9727us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400102cd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:18.862919 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564537088}
W20260709 13:10:18.842013 28968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.681s	user 0.009s	sys 0.021s
I20260709 13:10:18.841503 27273 raft_consensus.cc:2393] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:18.838140 29043 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.856846 26506 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:18.865643 29056 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:18.902051 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:18.871942 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:18.873044 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 491) took 3344 ms. Trace:
W20260709 13:10:18.856201 26502 rpcz_store.cc:269] 0709 13:10:16.612526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.625922 (+ 13396us) service_pool.cc:224] Handling call
0709 13:10:18.347314 (+1721392us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b540027e7d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:18.347496 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645631744}
I20260709 13:10:18.871959 27243 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:18.902830 27276 raft_consensus.cc:2368] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7.
W20260709 13:10:18.861786 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 604223us
I20260709 13:10:18.903306 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:18.902817 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:18.903657 26576 rpcz_store.cc:276] 0709 13:10:15.522548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.524724 (+  2176us) service_pool.cc:224] Handling call
0709 13:10:15.541838 (+ 17114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.431948 (+890110us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b540037a120. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8a0dc0 00007f882c92b1c0 00007f882c92c231 00007f882c928d8f 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c
0709 13:10:18.142547 (+1710599us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b58005b04d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8850aa 00007f882c907447 00007f882c91ffe7 00007f882c9217de 00007f882c92bb49 00007f882c92c416 00007f882c928d8f 00007f882c92883e 00007f88318ed419 00007f882ae64bd4
0709 13:10:18.866870 (+724323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.867076 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3802786560}
I20260709 13:10:18.904870 27275 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:18.875504 26658 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.874092 29057 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:18.908670 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:18.909251 26585 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:10:18.865327 28986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.493s	user 0.011s	sys 0.016s
I20260709 13:10:18.875593 26508 rpcz_store.cc:276] 0709 13:10:16.970406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.651368 (+680962us) service_pool.cc:224] Handling call
0709 13:10:17.673966 (+ 22598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.741281 (+ 67315us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:17.855982 (+114701us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.990483 (+134501us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.993682 (+  3199us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.993751 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:17.993816 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.672343 (+678527us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b54000a7dd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:18.672382 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.672513 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22601,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":69958,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":150,"spinlock_wait_cycles":154042240,"thread_start_us":110727,"threads_started":1,"wal-append.queue_time_us":203958}
I20260709 13:10:18.912335 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:18.912719 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.878895 28977 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:18.879925 28970 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:18.892220 29094 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:18.886082 26510 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:18.919683 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:18.886368 26401 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34748 (request call id 319) took 13065 ms (client timeout 15000 ms). Trace:
I20260709 13:10:18.887954 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.254066 29058 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:18.891976 26654 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:18.894852 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:18.925097 26580 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:18.875327 26503 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.864892 29022 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.897218 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:18.867013 29045 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:18.837627 27270 rpcz_store.cc:269] 0709 13:10:15.964156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.306777 (+342621us) service_pool.cc:224] Handling call
0709 13:10:18.262100 (+1955323us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54006a4fd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:18.262284 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084433280}
I20260709 13:10:18.835248 26657 raft_consensus.cc:2376] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3. Re-sending same reply.
I20260709 13:10:18.898501 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 558) took 1096 ms. Trace:
I20260709 13:10:18.933202 26656 rpcz_store.cc:276] 0709 13:10:17.802053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.431256 (+629203us) service_pool.cc:224] Handling call
0709 13:10:18.898415 (+467159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.402947 28952 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.910967 29000 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:18.909533 28915 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:18.873530 29012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.337s	user 0.014s	sys 0.022s
I20260709 13:10:18.852596 27272 rpcz_store.cc:276] 0709 13:10:16.632282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.646407 (+ 14125us) service_pool.cc:224] Handling call
0709 13:10:16.670621 (+ 24214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.878799 (+208178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.258178 (+1379379us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400720e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:18.258447 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370729856}
I20260709 13:10:18.854156 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.877122 26402 catalog_manager.cc:5697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 3 to 4, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 1 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:18.960367 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:18.960672 26585 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:18.878080 26507 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:18.905895 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:18.961674 27278 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:18.923928 29077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.171s	user 0.016s	sys 0.022s
W20260709 13:10:18.962494 29077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.016s	sys 0.022s
I20260709 13:10:18.962819 29077 raft_consensus.cc:697] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:18.963974 29077 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.906049 27271 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:18.970695 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:18.971385 27271 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:18.972287 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:18.972940 27271 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.906554 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.910130 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:18.874883 29049 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.913375 26508 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:18.881110 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:18.484663 29051 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.881034 28976 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:18.911918 29057 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:18.914878 26578 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:18.969478 27278 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:18.878593 29123 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:18.886567 29102 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:18.864694 29010 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.843382 28959 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.918001 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.071899 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1690) took 1429 ms. Trace:
I20260709 13:10:18.922335 26581 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:19.072263 26655 rpcz_store.cc:276] 0709 13:10:17.642766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.901553 (+1258787us) service_pool.cc:224] Handling call
0709 13:10:19.071838 (+170285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.922286 26658 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:18.898839 29110 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.896981 26473 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:19.075542 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 178666us
I20260709 13:10:18.922094 26652 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:18.927623 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:19.077919 26580 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:18.928390 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:18.901777 29067 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.934156 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:18.992995 29104 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:19.080886 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:18.934742 26549 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.004s	sys 0.018s
I20260709 13:10:18.913288 28984 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:18.936091 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:19.115382 28984 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.116235 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:18.897758 28869 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:10:19.078135 29012 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:18.936446 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:19.120296 26577 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:18.912762 29056 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:18.942142 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:18.906847 29117 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:18.946527 28893 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.947085 29008 raft_consensus.cc:3055] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:18.942966 29074 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54880 (request call id 88) took 26092 ms (client timeout 29999 ms). Trace:
I20260709 13:10:18.948208 29085 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.927019 28970 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.912053 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:19.180306 29129 log.cc:927] Time spent T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:19.180215 27241 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:19.180745 29003 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.180936 27274 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:19.114538 29067 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.955226 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:18.956331 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:18.956945 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:19.186934 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:19.187465 26576 raft_consensus.cc:2393] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:19.187827 27276 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
W20260709 13:10:18.931875 28956 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.000s	sys 0.020s
I20260709 13:10:18.974062 26506 raft_consensus.cc:2410] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:18.960381 26505 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:18.996701 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:19.191505 26582 raft_consensus.cc:2410] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:18.899029 29006 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:18.916460 29095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.015s	sys 0.042s
I20260709 13:10:18.998899 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.195571 26657 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:19.176141 29063 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:18.994907 26402 catalog_manager.cc:5697] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.003252 26583 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:19.004228 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:18.921521 26401 rpcz_store.cc:269] 0709 13:10:05.810088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.856214 (+ 46126us) service_pool.cc:224] Handling call
0709 13:10:07.213417 (+1357203us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b540013f2a8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832b1b331 00007f8832b163fc 00007f88326e81b4 00007f88327e637e 00007f8830ca72a4 00007f8830ca7232 00007f8830ca7161 00007f8830ca70dc 00007f8830ca6392 00007f882ac6448c 00007f882ac638c6
0709 13:10:18.874832 (+11661415us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:15.022454 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:15.072413 (+ 49959us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:15.072450 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:10:15.072468 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:15.084066 (+ 11598us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:15.084120 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:15.084148 (+    28us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:10:15.085304 (+  1156us) tablet.cc:701] Row locks acquired
0709 13:10:15.085322 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:10:15.085456 (+   134us) write_op.cc:270] Start()
0709 13:10:15.085584 (+   128us) write_op.cc:276] Timestamp: P: 1783602615085412 usec, L: 0
0709 13:10:15.085609 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:10:15.086292 (+   683us) log.cc:844] Serialized 4817 byte log entry
0709 13:10:15.332685 (+246393us) op_driver.cc:464] REPLICATION: finished
0709 13:10:15.405624 (+ 72939us) write_op.cc:301] APPLY: starting
0709 13:10:15.405717 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:15.405954 (+   237us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:15.406083 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:15.580985 (+174902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:15.647461 (+ 66476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:10:15.654138 (+  6677us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b540013f454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92632a 00007f882c8abf14 00007f882c8abec3 00007f882c8abe38 00007f882c8abdf3 00007f882c8ab0dc 00007f882c8d4e16 00007f882c8bccbb 00007f882c8a739d 00007f882c8aad75
0709 13:10:15.679419 (+ 25281us) write_op.cc:312] APPLY: finished
0709 13:10:15.775134 (+ 95715us) log.cc:844] Serialized 89 byte log entry
0709 13:10:15.792833 (+ 17699us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:15.811333 (+ 18500us) write_op.cc:454] Released schema lock
0709 13:10:15.830098 (+ 18765us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:15.944404 (+114306us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:15.961069 (+ 16665us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4042489,"reported_tablets":18,"spinlock_wait_cycles":6954752,"child_traces":[["op",{"apply.queue_time_us":72661,"apply.run_cpu_time_us":11923,"apply.run_wall_time_us":504167,"num_ops":12,"prepare.queue_time_us":110740,"prepare.run_cpu_time_us":31687,"prepare.run_wall_time_us":147876,"raft.queue_time_us":106675,"raft.run_cpu_time_us":10464,"raft.run_wall_time_us":392419,"replication_time_us":246899,"spinlock_wait_cycles":113624320,"thread_start_us":187002,"threads_started":4,"wal-append.queue_time_us":64747,"wal-append.run_cpu_time_us":40357,"wal-append.run_wall_time_us":1632400}]]}
I20260709 13:10:19.204080 26654 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:19.204533 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1710) took 1066 ms. Trace:
I20260709 13:10:19.204730 26654 rpcz_store.cc:276] 0709 13:10:18.138306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.003957 (+865651us) service_pool.cc:224] Handling call
0709 13:10:19.204488 (+200531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.006022 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:19.186172 29117 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:18.974898 26650 consensus_meta.cc:287] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.589s	user 0.003s	sys 0.007s
W20260709 13:10:19.050951 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.195245 29095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.015s	sys 0.043s
W20260709 13:10:19.069583 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 212422us
I20260709 13:10:19.217173 26476 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:18.956056 28915 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.949805 29066 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:18.925398 26504 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:19.220041 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 1913) took 1164 ms. Trace:
I20260709 13:10:19.220459 26504 rpcz_store.cc:276] 0709 13:10:18.055849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.431073 (+375224us) service_pool.cc:224] Handling call
0709 13:10:19.219973 (+788900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.077905 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 555) took 1328 ms. Trace:
I20260709 13:10:19.005153 29102 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.109453 26651 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:19.085994 26549 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.004s	sys 0.018s
W20260709 13:10:19.226383 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 869528us
I20260709 13:10:19.108652 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:19.116328 28984 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.955458 29045 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.229853 29102 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:19.015025 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:19.230945 27272 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:19.231716 29011 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:10:19.072867 28976 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:18.901934 29052 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.232750 28976 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.233807 29052 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:19.121775 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 207439us
I20260709 13:10:19.234377 29064 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:19.234732 29056 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:19.121304 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 236849us
I20260709 13:10:19.001499 29049 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.124617 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:19.157131 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:19.241173 26655 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:19.120823 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 203339us
W20260709 13:10:19.158210 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 254959us
I20260709 13:10:19.202653 29043 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.125053 29012 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.234750 29064 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:19.249200 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1709) took 1122 ms. Trace:
I20260709 13:10:19.018244 29123 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.176775 29104 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.179505 29130 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:19.179869 28970 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:18.900094 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:19.182199 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:19.180447 27271 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:19.272063 26653 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:19.272441 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 90332.1us
I20260709 13:10:18.953931 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 720) took 1092 ms. Trace:
I20260709 13:10:19.273728 27277 rpcz_store.cc:276] 0709 13:10:17.861296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.974556 (+113260us) service_pool.cc:224] Handling call
0709 13:10:17.988672 (+ 14116us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:17.995582 (+  6910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.995615 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:18.047351 (+ 51736us) log.cc:844] Serialized 534 byte log entry
0709 13:10:18.839952 (+792601us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:18.867175 (+ 27223us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.880563 (+ 13388us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.889671 (+  9108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.890018 (+   347us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.953644 (+ 63626us) raft_consensus.cc:1685] finished
0709 13:10:18.953674 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.953859 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8798,"prepare.queue_time_us":10531,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":14731,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":29574,"thread_start_us":781868,"threads_started":1,"wal-append.queue_time_us":888519}
I20260709 13:10:19.083082 29110 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.275698 29063 consensus_queue.cc:1059] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:19.196089 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1695) took 1218 ms. Trace:
I20260709 13:10:18.887738 29050 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.276624 29063 raft_consensus.cc:3055] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:19.276880 29050 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.277223 29063 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:19.278282 29063 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.279345 29063 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:19.279392 29050 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:19.197849 27241 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:19.013141 26503 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:19.209671 29010 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:19.156093 29138 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:10:19.211215 26509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2400) took 3260 ms (client timeout 1847 ms). Trace:
I20260709 13:10:19.281101 28949 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.211341 29051 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:19.213076 29022 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:19.281677 28949 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.282284 29022 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:19.282677 29022 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.283043 29022 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:19.209529 29127 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:19.283823 26622 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:19.276460 26657 rpcz_store.cc:276] 0709 13:10:17.977532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.932836 (+955304us) service_pool.cc:224] Handling call
0709 13:10:19.196015 (+263179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.221402 26652 rpcz_store.cc:276] 0709 13:10:17.749506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.862519 (+1113013us) service_pool.cc:224] Handling call
0709 13:10:19.077826 (+215307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10624}
I20260709 13:10:19.286171 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.227805 26580 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:19.286935 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.285210 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:18.937394 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 689) took 2304 ms. Trace:
I20260709 13:10:19.233940 26650 raft_consensus.cc:2410] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:19.242520 26548 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:19.225221 26476 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:19.209779 26402 catalog_manager.cc:5697] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 5, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 5 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:19.288820 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 560) took 1477 ms. Trace:
I20260709 13:10:19.288987 29051 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:19.289219 26650 rpcz_store.cc:276] 0709 13:10:17.811528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.046368 (+234840us) service_pool.cc:224] Handling call
0709 13:10:19.288759 (+1242391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.290306 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.289913 26402 catalog_manager.cc:5697] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 4, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 4 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:19.290894 26650 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:19.291411 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1703) took 1166 ms. Trace:
I20260709 13:10:19.291761 26650 rpcz_store.cc:276] 0709 13:10:18.124945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.290029 (+1165084us) service_pool.cc:224] Handling call
0709 13:10:19.291359 (+  1330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.291643 26402 catalog_manager.cc:5697] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 3, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:19.292375 29010 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:19.292739 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:19.187151 29003 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.288540 27269 rpcz_store.cc:276] 0709 13:10:16.633139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.644933 (+ 11794us) service_pool.cc:224] Handling call
0709 13:10:18.272178 (+1627245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.862346 (+590168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.937152 (+ 74806us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400681ad0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:18.937314 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3620705152}
W20260709 13:10:19.281246 26509 rpcz_store.cc:269] 0709 13:10:15.951237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.060902 (+109665us) service_pool.cc:224] Handling call
0709 13:10:19.210915 (+3150013us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b5400183dd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:19.211121 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6634517760}
I20260709 13:10:19.293493 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 568) took 1035 ms. Trace:
I20260709 13:10:19.295089 26650 rpcz_store.cc:276] 0709 13:10:18.257718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.292491 (+1034773us) service_pool.cc:224] Handling call
0709 13:10:19.293441 (+   950us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.229914 29066 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.296259 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.296856 26650 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:19.297338 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1707) took 1171 ms. Trace:
I20260709 13:10:19.297786 26659 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:19.260247 29049 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:19.240208 29000 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.260960 29058 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.225965 28915 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:19.249645 29128 consensus_queue.cc:1059] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 13:10:19.172873 29074 rpcz_store.cc:269] 0709 13:09:52.849849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.849989 (+   140us) service_pool.cc:224] Handling call
0709 13:09:53.092415 (+242426us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400053320. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8a6520 00007f882c92fb42 00007f882c92e800 00007f882c9279fa 00007f88318ef4c9 00007f882ae6bc54 00007f882ae6bbe2 00007f882ae6bb11 00007f882ae6ba8c 00007f882ae6ad42
0709 13:09:53.961815 (+869400us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b2c000972c8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882b222a11 00007f882b231a0a 00007f882b231693 00007f882b231631 00007f882c9643f1 00007f882c89d9fe 00007f882c924749 00007f882c92576a 00007f882c92491b 00007f882c93003c 00007f882c92f6b3
0709 13:09:53.964138 (+  2323us) log.cc:844] Serialized 508 byte log entry
0709 13:09:54.257864 (+293726us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b18000bfce0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:18.941629 (+24683765us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20117,"raft.queue_time_us":34643,"raft.run_cpu_time_us":1824,"raft.run_wall_time_us":193801,"spinlock_wait_cycles":503656704,"thread_start_us":96947,"threads_started":1,"wal-append.queue_time_us":162684,"wal-append.run_cpu_time_us":2765,"wal-append.run_wall_time_us":1107924}
I20260709 13:10:19.251566 29012 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:19.353518 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 128332us
I20260709 13:10:19.264412 27240 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:19.265221 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:19.267841 26651 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:19.354336 26476 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:19.354827 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1692) took 1403 ms. Trace:
I20260709 13:10:19.229527 28869 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:19.270700 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.275255 29052 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:19.275967 26584 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.276571 29113 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:19.277120 29110 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.171216 29008 raft_consensus.cc:740] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:19.275599 28984 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.280727 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 313) took 1041 ms. Trace:
I20260709 13:10:19.361382 26503 rpcz_store.cc:276] 0709 13:10:18.238965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.841062 (+602097us) service_pool.cc:224] Handling call
0709 13:10:19.280656 (+439594us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:19.190459 28956 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.214s	user 0.000s	sys 0.021s
I20260709 13:10:19.362037 26654 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:19.288064 29062 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:19.118647 28959 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:19.251989 29141 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:19.295426 29003 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:19.249608 26658 rpcz_store.cc:276] 0709 13:10:18.126407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.401580 (+275173us) service_pool.cc:224] Handling call
0709 13:10:19.249037 (+847457us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b540039bcd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:19.249148 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52012928}
W20260709 13:10:19.363909 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.365710 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.366835 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:19.367364 26658 raft_consensus.cc:2376] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5. Re-sending same reply.
I20260709 13:10:19.368245 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.368853 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 566) took 1317 ms. Trace:
I20260709 13:10:19.369063 26658 rpcz_store.cc:276] 0709 13:10:18.051882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.368063 (+1316181us) service_pool.cc:224] Handling call
0709 13:10:19.368812 (+   749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.072110 29036 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:19.285194 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.370090 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 550) took 1621 ms. Trace:
I20260709 13:10:19.370419 26657 rpcz_store.cc:276] 0709 13:10:17.748277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.284847 (+1536570us) service_pool.cc:224] Handling call
0709 13:10:19.370035 (+ 85188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.297394 29066 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:19.311388 26653 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:19.379463 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 561) took 1565 ms. Trace:
I20260709 13:10:19.379922 26653 rpcz_store.cc:276] 0709 13:10:17.814128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.880844 (+1066716us) service_pool.cc:224] Handling call
0709 13:10:19.379378 (+498534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.306695 26580 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:19.315702 29022 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.297763 26650 rpcz_store.cc:276] 0709 13:10:18.126031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.295997 (+1169966us) service_pool.cc:224] Handling call
0709 13:10:19.297287 (+  1290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.344440 26655 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
W20260709 13:10:19.345590 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 147806us
I20260709 13:10:19.248258 29134 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.266358 29085 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.262743 29006 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:19.333220 29043 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:10:19.263612 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:19.396027 27275 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:19.355156 26651 rpcz_store.cc:276] 0709 13:10:17.951276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.003249 (+1051973us) service_pool.cc:224] Handling call
0709 13:10:19.354768 (+351519us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.333968 29104 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.397223 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.397980 26651 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:10:19.398411 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 564) took 1347 ms. Trace:
I20260709 13:10:19.398698 26651 rpcz_store.cc:276] 0709 13:10:18.051208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.396891 (+1345683us) service_pool.cc:224] Handling call
0709 13:10:19.398357 (+  1466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.362232 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:19.429041 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 66872.4us
I20260709 13:10:19.430351 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.348320 28952 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:19.362926 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 98592us
I20260709 13:10:19.431048 26657 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:19.431535 27240 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:19.371447 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:19.433633 26658 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:19.357510 29128 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:19.372910 28893 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.373083 29155 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:19.374284 29058 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:19.375204 29148 log.cc:927] Time spent T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:10:19.375844 29008 consensus_queue.cc:260] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.377349 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 310) took 1169 ms. Trace:
W20260709 13:10:19.355268 29136 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:10:19.383015 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1699) took 1290 ms. Trace:
I20260709 13:10:19.383366 27241 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:19.303328 29000 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.381893 26584 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
W20260709 13:10:19.550444 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 167138us
I20260709 13:10:19.246158 29140 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 13:10:19.392046 26577 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:19.347591 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 62410.8us
I20260709 13:10:19.395099 28984 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:19.416538 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.389700 29036 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.364457 29064 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.378183 29141 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.447139 28952 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:19.426661 26474 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:19.555330 28952 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:19.556399 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 129881us
I20260709 13:10:19.556731 29036 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:19.557369 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.362541 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 562) took 1545 ms. Trace:
I20260709 13:10:19.558290 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:19.559085 26504 raft_consensus.cc:2393] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:19.559195 27241 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:19.359014 26659 raft_consensus.cc:2410] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:10:19.558053 26654 rpcz_store.cc:276] 0709 13:10:17.817038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.242498 (+1425460us) service_pool.cc:224] Handling call
0709 13:10:19.362485 (+119987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.531585 26510 rpcz_store.cc:276] 0709 13:10:18.207638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.920495 (+712857us) service_pool.cc:224] Handling call
0709 13:10:18.920777 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.932710 (+ 11933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.932743 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.933232 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.948978 (+ 15746us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b48000030d8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8831852aa1 00007f8831849b37 00007f88318499ca 00007f883194126f 00007f8831940f37 00007f883195555c 00007f8831955508 00007f8831955488 00007f8831955443 00007f88319546ec 00007f883087ea96
0709 13:10:19.079795 (+130817us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:19.079859 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.079956 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.377084 (+297128us) raft_consensus.cc:1685] finished
0709 13:10:19.377106 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.377291 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3440,"raft.queue_time_us":21539,"raft.run_cpu_time_us":1966,"raft.run_wall_time_us":6500,"spinlock_wait_cycles":10724736,"thread_start_us":62787,"threads_started":1,"wal-append.queue_time_us":359706}
I20260709 13:10:19.549609 26655 rpcz_store.cc:276] 0709 13:10:18.092431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.118875 (+1026444us) service_pool.cc:224] Handling call
0709 13:10:19.382958 (+264083us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:19.561378 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.553622 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 311054us
I20260709 13:10:19.567314 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:19.568120 26506 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:19.568609 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:19.569164 26505 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.570637 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:19.563095 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:19.571343 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:19.574168 26651 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:19.571578 26652 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:19.576078 26655 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:19.576712 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1687) took 1937 ms. Trace:
I20260709 13:10:19.555395 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:19.578037 26510 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:19.579180 26549 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:19.586241 26509 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:19.507612 29149 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:19.577239 26655 rpcz_store.cc:276] 0709 13:10:17.639196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.575603 (+1936407us) service_pool.cc:224] Handling call
0709 13:10:19.575887 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.576490 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.576659 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.555236 29141 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.581238 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:19.585328 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.591884 26504 raft_consensus.cc:2410] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:19.549645 28977 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:19.594636 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:19.595914 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:19.549286 29043 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.601682 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:19.603895 26654 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:19.606922 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:19.576352 29085 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:19.607697 26510 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.558607 29137 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:19.585044 28976 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:19.624650 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:19.591351 29150 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.616231 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:19.585373 29058 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:19.616714 26651 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:19.639382 26651 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 3. Ops: []
I20260709 13:10:19.640558 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1688) took 1734 ms. Trace:
I20260709 13:10:19.641086 26651 rpcz_store.cc:276] 0709 13:10:17.905750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.638711 (+1732961us) service_pool.cc:224] Handling call
0709 13:10:19.639128 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.640211 (+  1083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.640480 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.643880 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:19.625152 29107 consensus_meta.cc:287] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.788s	user 0.004s	sys 0.006s
I20260709 13:10:19.646934 29107 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.648839 27278 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:19.652879 26509 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:19.587286 28915 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.608616 29162 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:19.623768 26505 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:19.580672 28893 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:19.580225 29155 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:19.585625 28984 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:19.608814 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 315) took 1369 ms. Trace:
I20260709 13:10:19.396629 29134 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.584416 28952 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.593209 29008 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:19.615720 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 549) took 1867 ms. Trace:
I20260709 13:10:19.630546 26504 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:19.638315 29058 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:19.655931 26654 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:10:19.632261 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 574d2707e806420dab53495563bd03aa with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:19.626814 29095 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:19.609488 29043 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.659891 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1689) took 1748 ms. Trace:
I20260709 13:10:19.717736 26651 rpcz_store.cc:276] 0709 13:10:17.911487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.643010 (+1731523us) service_pool.cc:224] Handling call
0709 13:10:19.658058 (+ 15048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.658556 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.658614 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.658687 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:19.658907 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.659663 (+   756us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.659814 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.718743 28915 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.680805 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:19.680593 26655 rpcz_store.cc:276] 0709 13:10:17.747975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.590622 (+1842647us) service_pool.cc:224] Handling call
0709 13:10:19.615228 (+ 24606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.615390 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.615416 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.615458 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:19.615492 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.615546 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.615648 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.722606 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:19.659163 29107 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.686573 29142 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:19.682421 26507 rpcz_store.cc:276] 0709 13:10:18.239495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.962377 (+722882us) service_pool.cc:224] Handling call
0709 13:10:18.962688 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.975716 (+ 13028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.975750 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.976263 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:10:19.153934 (+177671us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:19.561746 (+407812us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.586287 (+ 24541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.586368 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.608611 (+ 22243us) raft_consensus.cc:1685] finished
0709 13:10:19.608634 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.608758 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36872,"prepare.queue_time_us":446401,"raft.queue_time_us":62194,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":83808,"spinlock_wait_cycles":7085952,"thread_start_us":444329,"threads_started":2,"wal-append.queue_time_us":184578}
I20260709 13:10:19.633080 28956 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:19.620419 26510 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:19.642686 29150 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.761711 26655 raft_consensus.cc:1240] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:19.762562 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:19.763767 26510 raft_consensus.cc:2393] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:19.712824 28952 raft_consensus.cc:3055] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:19.688571 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 86985us
I20260709 13:10:19.768636 26549 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:19.624931 29137 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:19.692771 29095 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.686206 29155 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:19.702883 26393 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 307410us
I20260709 13:10:19.670413 29162 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.693992 26504 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
W20260709 13:10:19.710726 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 468099us
W20260709 13:10:19.711355 26659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1691) took 1769 ms (client timeout 2181 ms). Trace:
I20260709 13:10:19.652307 28970 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:19.781057 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:19.780854 26659 rpcz_store.cc:269] 0709 13:10:17.941653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.914269 (+972616us) service_pool.cc:224] Handling call
0709 13:10:19.709481 (+795212us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400108954. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:19.711291 (+  1810us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503302528}
I20260709 13:10:19.782462 26659 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:19.783107 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1694) took 1821 ms. Trace:
I20260709 13:10:19.783409 26659 rpcz_store.cc:276] 0709 13:10:17.962196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.781954 (+1819758us) service_pool.cc:224] Handling call
0709 13:10:19.782255 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.782862 (+   607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.783054 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.784505 26659 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:19.785025 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1701) took 1662 ms. Trace:
I20260709 13:10:19.692698 27273 raft_consensus.cc:2368] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6.
I20260709 13:10:19.658970 28977 raft_consensus.cc:697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:19.686924 29123 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:19.682353 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 80882.5us
I20260709 13:10:19.763836 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1693) took 1805 ms. Trace:
I20260709 13:10:19.755605 29142 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:19.789927 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 206469us
W20260709 13:10:19.790642 26622 connection.cc:256] RPC call timeout handler was delayed by -1.0531107560000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 13:10:19.791654 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:19.796562 26501 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:19.773407 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 554) took 2024 ms. Trace:
I20260709 13:10:19.692042 28984 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.787081 26655 rpcz_store.cc:276] 0709 13:10:17.958778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.721406 (+1762628us) service_pool.cc:224] Handling call
0709 13:10:19.761463 (+ 40057us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.762182 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.763776 (+  1594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.801196 26655 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:19.687536 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1687) took 1788 ms. Trace:
I20260709 13:10:19.801954 26622 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:19.802439 26654 rpcz_store.cc:276] 0709 13:10:17.899293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.629076 (+1729783us) service_pool.cc:224] Handling call
0709 13:10:19.653807 (+ 24731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.687228 (+ 33421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.687477 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.801318 26657 rpcz_store.cc:276] 0709 13:10:17.749275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.592094 (+1842819us) service_pool.cc:224] Handling call
0709 13:10:19.614563 (+ 22469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.614776 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:19.673094 (+ 58318us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.772919 (+ 99825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.772992 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:19.773083 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.773175 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.773333 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13612,"prepare.queue_time_us":56671,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":7357,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":11061,"thread_start_us":129253,"threads_started":2}
I20260709 13:10:19.801838 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1706) took 1676 ms. Trace:
I20260709 13:10:19.785317 26659 rpcz_store.cc:276] 0709 13:10:18.123027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.784099 (+1661072us) service_pool.cc:224] Handling call
0709 13:10:19.784355 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.784826 (+   471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.784978 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.782210 27243 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:19.779158 29106 consensus_meta.cc:287] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.928s	user 0.007s	sys 0.006s
I20260709 13:10:19.798857 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:19.689651 29153 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:10:19.760932 29022 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.804394 26659 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:19.803503 26655 rpcz_store.cc:276] 0709 13:10:18.125746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.800669 (+1674923us) service_pool.cc:224] Handling call
0709 13:10:19.801010 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.801615 (+   605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.801787 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.767817 28952 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:19.775188 29095 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:19.808073 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:19.779376 29010 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:19.777287 29104 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:19.770723 29137 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.812091 26549 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:19.800468 29142 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:19.811280 28915 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:19.814775 29057 consensus_meta.cc:287] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.809s	user 0.012s	sys 0.000s
I20260709 13:10:19.818212 28952 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.821410 29012 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.774364 29058 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.823180 29155 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.803467 28956 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:19.811926 29106 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.797959 29107 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:19.817652 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:19.837474 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:19.805552 29157 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:19.805889 29123 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:19.806488 29117 consensus_meta.cc:287] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 13:10:19.855794 26655 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:19.856243 26657 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.858666 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1690) took 1938 ms. Trace:
I20260709 13:10:19.814364 29000 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.910826 26504 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:19.903695 28952 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:19.826630 29170 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:19.854408 29074 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:19.919392 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 82006.9us
I20260709 13:10:19.858538 29057 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:19.897081 28915 raft_consensus.cc:697] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:19.921756 26656 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:19.930068 26503 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:19.825440 28977 consensus_queue.cc:237] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.906883 29134 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:10:19.936476 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1708) took 1810 ms. Trace:
I20260709 13:10:19.936895 26654 rpcz_store.cc:276] 0709 13:10:18.126251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.803247 (+1676996us) service_pool.cc:224] Handling call
0709 13:10:19.815392 (+ 12145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.815643 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:19.818577 (+  2934us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.936092 (+117515us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.936145 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:19.936200 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.936282 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.936395 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13312,"prepare.queue_time_us":18908,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"thread_start_us":103830,"threads_started":1}
I20260709 13:10:19.905419 28956 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:19.939721 29152 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:10:19.920724 29113 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:19.941188 29150 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.918433 29058 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:19.918879 29074 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:19.945855 29074 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:19.949898 29043 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:19.950009 28915 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:19.951624 29012 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:19.912647 29170 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:19.954559 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.959970 26657 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:19.920877 29000 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:19.932724 28959 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.002s
I20260709 13:10:19.961750 29000 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:19.971278 26507 raft_consensus.cc:1275] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:10:19.971985 26507 pending_rounds.cc:85] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 1
I20260709 13:10:19.972656 26507 pending_rounds.cc:107] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:10:19.973093 26507 raft_consensus.cc:2889] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:19.960000 29170 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:19.999493 29102 consensus_meta.cc:287] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.769s	user 0.009s	sys 0.001s
I20260709 13:10:19.999939 29102 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.002008 26579 raft_consensus.cc:2393] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:20.009514 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.015494 29170 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.030411 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1711) took 1869 ms. Trace:
I20260709 13:10:20.039373 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:20.042522 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:20.044631 29170 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.031169 26657 rpcz_store.cc:276] 0709 13:10:18.157418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.803452 (+1646034us) service_pool.cc:224] Handling call
0709 13:10:19.856122 (+ 52670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.025989 (+169867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.026405 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.047194 29063 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:20.048769 29063 raft_consensus.cc:697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:20.049861 29063 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.054041 26622 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:20.056885 29036 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:19.953302 29141 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.017956 28984 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:20.066962 29123 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:20.080874 29095 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.084113 29095 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.083784 29074 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.086077 29102 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:20.041085 29104 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:10:20.086794 29000 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.005532 29137 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.086747 29074 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.092060 29141 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:20.092219 26474 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 2.023s (SENT) [suppressed 10 similar messages]
I20260709 13:10:20.092350 29137 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.065536 29113 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:10:20.040344 29010 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:10:20.106057 29162 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:20.107894 29106 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:20.113147 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.113833 26510 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
W20260709 13:10:20.120540 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 332876us
W20260709 13:10:20.122309 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 310302us
I20260709 13:10:20.121640 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.128180 26548 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.134397 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:20.135568 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.143186 26548 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:20.148308 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:20.116519 29142 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.185096 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:20.186363 26505 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:20.187973 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:20.188789 26506 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
W20260709 13:10:20.189069 26548 connection.cc:256] RPC call timeout handler was delayed by -2.0175887710000779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 13:10:20.189464 26548 connection.cc:256] RPC call timeout handler was delayed by -1.9500887710000825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 13:10:20.162177 29008 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:20.161630 29162 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:20.194237 26548 connection.cc:256] RPC call timeout handler was delayed by -1.909588771000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 13:10:20.194622 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:20.169821 28984 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:20.170308 29102 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:20.161834 28952 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.170152 29182 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:20.197321 26509 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:20.199800 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:20.203361 26506 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:20.180577 29170 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:10:20.205014 28984 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:20.205729 29102 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:20.161692 29095 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:10:20.206420 29095 consensus_queue.cc:1243] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:20.206060 28984 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.206691 29102 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.197413 26507 raft_consensus.cc:2393] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:20.201601 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:20.208351 26505 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
W20260709 13:10:20.197816 26548 connection.cc:256] RPC call timeout handler was delayed by -1.8870887710000943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
I20260709 13:10:20.210413 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:20.192133 29123 raft_consensus.cc:697] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:20.212085 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 119894us
W20260709 13:10:20.211658 26548 connection.cc:256] RPC call timeout handler was delayed by -1.8168887709999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:10:20.215152 26548 connection.cc:256] RPC call timeout handler was delayed by -1.7601887710000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
I20260709 13:10:20.218027 26505 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:20.218786 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:20.219422 26507 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:20.202983 29162 raft_consensus.cc:697] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:20.202541 29182 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:20.219942 26506 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
W20260709 13:10:20.220506 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 88007.4us
W20260709 13:10:20.221081 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.207831 29008 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:20.215490 26548 connection.cc:256] RPC call timeout handler was delayed by -1.5189887710000676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 13:10:20.230192 26548 connection.cc:256] RPC call timeout handler was delayed by -1.470388770999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260709 13:10:20.230736 26548 connection.cc:256] RPC call timeout handler was delayed by -1.423588771000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22730000000000003s for a response
W20260709 13:10:20.231117 26548 connection.cc:256] RPC call timeout handler was delayed by -1.3029887710000594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24070000000000003s for a response
W20260709 13:10:20.231499 26548 connection.cc:256] RPC call timeout handler was delayed by -1.0393069950000609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:10:20.250484 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.251525 26577 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:20.255302 29120 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.257017 29085 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:20.208709 28952 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.234179 29182 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:20.258729 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1698) took 1356 ms. Trace:
I20260709 13:10:20.272363 26655 rpcz_store.cc:276] 0709 13:10:18.902321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.814911 (+912590us) service_pool.cc:224] Handling call
0709 13:10:19.841453 (+ 26542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.904701 (+ 63248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.258358 (+353657us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b54002c2c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:20.258649 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32385280}
I20260709 13:10:20.282990 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.229132 29036 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:20.284981 29180 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:20.287623 29180 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.288234 29180 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:20.284986 29123 consensus_queue.cc:237] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.287623 29162 consensus_queue.cc:237] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.292140 29008 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.293365 28968 raft_consensus.cc:3055] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:20.293850 28968 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:20.294759 28968 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:19.910072 26651 rpcz_store.cc:276] 0709 13:10:17.920754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.718787 (+1798033us) service_pool.cc:224] Handling call
0709 13:10:19.719089 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.719288 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:19.770390 (+ 51102us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.858279 (+ 87889us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.858334 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:19.858396 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.858472 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.858609 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29232,"prepare.queue_time_us":51396,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4394,"raft.queue_time_us":9233,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":1830,"thread_start_us":79091,"threads_started":1}
W20260709 13:10:20.301231 26656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1696) took 2301 ms (client timeout 2221 ms). Trace:
I20260709 13:10:20.320393 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.357023 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.320691 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:20.356838 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 72800.7us
W20260709 13:10:20.337491 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 900079us
I20260709 13:10:20.336196 26583 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:20.359054 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.352788 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:20.275736 29085 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.359426 27240 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:20.358449 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.360002 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.355270 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:20.353168 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1712) took 1124 ms. Trace:
W20260709 13:10:20.360142 26656 rpcz_store.cc:269] 0709 13:10:17.999816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.933903 (+934087us) service_pool.cc:224] Handling call
0709 13:10:20.300964 (+1367061us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54001423d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:20.301122 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937099008}
I20260709 13:10:20.352756 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:20.368698 26508 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:20.360041 26506 raft_consensus.cc:1813] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Handling vote request from an unknown peer af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:20.321135 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.345671 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.371642 26576 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:20.371030 26548 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.373344 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.369813 26506 raft_consensus.cc:2410] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:10:20.374863 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:20.367841 26504 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:20.360277 26580 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:20.367884 26659 rpcz_store.cc:276] 0709 13:10:19.228414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.815844 (+587430us) service_pool.cc:224] Handling call
0709 13:10:19.816117 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.836733 (+ 20616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.836762 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.837192 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.186155 (+348963us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:20.186183 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.186247 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.290587 (+104340us) raft_consensus.cc:1685] finished
0709 13:10:20.290605 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.353110 (+ 62505us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30089,"raft.queue_time_us":21259,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":58655,"thread_start_us":161198,"threads_started":1,"wal-append.queue_time_us":421252}
I20260709 13:10:20.376715 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.377535 26659 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:20.380967 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:20.381647 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.383117 26659 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.381976 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.384768 26580 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:20.382993 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:20.321142 29146 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.791s	user 0.000s	sys 0.001s
I20260709 13:10:20.386651 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.387795 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.391528 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.344521 28952 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.379676 29166 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:20.388144 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:20.401549 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.401607 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:20.402498 26654 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:20.402640 26508 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:20.319676 29036 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.408051 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.365815 29120 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:10:20.411123 26659 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:20.387059 29134 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:20.386590 29000 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:20.410717 26504 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:20.423578 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:20.423468 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.424556 26576 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:20.389814 29107 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:20.393278 29077 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:20.417651 27273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 420) took 1534 ms (client timeout 1613 ms). Trace:
W20260709 13:10:20.432107 27273 rpcz_store.cc:269] 0709 13:10:18.882789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.917878 (+ 35089us) service_pool.cc:224] Handling call
0709 13:10:20.417427 (+1499549us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400760f54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:20.417589 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154452864}
W20260709 13:10:20.421486 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.392891 28968 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.389101 29178 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:20.426831 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.436427 26508 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:20.430877 26504 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:20.411156 29022 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:20.392910 28956 consensus_queue.cc:1059] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:10:20.423040 29000 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.434438 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:20.436779 26659 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:20.454919 29000 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.455257 26576 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:20.455780 26504 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 13:10:20.421343 29142 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:20.465277 26659 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:20.439587 29178 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:20.465829 29137 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.466418 29137 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.466840 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.466599 29178 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.468320 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.469022 26659 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:20.469233 26506 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:20.469942 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:20.471071 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:20.471748 26578 raft_consensus.cc:2368] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5.
I20260709 13:10:20.468734 29137 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.472638 26578 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:20.474306 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 419) took 1591 ms. Trace:
W20260709 13:10:20.474565 26652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1688) took 2835 ms (client timeout 2734 ms). Trace:
I20260709 13:10:20.474707 27278 rpcz_store.cc:276] 0709 13:10:18.882581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.005722 (+123141us) service_pool.cc:224] Handling call
0709 13:10:20.474128 (+1468406us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54004cc554. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:20.474250 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015200000}
W20260709 13:10:20.474956 26652 rpcz_store.cc:269] 0709 13:10:17.639569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.285918 (+1646349us) service_pool.cc:224] Handling call
0709 13:10:20.474419 (+1188501us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400140854. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:20.474505 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654975232}
I20260709 13:10:20.476063 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.476338 27241 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:20.476605 26652 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.438313 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:20.446689 26476 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.477909 29120 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:20.478149 26476 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:20.478435 29120 raft_consensus.cc:697] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:20.479324 29012 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:20.479719 26653 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:20.479379 29120 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.480057 29012 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:20.480680 29012 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.446951 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.447827 28956 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:20.450152 26577 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:20.432055 29077 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.428766 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.483361 26474 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:20.498732 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.456354 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.504703 26576 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:20.478055 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2504) took 1523 ms. Trace:
I20260709 13:10:20.485538 26476 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:20.505856 26651 raft_consensus.cc:2393] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:20.487888 26659 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:20.491163 26549 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.440800 26508 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
W20260709 13:10:20.509280 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.505720 26584 rpcz_store.cc:276] 0709 13:10:18.954846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.954978 (+   132us) service_pool.cc:224] Handling call
0709 13:10:20.477900 (+1522922us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b54000d8754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:20.478002 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205141376}
W20260709 13:10:20.514887 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.510783 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.515602 26625 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.515972 26653 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:20.516918 26625 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:20.517210 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.518388 26653 raft_consensus.cc:2410] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:20.502640 29077 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:20.517993 26625 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.524211 29190 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:20.600361 29190 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.600970 29190 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.525633 26577 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:10:20.603873 26577 pending_rounds.cc:85] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 5
I20260709 13:10:20.518836 26652 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:20.604256 26577 pending_rounds.cc:107] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:10:20.604655 26577 raft_consensus.cc:2889] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:20.527649 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.492347 28956 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:20.507391 28968 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:20.510643 29022 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:20.513331 29141 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:20.524641 29063 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:10:20.495961 29137 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:10:20.526564 29142 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:20.529191 28904 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:20.558768 26549 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:20.552974 28952 consensus_queue.cc:1059] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:10:20.631539 28977 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:20.632436 28977 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.632893 28977 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:20.567698 29150 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:20.635412 29022 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.636615 29150 raft_consensus.cc:3055] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:20.619108 29011 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.637777 28869 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:20.638307 28869 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:20.637964 29011 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.639235 28869 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.640805 28869 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:20.569487 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.522382 29134 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:10:20.625846 29142 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.503031 29180 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.560269 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.648718 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2423) took 1081 ms. Trace:
W20260709 13:10:20.557729 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 156331us
I20260709 13:10:20.649226 26501 rpcz_store.cc:276] 0709 13:10:19.566906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.570410 (+  3504us) service_pool.cc:224] Handling call
0709 13:10:20.648450 (+1078040us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54000b4ad4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:20.648579 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416596224}
I20260709 13:10:20.513545 29182 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.582301 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:20.583878 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 98418.8us
I20260709 13:10:20.660094 26476 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:20.586565 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.607405 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.613087 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.605440 26653 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:20.616462 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.579692 29154 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.619877 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 101934us
I20260709 13:10:20.570972 29095 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:10:20.678580 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.679262 26651 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:20.627648 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 68967us
I20260709 13:10:20.629733 28968 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:20.629944 29137 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:20.644614 29142 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.631675 28952 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:20.550084 29110 consensus_queue.cc:1059] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:10:20.637423 29150 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:20.568835 29133 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 1.392s	user 0.008s	sys 0.000s
I20260709 13:10:20.722462 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:20.665652 29134 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.663154 26652 raft_consensus.cc:2410] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:10:20.662834 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:20.664366 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.724977 26584 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:20.725075 26582 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:20.726209 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.727270 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.727989 26582 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:20.668614 26585 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:20.668870 29155 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.669801 26625 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:20.730291 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 60600.1us
I20260709 13:10:20.676854 26654 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:20.680912 26549 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:20.732772 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 51946.8us
I20260709 13:10:20.641526 29011 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:20.733672 26549 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.734046 29011 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.734956 29011 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:20.735527 29011 raft_consensus.cc:697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:20.736564 29011 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.686360 29187 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:20.686939 29067 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.687234 29064 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:20.687497 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:20.688508 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:20.689628 27274 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:20.689957 29154 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.690958 29204 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:20.682368 29085 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.748101 29157 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:20.696614 29180 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:20.701997 26581 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:20.707257 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 223989us
I20260709 13:10:20.648059 29141 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:20.719825 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:20.721694 26651 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:20.642802 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.723179 27276 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:20.621754 29123 raft_consensus.cc:2764] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:20.686234 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:20.779054 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 92896.7us
I20260709 13:10:20.780365 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:20.740195 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:20.740355 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:20.741392 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.743512 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:20.682518 28968 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:20.751530 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:20.751858 26584 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:20.699450 29137 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:20.713585 28952 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:20.757843 26652 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:20.765298 29204 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:20.765697 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.800333 26654 raft_consensus.cc:2376] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7. Re-sending same reply.
I20260709 13:10:20.776810 27271 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:20.785075 26476 leader_election.cc:400] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5.
I20260709 13:10:20.801249 26476 leader_election.cc:403] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:10:20.801411 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.760371 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:20.786125 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:20.788746 27277 raft_consensus.cc:2368] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6.
I20260709 13:10:20.826426 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:20.789613 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 46155.7us
I20260709 13:10:20.827183 26654 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:20.793118 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.829012 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.829334 26476 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:20.754679 29155 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.742746 29134 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:20.804909 26503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2417) took 1250 ms (client timeout 1624 ms). Trace:
I20260709 13:10:20.806164 29012 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.810464 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:20.833151 26654 raft_consensus.cc:1275] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:20.811573 28986 consensus_queue.cc:1059] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:20.812255 29067 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5.
I20260709 13:10:20.814986 28904 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:20.815785 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:20.816461 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:20.817312 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:20.818403 29123 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:20.823673 29085 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:20.823107 28952 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.791466 27270 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:20.829550 26651 raft_consensus.cc:2376] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5. Re-sending same reply.
I20260709 13:10:20.695144 29182 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.792441 28968 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.786465 29120 raft_consensus.cc:2764] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:10:20.832867 26503 rpcz_store.cc:269] 0709 13:10:19.554349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.555150 (+   801us) service_pool.cc:224] Handling call
0709 13:10:20.804727 (+1249577us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54000b4fd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:20.804843 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809756928}
I20260709 13:10:20.795286 29137 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:20.855916 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.857374 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:20.793423 29157 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:20.867561 29134 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:20.868552 27273 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:20.869071 29154 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.804229 29204 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.869813 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:20.765496 29150 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:20.871361 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 98918.1us
W20260709 13:10:20.945827 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.871692 27276 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:20.878409 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:20.862047 27269 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:20.938992 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.952026 26652 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:20.937363 27277 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:20.941486 27271 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:20.890983 29067 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:20.856889 29216 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:10:20.908553 28949 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:20.877803 27272 raft_consensus.cc:2376] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6. Re-sending same reply.
I20260709 13:10:20.944061 28952 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:20.971688 27276 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:20.878005 27274 raft_consensus.cc:2376] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6. Re-sending same reply.
W20260709 13:10:20.977308 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 148042us
I20260709 13:10:20.989737 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:20.909406 28904 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:10:20.979948 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 152119us
I20260709 13:10:20.912798 29000 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:20.910540 29077 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:20.958154 29067 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.946880 29178 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:10:20.996101 26625 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:20.960335 29045 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:20.909291 29141 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.007727 26625 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:21.014843 29120 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:21.015626 29120 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:21.015973 29120 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:21.016368 29120 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:21.016506 29215 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:21.018569 29155 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.018915 29077 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.021778 26580 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 4. Ops: []
I20260709 13:10:21.021981 26578 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:10:21.022359 26578 pending_rounds.cc:85] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 7
I20260709 13:10:21.022609 26578 pending_rounds.cc:107] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:10:21.022903 26578 raft_consensus.cc:2889] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:21.024084 29219 log.cc:927] Time spent T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:10:21.024485 29166 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:21.024986 29166 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:21.026417 29190 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.028695 29190 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:21.002846 29067 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:21.030265 29142 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.006809 28977 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.034330 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.031448 26653 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:20.994752 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.034622 26577 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:21.014947 29213 log.cc:927] Time spent T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:10:21.021219 29000 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.051069 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:21.056285 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 105708us
I20260709 13:10:21.058665 26474 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:21.061435 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.068308 29226 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:21.093335 27270 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:21.113847 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 123922us
I20260709 13:10:21.114578 26474 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:21.108373 29012 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:21.109359 29142 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:21.123803 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:21.124454 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.125849 29049 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:21.141108 29049 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:21.037957 29123 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:21.131788 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:21.161741 26651 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:21.122810 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:21.115792 29226 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:21.141968 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 86096.6us
I20260709 13:10:21.119105 29157 raft_consensus.cc:697] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:21.123373 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.166219 29049 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.167627 29123 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.126304 29166 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.239841 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:21.168151 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:21.248378 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:21.249691 26658 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:21.248489 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 134030us
I20260709 13:10:21.250878 26658 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:10:21.251227 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.252261 26658 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:21.254599 27272 raft_consensus.cc:2393] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:21.255317 26658 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:21.256628 29049 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:21.258181 26658 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:21.263902 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:21.264810 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2440) took 1028 ms. Trace:
I20260709 13:10:21.265666 27270 raft_consensus.cc:2393] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:21.267064 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.268090 27270 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:21.269696 29178 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.269977 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:21.270479 29178 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.271183 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:21.271828 27269 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:21.280830 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 273158us
I20260709 13:10:21.269132 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.283077 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:21.283793 26583 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:21.283986 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:21.284998 27270 raft_consensus.cc:2393] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:21.265120 26505 rpcz_store.cc:276] 0709 13:10:20.236874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.242882 (+  6008us) service_pool.cc:224] Handling call
0709 13:10:21.263734 (+1020852us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5800010598. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:10:21.264754 (+  1020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50109184}
I20260709 13:10:21.286661 26625 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:21.290279 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 172713us
I20260709 13:10:21.293275 26625 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:21.201772 29216 consensus_queue.cc:1243] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:21.142756 28977 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.298484 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:21.289470 28869 consensus_meta.cc:287] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.003s
I20260709 13:10:21.302862 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.304054 26583 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:21.307677 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:21.301045 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:21.320152 26651 raft_consensus.cc:2376] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6. Re-sending same reply.
I20260709 13:10:21.320302 26584 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:21.321038 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:21.321918 26651 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:21.255780 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.311396 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:21.329447 26658 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:21.321103 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:21.202201 28949 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:21.322937 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 72037.7us
I20260709 13:10:21.324321 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:21.324638 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:21.331068 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:21.325852 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:21.327641 27243 connection.cc:256] RPC call timeout handler was delayed by -1.0244227570000248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 13:10:21.327952 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:21.331890 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:21.332501 26506 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:21.332747 26583 raft_consensus.cc:2393] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:21.331212 26503 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:10:21.325352 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:21.331921 26504 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:21.341053 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:21.318647 29012 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:10:21.314258 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.310875 29106 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:21.374437 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:21.358906 26583 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:21.383374 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:21.314834 29063 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:21.502017 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.384886 26585 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:21.411448 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:21.521374 26508 raft_consensus.cc:2376] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7. Re-sending same reply.
I20260709 13:10:21.524111 26509 raft_consensus.cc:2376] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5. Re-sending same reply.
I20260709 13:10:21.524803 26657 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:21.310038 29232 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:21.530102 26625 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:21.531308 29237 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.375662 27272 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:21.335417 28869 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:21.449659 28968 consensus_meta.cc:287] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
W20260709 13:10:21.577891 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.579134 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 49122.8us
I20260709 13:10:21.449244 29137 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.446925 29229 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.610078 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:21.610786 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1720) took 1244 ms. Trace:
I20260709 13:10:21.610594 29229 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.611125 26656 rpcz_store.cc:276] 0709 13:10:20.366877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.609852 (+1242975us) service_pool.cc:224] Handling call
0709 13:10:21.610730 (+   878us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.611721 29137 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.612805 29229 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:21.388190 29226 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.447400 29123 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.529453 29063 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:21.614315 29063 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:21.586279 29106 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:21.615988 29106 raft_consensus.cc:697] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:21.374922 29243 consensus_queue.cc:1059] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.211s
I20260709 13:10:21.375958 29178 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:21.344213 29236 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.263s
W20260709 13:10:21.605638 28952 consensus_meta.cc:287] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.614s	user 0.001s	sys 0.011s
W20260709 13:10:21.606227 29204 consensus_meta.cc:287] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.000s
I20260709 13:10:21.608193 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1669) took 1287 ms. Trace:
I20260709 13:10:21.626959 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:21.627169 26657 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:21.627259 26581 rpcz_store.cc:276] 0709 13:10:20.320291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.320424 (+   133us) service_pool.cc:224] Handling call
0709 13:10:21.608006 (+1287582us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400021a54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:21.608138 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789267840}
I20260709 13:10:21.627866 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1722) took 1260 ms. Trace:
I20260709 13:10:21.628274 26657 rpcz_store.cc:276] 0709 13:10:20.367546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.383064 (+1015518us) service_pool.cc:224] Handling call
0709 13:10:21.627817 (+244753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.609309 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:21.609784 27269 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:21.613957 29216 consensus_queue.cc:1175] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "af1b5d6d444447b7a580afb4aff33320" responder_term: 5 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:21.649330 26585 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:21.616880 29106 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:21.620339 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 329335us
I20260709 13:10:21.655565 26476 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:21.601907 26474 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:21.374493 28949 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.629336 26581 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:10:21.591912 29237 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.667208 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:21.667912 26506 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:21.447207 29157 consensus_queue.cc:237] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.652375 29202 raft_consensus.cc:3055] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:21.652696 29251 raft_consensus.cc:3055] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:21.599469 28968 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.655150 29166 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.634536 29094 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.624723 27270 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:21.662698 26584 pending_rounds.cc:85] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 2
I20260709 13:10:21.685282 26584 pending_rounds.cc:107] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:10:21.661952 29137 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:21.661805 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 59971.6us
I20260709 13:10:21.614008 29123 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.678434 26506 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:21.678690 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2517) took 1106 ms. Trace:
I20260709 13:10:21.679672 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1681) took 1236 ms. Trace:
I20260709 13:10:21.680739 26501 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:21.682343 26652 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:21.696939 26578 rpcz_store.cc:276] 0709 13:10:20.442983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.473429 (+ 30446us) service_pool.cc:224] Handling call
0709 13:10:20.489104 (+ 15675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.023365 (+534261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.679427 (+656062us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54000ef6d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:21.679590 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1224687744}
I20260709 13:10:21.675909 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:21.699283 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.659448 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:21.685632 26584 raft_consensus.cc:2889] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:21.675123 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:21.664203 29243 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:21.671689 29238 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.695894 26577 rpcz_store.cc:276] 0709 13:10:20.572230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.605774 (+ 33544us) service_pool.cc:224] Handling call
0709 13:10:21.678481 (+1072707us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54002ef254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:21.678629 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858160384}
I20260709 13:10:21.673743 29202 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:21.675166 29251 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:21.636086 29204 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:21.717293 26579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2509) took 2758 ms (client timeout 2999 ms). Trace:
W20260709 13:10:21.717944 26579 rpcz_store.cc:269] 0709 13:10:18.958713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.115959 (+157246us) service_pool.cc:224] Handling call
0709 13:10:21.717030 (+2601071us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54003d1154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:21.717211 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035046784}
I20260709 13:10:21.708953 29150 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:21.708804 29252 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:21.695235 29120 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.678s	user 0.006s	sys 0.006s
I20260709 13:10:21.689019 29094 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.708600 29236 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:10:21.720037 29238 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.738042 29242 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:10:21.754468 29120 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.762395 29251 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.771852 29238 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:21.772043 29251 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:21.752322 29252 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.777334 29237 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.757917 29202 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.782232 29252 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:21.816118 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.815451 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:21.749720 28869 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:21.837963 28869 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.848449 28968 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.848433 28949 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.852309 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:21.853796 26657 raft_consensus.cc:2410] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:21.856052 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:21.857386 26507 raft_consensus.cc:2393] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:21.857971 26507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2438) took 1631 ms (client timeout 1821 ms). Trace:
W20260709 13:10:21.858500 26507 rpcz_store.cc:269] 0709 13:10:20.226362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.226800 (+   438us) service_pool.cc:224] Handling call
0709 13:10:21.855596 (+1628796us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b5800010598. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:10:21.857823 (+  2227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7539968}
I20260709 13:10:21.866266 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:21.868141 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1725) took 1378 ms. Trace:
I20260709 13:10:21.875528 26653 rpcz_store.cc:276] 0709 13:10:20.490020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.679887 (+189867us) service_pool.cc:224] Handling call
0709 13:10:20.680232 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.035670 (+355438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.867418 (+831748us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54002dad54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:21.867902 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806916992}
I20260709 13:10:21.874745 27241 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:21.883983 27270 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:21.886845 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.890393 28949 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:21.891268 28949 raft_consensus.cc:697] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:21.896256 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:21.898113 29077 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.899094 29077 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.900374 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.901616 29058 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.902727 29058 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:21.903355 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.904500 27275 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:21.905772 29077 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.906726 29058 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.772122 29120 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:21.909361 29120 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:21.903750 29094 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.907474 29077 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.911834 29077 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.913733 29123 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:21.914680 29077 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:21.915165 28949 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.935127 26508 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:21.921689 27241 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:21.927522 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:21.938735 27269 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:21.940287 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.929920 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:21.931421 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.901504 27273 raft_consensus.cc:2368] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:21.932307 27274 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:21.933185 27275 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:21.933781 27271 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:21.870884 26622 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:21.941232 27269 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:21.973443 27272 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:21.974676 29204 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:21.975412 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.975956 29251 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:21.976926 27270 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:21.973436 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:21.989717 29077 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:21.990302 29077 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.990744 29077 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:21.990936 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 120490us
I20260709 13:10:21.994524 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:21.994820 26506 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:21.995572 26509 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:21.996484 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:21.996729 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:21.966701 29123 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.999254 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:22.002048 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.002151 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:22.003341 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:22.001446 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.019877 26501 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:22.022027 29238 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:22.019692 27243 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.023240 29238 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.024262 26506 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:22.024150 29238 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.025987 26506 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:22.025782 29123 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.026605 29202 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.016177 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:21.977144 29251 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:21.997599 29204 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.028573 28956 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.031493 26659 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:22.034044 26509 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:10:22.040794 29067 consensus_meta.cc:287] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.010s	user 0.005s	sys 0.017s
I20260709 13:10:22.043812 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1672) took 1645 ms. Trace:
I20260709 13:10:22.044498 26582 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:22.044593 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:22.045120 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:22.045957 26504 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.062206 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:22.063242 27276 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:22.065383 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:22.066569 26651 raft_consensus.cc:2410] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:22.068112 29141 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:22.068962 29141 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.050384 26580 rpcz_store.cc:276] 0709 13:10:20.398619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.398867 (+   248us) service_pool.cc:224] Handling call
0709 13:10:20.399297 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.022224 (+622927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.043301 (+1021077us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b540032d7d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:22.043616 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431150464}
I20260709 13:10:22.070410 26509 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:22.071354 29141 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:22.075579 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.076664 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:22.077417 29123 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:22.077966 29166 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:22.078593 29166 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:22.079176 29214 log.cc:927] Time spent T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.087s	user 0.004s	sys 0.000s
I20260709 13:10:22.080505 29166 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.081465 29204 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:22.082739 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 89511.8us
I20260709 13:10:22.083367 29238 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:22.084159 29204 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:22.086378 29244 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.504s	user 0.002s	sys 0.000s
I20260709 13:10:22.088044 27241 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.089221 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:22.089838 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.090519 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:22.086426 27271 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:22.091711 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:22.092252 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:22.092263 29216 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:22.092716 26583 raft_consensus.cc:2410] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:22.093123 29251 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:22.094439 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:22.097014 29247 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.498s	user 0.001s	sys 0.000s
W20260709 13:10:22.097990 29259 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.004s
I20260709 13:10:22.098148 26652 raft_consensus.cc:2410] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:10:22.077446 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 66689.3us
I20260709 13:10:22.115034 27271 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:22.117543 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:22.111451 26656 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:22.117062 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:22.141621 27275 raft_consensus.cc:2410] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:10:22.133800 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 66227.7us
I20260709 13:10:22.127087 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2522) took 1552 ms. Trace:
I20260709 13:10:22.109761 26509 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:22.133960 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:22.118925 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:22.109514 26548 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:22.112612 29226 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.151299 27277 raft_consensus.cc:1813] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Handling vote request from an unknown peer ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.152446 27277 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:10:22.152522 26502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2439) took 1924 ms (client timeout 1763 ms). Trace:
I20260709 13:10:22.154124 26658 raft_consensus.cc:2410] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:22.144124 26582 rpcz_store.cc:276] 0709 13:10:20.574376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.731202 (+156826us) service_pool.cc:224] Handling call
0709 13:10:22.044065 (+1312863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.056216 (+ 12151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.126823 (+ 70607us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540032d7d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:22.127014 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3018553600}
I20260709 13:10:22.109406 29178 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.153041 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 443) took 1282 ms. Trace:
I20260709 13:10:22.120471 27270 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:22.171795 28869 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:22.172843 26579 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:22.174268 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:22.174436 26501 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:22.102056 29067 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:22.153117 26502 rpcz_store.cc:269] 0709 13:10:20.228084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.228693 (+   609us) service_pool.cc:224] Handling call
0709 13:10:21.814623 (+1585930us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b5800010598. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:10:22.152228 (+337605us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400359b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:22.152428 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467543680}
I20260709 13:10:22.164120 26659 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:22.152956 26473 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:22.174510 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 155369us
I20260709 13:10:22.183017 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:22.188601 26583 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:22.225417 26504 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:22.193245 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:22.166028 27277 rpcz_store.cc:276] 0709 13:10:20.870754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.133419 (+1262665us) service_pool.cc:224] Handling call
0709 13:10:22.152960 (+ 19541us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:22.183640 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 95793.9us
I20260709 13:10:22.173032 29077 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:22.232611 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 123416us
I20260709 13:10:22.234838 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.115563 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:22.235752 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:22.148775 28949 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:22.237203 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.128193 28956 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:22.181752 26549 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:22.177465 29063 consensus_meta.cc:287] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.562s	user 0.014s	sys 0.007s
I20260709 13:10:22.239456 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.234522 26506 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:22.192553 29246 log.cc:927] Time spent T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.521s	user 0.001s	sys 0.000s
I20260709 13:10:22.255136 26656 raft_consensus.cc:2410] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:22.184957 28952 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.256340 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:22.254238 26651 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:22.261278 26504 raft_consensus.cc:2376] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4. Re-sending same reply.
I20260709 13:10:22.265254 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:22.268499 27276 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:22.269920 26502 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:22.271400 26502 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:22.272734 26502 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:22.274521 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 121693us
I20260709 13:10:22.274796 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:22.275643 26504 raft_consensus.cc:2393] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:22.276408 29255 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:22.276682 29095 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:22.277247 29095 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:22.277706 29095 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.248456 27274 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:22.281690 29141 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:22.283167 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.298607 26658 raft_consensus.cc:2376] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6. Re-sending same reply.
I20260709 13:10:22.303018 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:22.307013 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 57585.5us
I20260709 13:10:22.250939 29178 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.313714 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:22.323520 26473 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:22.325320 26502 raft_consensus.cc:2393] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:22.319471 26509 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:22.329869 26501 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:10:22.337777 29269 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:10:22.340481 29233 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.341461 29233 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.350483 29067 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:22.354379 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 59691.3us
I20260709 13:10:22.355507 26473 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.358271 29216 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:22.355623 29178 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:22.359879 29178 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:22.367100 29077 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:22.313516 28952 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.369931 28952 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:22.373248 29067 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:22.375121 26473 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:22.265148 29063 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.330371 26501 pending_rounds.cc:85] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 3
I20260709 13:10:22.393157 26501 pending_rounds.cc:107] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:10:22.398912 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.402549 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.403575 26504 raft_consensus.cc:2410] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:22.404644 26402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34738 (request call id 296) took 7793 ms. Trace:
I20260709 13:10:22.406380 29255 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:22.406793 29255 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.407126 29255 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:22.407385 26502 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
W20260709 13:10:22.417006 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 89935.9us
I20260709 13:10:22.427645 26507 raft_consensus.cc:2410] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:22.401891 26501 raft_consensus.cc:2889] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:22.394480 29233 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:22.400413 29137 consensus_meta.cc:287] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.012s
I20260709 13:10:22.449663 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:22.464859 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 89882.3us
I20260709 13:10:22.472085 26504 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:22.464962 29137 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:22.487156 27243 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.459285 28952 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.498411 29077 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:22.490525 29008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.012s	sys 0.061s
W20260709 13:10:22.501757 27240 leader_election.cc:336] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.609s (SENT)
I20260709 13:10:22.508380 27240 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:22.502425 29008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.012s	sys 0.061s
W20260709 13:10:22.507987 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 253134us
I20260709 13:10:22.510412 26473 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.516037 26506 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:22.405237 26402 rpcz_store.cc:276] 0709 13:10:14.610631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.613480 (+  2849us) service_pool.cc:224] Handling call
0709 13:10:22.404264 (+7790784us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:19.752006 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:19.928130 (+176124us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:19.929336 (+  1206us) write_op.cc:435] Acquired schema lock
0709 13:10:19.935288 (+  5952us) tablet.cc:662] Decoding operations
0709 13:10:20.229697 (+294409us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:20.241773 (+ 12076us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:20.244179 (+  2406us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:10:20.253342 (+  9163us) tablet.cc:701] Row locks acquired
0709 13:10:20.253363 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:10:20.253540 (+   177us) write_op.cc:270] Start()
0709 13:10:20.253703 (+   163us) write_op.cc:276] Timestamp: P: 1783602620253488 usec, L: 0
0709 13:10:20.253723 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:10:20.254393 (+   670us) log.cc:844] Serialized 2485 byte log entry
0709 13:10:20.698494 (+444101us) op_driver.cc:464] REPLICATION: finished
0709 13:10:20.819105 (+120611us) write_op.cc:301] APPLY: starting
0709 13:10:20.819235 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:20.819486 (+   251us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:20.819635 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:20.820929 (+  1294us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:20.821491 (+   562us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:10:20.828432 (+  6941us) write_op.cc:312] APPLY: finished
0709 13:10:20.876959 (+ 48527us) log.cc:844] Serialized 53 byte log entry
0709 13:10:20.934998 (+ 58039us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:20.945204 (+ 10206us) write_op.cc:454] Released schema lock
0709 13:10:20.950663 (+  5459us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:20.993848 (+ 43185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:20.996619 (+  2771us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19040,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":120155,"apply.run_cpu_time_us":4259,"apply.run_wall_time_us":158732,"num_ops":6,"prepare.queue_time_us":345223,"prepare.run_cpu_time_us":18761,"prepare.run_wall_time_us":712196,"raft.queue_time_us":159987,"raft.run_cpu_time_us":22903,"raft.run_wall_time_us":73142,"replication_time_us":444593,"thread_start_us":591550,"threads_started":4,"wal-append.queue_time_us":258412,"wal-append.run_cpu_time_us":13013,"wal-append.run_wall_time_us":1466797}]]}
I20260709 13:10:22.517052 26505 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
W20260709 13:10:22.513624 29187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.679s	user 0.009s	sys 0.002s
W20260709 13:10:22.520584 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 52907.4us
I20260709 13:10:22.518450 26505 pending_rounds.cc:85] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 4
I20260709 13:10:22.525101 27241 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:22.527473 26653 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:22.523061 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:22.528051 26505 pending_rounds.cc:107] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:10:22.528530 26505 raft_consensus.cc:2889] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:22.529300 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:22.518556 29063 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:22.532378 26510 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:10:22.522568 29187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.759s	user 0.010s	sys 0.003s
I20260709 13:10:22.522028 29141 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:22.520037 29137 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:22.536862 26503 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:22.517652 29095 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.538172 26658 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:22.538486 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 356930us
I20260709 13:10:22.538357 29157 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.541401 29077 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:22.541215 29157 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.541599 29202 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:22.542097 29077 raft_consensus.cc:697] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:22.523862 28952 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:22.547223 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.546007 28949 consensus_queue.cc:1059] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:10:22.547966 29272 log.cc:927] Time spent T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:10:22.548391 29238 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.548720 28949 raft_consensus.cc:3055] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:22.552902 26580 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:22.552860 29166 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:22.554358 29166 raft_consensus.cc:697] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:22.549242 28949 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:22.543875 29150 consensus_meta.cc:287] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.009s
I20260709 13:10:22.559842 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:22.554967 26549 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:22.549723 29227 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:10:22.558037 29157 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:22.549005 29238 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.562491 29110 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.563159 29110 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:22.558501 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 157846us
W20260709 13:10:22.558909 29271 log.cc:927] Time spent T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:10:22.558468 28949 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.571436 28949 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.562002 29227 consensus_queue.cc:1243] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:22.576745 26650 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:22.577107 26650 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:22.579595 26650 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.581625 26650 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.543155 29077 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.586971 29095 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:22.587869 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 56813.9us
I20260709 13:10:22.588915 27243 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.589847 29141 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:22.591464 27243 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:22.592294 29141 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:22.592760 29141 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.593240 29141 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:22.597182 26576 raft_consensus.cc:2410] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:22.599033 27243 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:22.566321 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 266199us
I20260709 13:10:22.567241 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 578) took 1923 ms. Trace:
I20260709 13:10:22.607012 29264 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:22.569000 27240 leader_election.cc:336] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.674s (SENT)
I20260709 13:10:22.557174 26548 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:22.607072 29117 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:22.570504 28952 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:22.610636 26658 raft_consensus.cc:2410] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:22.611446 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:22.616950 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 72016.8us
I20260709 13:10:22.619812 26659 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:22.621208 29264 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:22.621414 29110 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:22.618144 29227 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:10:22.611575 29117 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.623943 28956 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:22.626400 29117 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.606624 26654 rpcz_store.cc:276] 0709 13:10:20.643557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.834100 (+190543us) service_pool.cc:224] Handling call
0709 13:10:20.834400 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.874129 (+ 39729us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:21.189136 (+315007us) log.cc:844] Serialized 14 byte log entry
0709 13:10:21.331455 (+142319us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.342049 (+ 10594us) log.cc:844] Serialized 26 byte log entry
0709 13:10:21.342273 (+   224us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:21.342324 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.342425 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.096010 (+753585us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:22.563172 (+467162us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b24001f8098. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f88296c29c4 00007f88296c0acb 00007f882987bdc9 00007f882987ba55 00007f882987afb0 00007f882c4f1488 00007f882c4f1be8 00007f882c4c9398 00007f882c4c476a 00007f882c4c3bb6
0709 13:10:22.564718 (+  1546us) raft_consensus.cc:1685] finished
0709 13:10:22.564736 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.567070 (+  2334us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":117857,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":155055,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":115835,"spinlock_wait_cycles":64738816,"thread_start_us":355683,"threads_started":3,"wal-append.queue_time_us":267525}
I20260709 13:10:22.631547 26548 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:10:22.634442 26508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.081s	sys 0.069s
W20260709 13:10:22.635041 26508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.081s	sys 0.069s
I20260709 13:10:22.634701 29227 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:22.635895 29216 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:22.636735 29095 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:22.637426 29095 raft_consensus.cc:697] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:22.637706 29216 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:22.638236 29216 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.638564 29095 consensus_queue.cc:237] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.643200 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:22.644469 29178 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:22.644629 29150 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:22.645067 29178 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:22.645592 29178 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.645861 29150 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:22.646364 29150 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.646785 29150 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:22.647509 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:22.647715 29276 raft_consensus.cc:3055] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:22.649046 29276 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:22.649000 29008 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:22.649806 29110 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:22.650247 29276 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.651794 29276 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.650224 29277 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:10:22.655382 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.656316 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.657792 28904 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:22.658327 26622 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.658347 28904 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:22.660069 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 108793us
I20260709 13:10:22.660609 29106 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.663158 29063 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:22.663756 29063 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:22.653584 29141 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.660032 28904 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.673552 29264 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:22.677908 29166 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.680622 29063 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.682267 29150 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.682299 29063 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:22.677815 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 122978us
W20260709 13:10:22.677819 26576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2524) took 2097 ms (client timeout 1763 ms). Trace:
I20260709 13:10:22.617509 29238 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:22.692045 26576 rpcz_store.cc:269] 0709 13:10:20.579787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.642420 (+ 62633us) service_pool.cc:224] Handling call
0709 13:10:22.677085 (+2034665us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b540032ebd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:22.677451 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4185369984}
I20260709 13:10:22.668316 28956 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:22.711565 29008 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:22.712971 26548 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:22.713752 29277 consensus_queue.cc:1059] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:22.714879 28952 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:22.715523 29137 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:22.716125 29137 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.715158 29277 raft_consensus.cc:3055] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:22.723047 26625 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.730067 28956 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.734925 29141 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:10:22.718083 29187 consensus_queue.cc:1059] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:10:22.732085 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:22.705140 29255 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.705710 29238 consensus_queue.cc:1059] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:10:22.720774 29277 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:22.777724 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.778898 29106 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:22.727576 29178 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.862301 29178 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:22.862963 29178 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:22.863581 29137 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:22.856210 29117 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:22.865762 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 296803us
I20260709 13:10:22.814384 26401 catalog_manager.cc:5697] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 4, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 4 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.887116 26401 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.749341 29264 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:10:22.836362 29281 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.082s	user 0.004s	sys 0.000s
I20260709 13:10:22.897033 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:22.752426 26549 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:22.897897 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:22.898152 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 145830us
I20260709 13:10:22.751523 29269 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:10:22.898681 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:22.899343 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:22.899586 27276 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:22.900059 27275 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:22.837690 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:22.733609 29157 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:10:22.902060 26658 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:22.900942 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:22.838568 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:22.898622 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:22.903187 27273 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:22.903414 26580 raft_consensus.cc:2410] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:22.903589 29269 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.914322 29282 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:22.737426 29166 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:22.837764 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:22.844655 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.918879 26508 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:22.919437 26510 raft_consensus.cc:2410] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:22.920667 29178 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:22.840374 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.845924 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.847288 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:22.851933 26650 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:10:22.852671 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 133211us
I20260709 13:10:22.925666 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1743) took 1633 ms. Trace:
W20260709 13:10:22.853256 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 121586us
I20260709 13:10:22.926067 26650 rpcz_store.cc:276] 0709 13:10:21.292498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.296735 (+  4237us) service_pool.cc:224] Handling call
0709 13:10:21.370789 (+ 74054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.576491 (+1205702us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003f5320. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8a0dc0 00007f882c92b1c0 00007f882c92c231 00007f882c928d8f 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c
0709 13:10:22.925283 (+348792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.925534 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2769364224}
I20260709 13:10:22.853850 29274 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:22.926873 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:22.852824 29277 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.928148 29277 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.909850 29269 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.855156 28904 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:22.929783 28904 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.930189 28904 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.930292 29269 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:22.856194 29238 raft_consensus.cc:3055] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:22.737320 29187 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:22.942557 29238 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:22.942804 29187 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:22.943485 28956 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:22.943638 29238 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.943917 29187 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.944649 29166 raft_consensus.cc:697] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:22.944904 29238 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:22.859453 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:22.945734 29166 consensus_queue.cc:237] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.853926 29150 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:22.754604 29255 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:22.874300 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:22.947523 29150 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.874974 29117 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:22.948125 29150 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.948776 29106 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:22.949445 29106 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.950291 29150 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:22.879750 29137 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.951252 29137 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.899858 29095 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:22.837860 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:22.907050 27243 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.870846 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:22.954895 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 47923.9us
I20260709 13:10:22.955015 29106 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:22.955792 29264 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:22.945312 29187 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:22.935889 29036 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:10:22.908037 26401 catalog_manager.cc:5697] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 2 to 3, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:22.898752 27274 raft_consensus.cc:2368] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:22.953331 29137 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:22.958021 26401 catalog_manager.cc:5697] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 4 to 5, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 5 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:22.956401 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.960072 27243 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.961059 29077 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:22.938130 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.942653 29178 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:22.961977 29178 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:22.962323 29178 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:22.963207 29178 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.964509 29178 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:22.839958 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.940357 29274 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:22.965967 29077 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:22.966074 29274 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.966642 29274 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.837261 26505 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:22.966109 29137 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:22.971686 29137 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:22.975888 29187 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:22.976416 26625 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:22.979506 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:22.985363 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.997843 29187 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:22.998437 29036 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.999470 29036 raft_consensus.cc:3055] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:22.999894 29036 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:23.000337 26549 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.001791 28956 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:23.003994 26576 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:23.006481 29187 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:23.007088 29077 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:10:23.008837 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 69673.9us
I20260709 13:10:23.012089 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:23.012938 29137 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:23.000886 29036 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.020530 29036 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:23.021931 29187 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:23.026849 29187 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.027680 29187 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:23.028991 29137 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.030787 29137 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.039525 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:23.040241 26505 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:23.046797 27274 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:23.001422 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 51881.5us
I20260709 13:10:23.052690 29137 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:23.054011 29117 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.056748 29117 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.055197 29255 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.056090 26506 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:23.059756 29255 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:22.999500 26625 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.062230 29106 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:23.062621 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:23.062803 29106 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:23.063272 26507 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:23.063819 29106 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.064317 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:23.064888 26510 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:23.066323 26508 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:23.067638 29117 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:23.068632 29255 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:22.959487 26401 catalog_manager.cc:5697] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 3 to 4, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 4 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.071692 26401 catalog_manager.cc:5697] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 4 to 5, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 5 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.079048 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:23.073973 26401 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.096649 26401 catalog_manager.cc:5697] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 2 to 3, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 3 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.113281 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:23.108222 26401 catalog_manager.cc:5697] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 4 to 5, term changed from 2 to 4, VOTER ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) evicted. New cstate: current_term: 4 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:23.117213 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:23.137399 26505 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:23.138846 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 85295.1us
I20260709 13:10:23.140012 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:23.144690 26509 raft_consensus.cc:2393] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:23.146441 26506 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:23.179392 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:23.102926 29282 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.179392 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 179949us
I20260709 13:10:23.198393 27275 raft_consensus.cc:2393] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 4: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:23.202163 26582 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:10:23.200645 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:23.184088 26508 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:23.220553 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:23.221354 26506 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:23.202680 26582 pending_rounds.cc:85] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 5
I20260709 13:10:23.224511 26582 pending_rounds.cc:107] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:10:23.224285 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 282648us
I20260709 13:10:23.225181 26582 raft_consensus.cc:2889] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:23.193468 29286 log.cc:927] Time spent T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:10:23.103884 29216 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.223775 26625 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:23.104609 28904 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.187726 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:23.187271 29095 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:23.258873 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 110330us
W20260709 13:10:23.280994 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 77370.1us
I20260709 13:10:23.193957 29282 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.221346 29157 consensus_queue.cc:1059] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:10:23.284626 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 140156us
I20260709 13:10:23.253921 29137 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.314639 26654 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:10:23.320552 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 82463.1us
I20260709 13:10:23.258551 29106 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:23.330745 27273 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:23.338362 26474 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:23.346065 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:23.281782 27270 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:23.349655 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:23.352784 29282 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:23.365072 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:23.378742 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.353397 29274 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.354228 27275 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:23.354106 29137 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.355234 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 057c1e97d7fb407aaf9cf119a0b63a37 with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54880
I20260709 13:10:23.357856 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:23.393332 27276 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:23.393522 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.358572 28986 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:23.360298 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.361060 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.361828 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:23.363150 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:23.363871 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.399421 26584 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:10:23.399905 26584 pending_rounds.cc:85] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 4
I20260709 13:10:23.375468 27274 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:23.400277 26584 pending_rounds.cc:107] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:10:23.400619 26584 raft_consensus.cc:2889] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:23.365177 27278 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:23.402202 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:23.382176 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 52211.7us
W20260709 13:10:23.385351 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 47107.5us
I20260709 13:10:23.390507 26506 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:23.357908 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:23.398144 26659 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:23.417435 26657 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:23.414036 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:23.426921 27276 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:23.427639 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:23.321861 29095 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.388907 29157 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.433125 26549 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.433633 26506 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:10:23.446630 26506 pending_rounds.cc:85] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 3
I20260709 13:10:23.446943 26506 pending_rounds.cc:107] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:10:23.447312 26506 raft_consensus.cc:2889] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:23.389667 29255 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:23.439409 26582 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:23.438825 26583 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:23.435808 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:23.441897 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:23.449718 27274 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:23.441982 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.461181 26579 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:23.465651 26576 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:23.468140 27276 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:23.472487 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.403407 29187 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.452533 29311 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.452346 29255 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:23.489318 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.493366 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:23.520593 27277 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:23.464798 29227 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.523926 29227 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.468377 29117 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:23.434058 29277 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:10:23.525873 29117 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.526432 29117 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.482120 28949 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.527103 28949 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.527660 29321 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.528251 29321 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.529294 28949 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:23.461787 29178 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:23.530004 26656 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:23.518374 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:23.519480 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:23.437233 29077 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:10:23.516300 29311 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.533835 27273 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:23.470974 29238 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.537137 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 104134us
I20260709 13:10:23.533944 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:23.540189 26653 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:23.462646 29157 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.451625 28986 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.541697 26579 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 3: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:23.548553 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.511279 29255 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:23.553066 27274 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:23.558307 26658 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:23.562801 29187 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:23.575047 29293 log.cc:927] Time spent T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:10:23.575685 29187 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:23.576489 29301 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:10:23.576341 29187 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.578895 29095 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:23.583256 26576 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:23.586922 26657 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:23.592291 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:23.636421 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.643071 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 93086.9us
I20260709 13:10:23.645308 26582 raft_consensus.cc:1217] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Deduplicated request from leader. Original: 3.3->[4.4-6.5]   Dedup: 4.4->[6.5-6.5]
I20260709 13:10:23.645898 26582 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:10:23.541888 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:23.541004 29312 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:23.589207 29216 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:23.588258 29063 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.672597 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 467772us
I20260709 13:10:23.542871 29238 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.649689 29264 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:23.649207 28904 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:23.685688 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:23.685689 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 149482us
W20260709 13:10:23.688417 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 169071us
I20260709 13:10:23.691398 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.693725 26582 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:10:23.701136 26548 leader_election.cc:336] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.613s (SENT)
W20260709 13:10:23.689316 29290 log.cc:927] Time spent T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 13:10:23.701668 26548 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:23.666337 29110 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:10:23.702909 29110 consensus_queue.cc:1243] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:23.666528 29095 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:10:23.695289 29312 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.712055 29137 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:23.713313 29311 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:23.688290 29187 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:23.673955 29063 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.715468 28986 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:23.674383 29106 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 13:10:23.709345 29036 consensus_meta.cc:287] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.676s	user 0.005s	sys 0.001s
W20260709 13:10:23.699512 29292 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:10:23.722600 29274 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:23.725528 29106 raft_consensus.cc:3055] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:23.729158 29106 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:23.730222 29106 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.731452 29106 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:23.725786 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:23.727084 29123 raft_consensus.cc:3055] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:23.727210 29117 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.699651 29264 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:23.737712 29306 consensus_queue.cc:1059] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:10:23.750933 29157 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:23.751587 26584 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:10:23.751967 26584 pending_rounds.cc:85] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 2
I20260709 13:10:23.752218 26584 pending_rounds.cc:107] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:10:23.752439 26584 raft_consensus.cc:2889] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:23.755707 26625 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:23.756503 29036 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:23.756959 29187 consensus_queue.cc:1059] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:23.757858 29036 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:23.758242 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.758527 29329 tablet_replica.cc:333] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:10:23.759531 29274 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:23.760058 29274 raft_consensus.cc:697] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:23.712061 29312 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:23.761597 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 72918us
I20260709 13:10:23.722785 29277 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:23.759164 29036 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:23.765434 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.736164 29123 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:23.767439 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:23.776162 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:23.777791 26509 consensus_meta.cc:287] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:10:23.781805 26509 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
W20260709 13:10:23.783839 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 91560.1us
I20260709 13:10:23.755707 29063 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:23.760921 29274 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.773617 28904 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:10:23.787937 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.793007 26583 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
W20260709 13:10:23.787655 26548 leader_election.cc:336] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.688s (SENT)
I20260709 13:10:23.793478 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.793880 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:23.795151 26548 leader_election.cc:336] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.733s (SENT)
I20260709 13:10:23.795553 26548 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:23.796339 29178 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:23.797386 29277 consensus_queue.cc:1059] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:23.797554 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.798313 29277 raft_consensus.cc:3055] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:23.798452 29166 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:23.798707 29277 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:23.799613 29277 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.800514 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:23.800817 29277 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:23.801337 29166 raft_consensus.cc:2764] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:23.802336 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.814649 26474 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:23.826756 29321 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:23.827514 26622 leader_election.cc:400] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:23.827482 29321 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:23.805127 29110 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:23.827865 26622 leader_election.cc:403] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:23.830276 29187 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:23.830854 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.832263 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:23.833421 29324 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
I20260709 13:10:23.834378 26581 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:10:23.834532 29227 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:23.837702 29326 raft_consensus.cc:3055] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:23.838047 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:23.839087 29330 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 13:10:23.839190 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.840212 29238 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:23.840121 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:23.872474 26585 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:23.849819 26474 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:23.856325 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.855396 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.879122 26577 raft_consensus.cc:2393] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:23.864660 26576 raft_consensus.cc:2393] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:23.865501 26581 pending_rounds.cc:85] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 3
I20260709 13:10:23.790526 29325 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:23.872694 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 105385us
W20260709 13:10:23.871038 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 65676.2us
I20260709 13:10:23.874239 26583 raft_consensus.cc:2410] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:23.875062 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:23.875161 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.784500 29157 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:10:23.779631 29282 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:10:23.879870 26581 pending_rounds.cc:107] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:10:23.881337 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.889505 26581 raft_consensus.cc:2889] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:23.889716 26656 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:23.879256 26653 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:23.883189 26650 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:23.886631 27240 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.891880 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:23.830890 29117 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:23.895766 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:23.899413 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 68662.2us
I20260709 13:10:23.871803 29137 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.879995 29166 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:23.907438 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:23.908237 26659 raft_consensus.cc:2393] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:23.871336 29326 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:23.884114 29187 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:23.889976 29325 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.911504 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.786705 29327 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:10:23.865798 29311 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:10:23.911998 29264 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:23.923974 29308 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.946859 29077 raft_consensus.cc:3055] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:23.947319 29077 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:23.946982 29308 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.948197 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.948730 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:23.944998 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.950296 26652 pending_rounds.cc:85] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 4
I20260709 13:10:23.950578 26652 pending_rounds.cc:107] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:10:23.950671 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:23.950837 26652 raft_consensus.cc:2889] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:23.950888 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:23.944718 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 44389.9us
I20260709 13:10:23.951637 26581 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:23.951723 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.952775 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.952963 26655 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:23.916934 26578 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:23.954872 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.955392 26578 raft_consensus.cc:1813] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Handling vote request from an unknown peer b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.955852 26578 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:23.917011 29320 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:23.956631 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.921667 28986 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.930181 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.957458 28986 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:23.912011 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 96527us
I20260709 13:10:23.958122 29326 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.959226 29326 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:23.959719 28986 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:23.960227 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.960952 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.938619 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.891996 28956 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:23.962807 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.911826 29117 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.963828 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 77578.1us
I20260709 13:10:23.963735 29117 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.964882 26577 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:23.916885 29309 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:23.965930 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.922930 29334 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:23.967804 29334 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.968143 29334 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:23.967036 29308 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:23.945020 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.971841 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.883379 29123 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.972411 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:23.972947 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:23.965984 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.966096 29309 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:23.918888 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.975996 26576 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:23.966593 29325 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:23.967037 29311 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.926070 29137 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.969940 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.958184 26582 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:23.962568 28956 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:23.944128 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.891709 29095 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:23.892747 29227 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.973516 26654 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.979678 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:23.982378 26583 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:23.995968 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:23.963074 29321 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:23.912194 29141 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:24.010224 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 80132.7us
I20260709 13:10:24.011333 27240 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:24.002609 26656 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:24.017411 26659 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:23.927030 29166 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:24.028026 26576 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:10:24.029098 26474 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:24.038578 27240 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.040380 29349 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:24.042961 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 70677.3us
I20260709 13:10:24.044173 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.038699 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:24.046041 27240 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.002472 29178 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:24.050720 26625 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:23.936221 29255 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.020359 29320 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:24.038360 29166 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.066711 26622 leader_election.cc:400] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
W20260709 13:10:24.062530 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 62496.1us
I20260709 13:10:24.080354 26622 leader_election.cc:403] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:24.079885 26549 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:24.050040 29282 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:24.055334 29329 raft_consensus.cc:2243] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.050326 29312 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:24.052445 29306 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:24.001823 29311 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.092867 26549 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:24.095464 26548 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:24.020854 29227 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.078018 29187 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:24.085683 28986 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.056367 29117 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:24.060308 29238 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:24.124029 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 175544us
I20260709 13:10:24.056911 29141 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:24.097886 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.132472 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:24.052752 29157 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:10:24.129798 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:24.096808 29110 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.099956 29312 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:24.124984 29345 log.cc:927] Time spent T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:10:24.055616 29303 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 13:10:24.167397 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 74619.8us
I20260709 13:10:24.096359 29274 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4.
I20260709 13:10:24.195410 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:24.126160 29329 raft_consensus.cc:2272] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.196157 26576 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:24.196493 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 101147us
W20260709 13:10:24.127318 29336 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:10:24.199805 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:24.199880 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:24.124219 29337 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:24.163765 29321 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.130899 29187 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.106850 28949 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:10:24.190795 29312 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.214089 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:24.129002 29352 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:24.214663 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:24.125232 29227 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:24.128433 29150 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:10:24.214169 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:24.124527 29063 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:10:24.221868 26583 raft_consensus.cc:2376] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4. Re-sending same reply.
W20260709 13:10:24.218281 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 85854.6us
I20260709 13:10:24.163066 29036 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:10:24.234458 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.220148 29187 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.242683 26576 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:24.222878 29157 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:24.224603 29352 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.232388 26476 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:24.251147 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 46226.5us
I20260709 13:10:24.162767 28986 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.257375 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.249244 29117 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:24.265456 29361 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:24.266332 29150 consensus_queue.cc:1059] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:24.267392 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:24.274030 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 74260.3us
I20260709 13:10:24.279479 26654 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
W20260709 13:10:24.293105 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.298074 29137 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:24.288811 29308 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:24.299578 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:24.106562 29309 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.301409 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:24.302117 29311 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:24.248956 29157 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.302932 29157 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.303007 26657 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:24.305388 26653 raft_consensus.cc:2368] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:24.306177 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:24.306731 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:24.307304 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 50043us
I20260709 13:10:24.241911 28956 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:24.315604 26655 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
W20260709 13:10:24.310531 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 224403us
I20260709 13:10:24.249137 29352 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.317679 26579 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:24.316896 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.323900 27240 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:24.324117 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:24.304289 29216 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:24.325863 29353 log.cc:927] Time spent T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
W20260709 13:10:24.326802 29351 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:10:24.328227 29348 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:24.328855 29348 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.324893 29255 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:24.330664 29356 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:24.331197 29356 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.331647 29356 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.331283 29216 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:24.334605 29343 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:10:24.315608 29311 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:24.336056 29311 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:24.337116 29311 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.322712 26476 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.325623 26654 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:24.343070 26474 leader_election.cc:400] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:24.343463 26474 leader_election.cc:403] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:24.333179 29350 consensus_queue.cc:1059] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:10:24.319329 28956 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:24.353603 26476 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.341886 29306 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:24.366039 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:24.370172 29350 raft_consensus.cc:3055] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:24.370749 29350 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:24.371407 29216 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:24.372346 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:24.371919 29350 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.373020 26503 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:24.373940 29350 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.375587 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:24.376225 26509 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 1.
I20260709 13:10:24.358597 29255 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:24.353047 29063 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.382390 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:24.357090 29110 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:24.385172 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.361340 29308 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.387594 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:24.388638 26476 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.364526 29036 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.360846 29178 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:24.380661 28956 raft_consensus.cc:3055] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:24.399662 26473 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:24.408622 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:24.409255 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:24.352378 29326 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:10:24.394318 29216 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:24.424217 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:24.426656 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:24.427436 27276 raft_consensus.cc:2393] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:24.427173 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:24.368462 29227 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:10:24.428057 27271 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:24.391065 29325 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.384718 29150 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:10:24.389684 29274 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:10:24.390199 29063 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.391052 29337 consensus_queue.cc:1059] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
W20260709 13:10:24.431442 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 140411us
W20260709 13:10:24.467525 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 58381.6us
I20260709 13:10:24.637578 27240 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.411959 29117 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:24.414814 28956 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:24.390287 29360 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:24.512362 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 126152us
I20260709 13:10:24.424131 29282 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:24.579543 29366 log.cc:927] Time spent T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:10:24.530119 29359 log.cc:927] Time spent T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:10:24.514406 29137 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.493520 29255 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:24.537153 29329 ts_tablet_manager.cc:1916] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:24.667210 26650 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
W20260709 13:10:24.590250 29106 consensus_meta.cc:287] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.858s	user 0.014s	sys 0.000s
W20260709 13:10:24.580755 29334 consensus_meta.cc:287] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
W20260709 13:10:24.593883 29166 consensus_meta.cc:287] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
I20260709 13:10:24.581274 28986 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:24.432348 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:24.682029 27270 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.681849 28956 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.659380 29327 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.683974 29327 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.417026 29036 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.685681 29323 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.686580 29327 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:24.638762 29274 consensus_queue.cc:1243] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:10:24.666373 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 275916us
I20260709 13:10:24.465916 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:24.507133 29110 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.686300 29323 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.549454 29178 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.687425 29137 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.673679 29255 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:24.687983 29036 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:24.642509 29302 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:24.529019 29356 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.690927 29325 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:24.693178 29312 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.579813 29077 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.570576 29352 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.596539 29187 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.697757 29166 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.699020 29321 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:24.698798 29334 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.700599 29348 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:24.661969 29141 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:24.702533 26651 raft_consensus.cc:1275] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:24.710042 29106 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:24.467859 29342 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.289s
I20260709 13:10:24.659132 29382 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.467635 29364 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:24.737870 26581 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:24.738638 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:24.742791 27270 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:24.704964 29157 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.667953 29360 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.793363 27272 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
W20260709 13:10:24.796747 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 135359us
W20260709 13:10:24.797791 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 374444us
I20260709 13:10:24.672839 29282 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.807006 29255 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.859198 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:24.934404 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:24.787487 29110 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.875308 29323 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:24.914018 29308 consensus_meta.cc:287] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.015s
I20260709 13:10:24.878328 29302 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:24.861088 26651 pending_rounds.cc:85] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 1
W20260709 13:10:24.905761 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 242973us
I20260709 13:10:24.939962 26651 pending_rounds.cc:107] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:24.940307 26510 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:24.940371 26651 raft_consensus.cc:2889] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:24.941859 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:24.882858 29141 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:24.921671 26476 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:24.932462 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:24.948257 27277 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:24.933897 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:24.948730 26476 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:24.935616 26579 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:24.862155 29077 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.875465 29238 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:24.906250 28956 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.937013 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:24.959698 27273 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.913125 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:24.911741 29311 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.946421 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:24.910733 29348 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.924437 29360 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.936321 29117 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:24.951434 29141 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.913614 29386 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.952867 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:24.956157 26476 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:24.918753 29352 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:24.957355 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.981447 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:24.981878 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:24.982210 29348 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.948248 26501 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:24.967773 26473 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:24.952081 29302 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.914793 29106 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:24.950790 27278 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:24.954689 29325 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:24.922550 29327 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.954075 29308 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:24.981885 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:24.917127 29382 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:24.991128 29278 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:24.995538 29382 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:24.992166 29312 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:24.997236 29312 consensus_queue.cc:1059] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:24.998435 29312 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:24.998819 29312 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:24.999223 29312 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.002113 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:25.002833 29157 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:25.002928 27271 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:24.959756 29379 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.983906 29063 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:25.006237 29187 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:25.007477 29356 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:25.008004 29106 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:24.969323 29311 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:25.009877 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 57069.6us
I20260709 13:10:24.953528 29238 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:24.955006 29309 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:10:25.009913 27240 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:25.023636 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:25.025425 26548 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:24.987524 29349 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:25.021412 26508 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:25.058751 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:25.059124 26501 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:25.059494 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:25.017593 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 95268.8us
I20260709 13:10:25.060256 26508 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:25.061381 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:25.062625 26508 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.988198 29325 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.068441 26548 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:25.070907 26506 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:25.072113 26505 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:25.074667 29334 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:25.074877 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 86358.3us
I20260709 13:10:24.976174 29117 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:25.021596 29327 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:25.078944 29166 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:24.984826 29386 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:25.079290 29327 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:25.067028 29150 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:25.080200 29110 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:25.081096 29386 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:25.081781 29095 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:25.082087 26502 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:25.082157 29309 raft_consensus.cc:3055] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:25.022478 28986 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:25.083536 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:25.085175 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:25.080168 29150 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:25.086555 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:25.086797 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:25.087908 27276 raft_consensus.cc:2376] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4. Re-sending same reply.
I20260709 13:10:25.087483 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:25.103941 29387 raft_consensus.cc:3055] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:25.108771 29387 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:25.109067 29117 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:25.110581 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:25.111263 27275 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.077994 29137 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:25.098369 27273 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
W20260709 13:10:25.099284 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 131595us
W20260709 13:10:25.102236 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.111680 27270 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.112135 29110 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:25.058619 29349 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:25.093950 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.141209 29396 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:25.107326 29150 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.104517 29334 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.110821 29363 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:25.137471 29238 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:25.140576 29377 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:25.141139 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 80676.3us
I20260709 13:10:25.141307 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:25.146314 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.147396 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 60932.2us
W20260709 13:10:25.151619 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 195520us
I20260709 13:10:25.169865 26508 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:25.096930 29309 raft_consensus.cc:740] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:25.086951 29325 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.200439 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:25.200475 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:25.201802 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:25.202155 26582 raft_consensus.cc:2410] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:25.104312 28986 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:25.106555 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:25.195075 26476 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:25.195761 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.201261 27273 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.204505 27241 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:25.206626 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 65405.4us
I20260709 13:10:25.171414 28904 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:25.211627 26476 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:25.208225 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:25.212875 26583 raft_consensus.cc:2410] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:25.202438 26580 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:25.106173 29365 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 13:10:25.211850 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:25.218514 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:25.182660 29349 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:25.222468 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:25.220819 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:25.221606 26652 raft_consensus.cc:2410] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:10:25.223815 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 155476us
I20260709 13:10:25.225777 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:25.226341 26653 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:25.227002 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 54481.7us
I20260709 13:10:25.185266 29110 raft_consensus.cc:697] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:25.192245 29311 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:25.192852 29348 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:25.230412 26655 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:25.211187 28904 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.266772 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:25.231787 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:25.234616 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:25.268734 26659 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.242117 29363 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:25.210973 29238 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:25.255465 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:25.193192 29334 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:25.259158 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 64643.8us
I20260709 13:10:25.302350 26622 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:25.302841 27273 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:25.303364 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:25.270190 29396 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:25.230420 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:25.306979 29312 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:25.267638 26579 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:25.208033 28986 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.291431 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:25.269049 29137 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:25.270352 28904 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:25.403370 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 129510us
I20260709 13:10:25.409818 27273 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:25.410732 26473 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:25.412160 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 200379us
I20260709 13:10:25.300504 29117 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:24.532318 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:25.312008 29312 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:25.399209 29311 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:25.447185 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:25.405452 29137 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:25.461719 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 252126us
I20260709 13:10:25.515821 26579 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:25.417326 29117 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:25.523442 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 112804us
W20260709 13:10:25.521746 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 257797us
W20260709 13:10:25.522430 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 297298us
I20260709 13:10:25.402024 29141 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:25.576126 27243 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:25.575855 26548 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:25.444727 29377 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:25.518500 29255 consensus_meta.cc:287] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.000s
I20260709 13:10:25.525957 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:25.584391 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:25.519110 29137 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.516362 29352 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:25.515115 29410 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:25.602062 26548 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:25.577056 29378 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:25.607205 26548 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:25.615113 29095 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:25.615859 29377 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:25.515957 29110 consensus_queue.cc:237] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:25.617182 29391 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:25.538709 29117 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.594478 29411 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:25.618482 29390 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.603860 29255 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:25.660504 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:25.605003 29311 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:25.619562 29401 log.cc:927] Time spent T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:10:25.620306 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 94430us
I20260709 13:10:25.453226 29302 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:25.586449 29178 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:25.673705 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.619979 29393 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:25.586009 29350 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
W20260709 13:10:25.654973 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 241181us
I20260709 13:10:25.667367 26473 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:25.685010 26473 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:25.661252 26579 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:25.624780 29378 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.687110 26473 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:25.688067 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:25.621197 28956 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:10:25.594313 29361 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:10:25.694693 26474 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:25.658739 29282 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:25.699093 29302 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:25.594008 29400 consensus_queue.cc:1059] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.489s
I20260709 13:10:25.693030 29391 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:25.669588 29178 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:25.691227 29077 consensus_meta.cc:287] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.003s
I20260709 13:10:25.663367 29410 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:25.648132 29352 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:25.666170 29380 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.437s
I20260709 13:10:25.693521 29378 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.694831 29411 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:25.711356 29277 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:25.710155 29311 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:25.751850 27275 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.001s
I20260709 13:10:25.734486 29178 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.763972 26659 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:25.773722 27275 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
W20260709 13:10:25.734915 29402 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
W20260709 13:10:25.815476 29392 log.cc:927] Time spent T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.447s	user 0.000s	sys 0.001s
I20260709 13:10:25.741914 29410 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:25.819180 27273 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:10:25.841244 27270 consensus_meta.cc:287] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.656s	user 0.006s	sys 0.002s
W20260709 13:10:25.821048 29403 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:10:25.821847 29141 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:25.669471 29390 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:25.827816 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1766) took 1352 ms. Trace:
I20260709 13:10:25.850337 29410 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.876530 26654 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:25.819624 29095 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:25.836512 29379 consensus_meta.cc:287] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.833s	user 0.006s	sys 0.004s
I20260709 13:10:25.759872 29274 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.837175 26549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.999s (SENT) [suppressed 35 similar messages]
W20260709 13:10:25.886224 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 310443us
W20260709 13:10:25.817260 26476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.085s	sys 0.124s
I20260709 13:10:25.772941 29311 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.811033 29334 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:25.838155 29360 consensus_meta.cc:287] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.853s	user 0.006s	sys 0.001s
I20260709 13:10:25.875320 29157 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.863462 27270 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:25.828166 29391 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:25.878139 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:25.879133 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:25.872527 26651 rpcz_store.cc:276] 0709 13:10:24.475902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.476598 (+   696us) service_pool.cc:224] Handling call
0709 13:10:24.505114 (+ 28516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.950721 (+445607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.827569 (+876848us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54001f5c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:25.827751 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453066112}
I20260709 13:10:25.880446 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:25.882736 26656 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:10:25.852761 26653 consensus_meta.cc:287] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.002s
W20260709 13:10:25.886790 26476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.085s	sys 0.124s
I20260709 13:10:25.883329 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:25.902098 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:25.884490 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:25.864959 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 170346us
I20260709 13:10:25.933539 27243 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:25.939239 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:25.881688 29396 consensus_queue.cc:1243] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:25.882961 29269 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.902732 29379 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:25.953094 26509 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:26.030555 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 818961us
I20260709 13:10:26.039593 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:26.040141 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:26.036722 26653 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:26.043332 26654 raft_consensus.cc:2410] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:26.054093 26652 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:25.882126 29389 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:25.865235 28986 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:25.902334 29095 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:25.911916 29311 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:26.063443 26508 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:26.031774 26650 raft_consensus.cc:2410] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:26.038821 28949 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:25.883780 29400 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:26.055071 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 757) took 1095 ms. Trace:
I20260709 13:10:26.065359 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:25.885211 29423 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:26.065430 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:26.066635 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 228835us
I20260709 13:10:26.068399 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:26.068590 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:26.135428 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 298235us
I20260709 13:10:25.951879 29411 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:26.039143 29416 raft_consensus.cc:3055] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:26.072641 27277 rpcz_store.cc:276] 0709 13:10:24.958990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.830385 (+871395us) service_pool.cc:224] Handling call
0709 13:10:26.053654 (+223269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:25.952730 29360 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:26.113176 26501 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:25.912742 29274 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.038949 29282 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:26.040344 28956 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:26.056378 29255 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:26.069624 29397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.005s	sys 0.009s
I20260709 13:10:25.953352 29430 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.028760 29157 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.064837 29380 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:26.070842 29400 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.154126 26507 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:26.124317 29238 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.004s
I20260709 13:10:26.154597 29396 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:26.158576 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:26.161398 27240 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:26.053071 29269 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.069751 29389 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.183952 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:26.146123 29416 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:26.149067 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 759) took 1120 ms. Trace:
I20260709 13:10:26.365540 27277 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:10:26.356254 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 469311us
I20260709 13:10:26.367607 27243 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:26.390272 26576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2561) took 2095 ms (client timeout 2066 ms). Trace:
W20260709 13:10:26.390975 26576 rpcz_store.cc:269] 0709 13:10:24.294890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.299318 (+  4428us) service_pool.cc:224] Handling call
0709 13:10:26.390071 (+2090753us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400253354. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:26.390210 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307731328}
W20260709 13:10:26.167507 29397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.005s	sys 0.010s
I20260709 13:10:26.368839 27271 rpcz_store.cc:276] 0709 13:10:25.014656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.014817 (+   161us) service_pool.cc:224] Handling call
0709 13:10:25.073294 (+ 58477us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:25.097453 (+ 24159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.097487 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:25.113685 (+ 16198us) log.cc:844] Serialized 52 byte log entry
0709 13:10:25.295548 (+181863us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:25.657512 (+361964us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.135230 (+477718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.135304 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.135345 (+    41us) raft_consensus.cc:1685] finished
0709 13:10:26.135356 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.135482 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":480827,"prepare.queue_time_us":553723,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":405777,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":60697,"thread_start_us":417178,"threads_started":3,"wal-append.queue_time_us":438166}
I20260709 13:10:26.418768 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 752) took 1481 ms. Trace:
I20260709 13:10:26.185788 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:26.427294 26501 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.267894 26655 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:26.352926 28904 consensus_meta.cc:287] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.929s	user 0.009s	sys 0.000s
I20260709 13:10:26.451081 29386 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:26.451475 28904 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.395402 29423 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.454679 29423 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:26.345713 29433 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:26.418130 29264 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:26.426249 27276 rpcz_store.cc:276] 0709 13:10:24.912049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.912157 (+   108us) service_pool.cc:224] Handling call
0709 13:10:26.393052 (+1480895us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400845154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:26.393253 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318711680}
I20260709 13:10:26.458297 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:26.457024 29433 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:26.345428 29422 log.cc:927] Time spent T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:10:26.349380 29424 log.cc:927] Time spent T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:10:26.348397 29157 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:26.314471 29425 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.402s	user 0.002s	sys 0.000s
I20260709 13:10:26.344420 29305 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:26.267294 29419 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:26.346128 29426 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.184176 29352 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:26.351907 29360 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:26.354678 29390 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:26.502039 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:26.396286 29400 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.494140 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:26.175717 29329 ts_tablet_manager.cc:1929] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:26.459964 29238 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.252892 29095 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:26.617511 29137 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.961s	user 0.008s	sys 0.000s
I20260709 13:10:26.642424 29137 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:26.174153 28956 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:26.533839 29305 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.166868 29282 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.548482 29360 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.610409 29390 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:26.346004 29411 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.457044 29311 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.191632 29380 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:26.239982 29430 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:26.529063 29157 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.549306 29419 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.549643 29426 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.423666 29396 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:26.520399 26623 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.046s	sys 0.029s
I20260709 13:10:26.304421 29302 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:26.774966 26549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.002s	sys 0.009s
W20260709 13:10:26.871349 26549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.004s	sys 0.010s
I20260709 13:10:26.184641 29439 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:26.554415 29349 consensus_meta.cc:287] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.318s	user 0.011s	sys 0.000s
W20260709 13:10:26.622512 29150 consensus_meta.cc:287] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.422s	user 0.012s	sys 0.001s
W20260709 13:10:26.872313 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 710984us
I20260709 13:10:26.633340 29329 log.cc:1199] T 057c1e97d7fb407aaf9cf119a0b63a37 P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/057c1e97d7fb407aaf9cf119a0b63a37
W20260709 13:10:26.734479 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 184954us
W20260709 13:10:26.627391 29325 consensus_meta.cc:287] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.402s	user 0.012s	sys 0.000s
I20260709 13:10:26.653005 28904 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:26.871075 26623 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.046s	sys 0.034s
I20260709 13:10:26.809177 29137 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:26.827602 29407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.008s	sys 0.011s
W20260709 13:10:26.621078 29438 log.cc:927] Time spent T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:10:26.618952 29117 consensus_meta.cc:287] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.944s	user 0.010s	sys 0.002s
W20260709 13:10:26.871721 27275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.003s	sys 0.008s
W20260709 13:10:26.967299 27275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.003s	sys 0.008s
W20260709 13:10:26.871488 26503 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.005s	sys 0.007s
W20260709 13:10:26.868359 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 500839us
W20260709 13:10:26.627679 29424 log.cc:927] Time spent T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:10:26.638940 29410 consensus_meta.cc:287] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.753s	user 0.004s	sys 0.005s
W20260709 13:10:26.816946 29110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.011s
W20260709 13:10:26.783778 29166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.008s	sys 0.009s
W20260709 13:10:26.785316 29378 consensus_meta.cc:287] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.010s	user 0.009s	sys 0.002s
I20260709 13:10:26.893901 29447 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:26.867364 29444 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.895280 28956 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:26.895479 29178 consensus_meta.cc:287] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.057s	user 0.011s	sys 0.000s
I20260709 13:10:26.990172 29178 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:26.991724 26579 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:26.896688 29433 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:26.897015 29419 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:26.627300 29389 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:26.871915 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 715765us
I20260709 13:10:26.994179 29419 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:26.994846 29419 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.998131 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:26.998948 26654 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 2.
I20260709 13:10:26.993119 29178 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:26.876335 29305 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:26.849092 29415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.005s	sys 0.021s
I20260709 13:10:26.704129 29350 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:26.874706 26501 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
I20260709 13:10:26.869175 29423 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:26.948294 29396 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:27.024117 26501 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:26.948885 29282 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:26.949152 29426 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:26.890261 29150 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:26.950420 26509 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:26.703807 29443 consensus_queue.cc:1059] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.247s
I20260709 13:10:26.631273 27270 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:26.951006 29311 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:26.628077 29416 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.037271 29416 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.634021 29238 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.006784 28956 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:26.960204 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:26.964838 29430 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:26.954741 29325 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:26.969105 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:26.969441 26503 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.005s	sys 0.007s
W20260709 13:10:26.966851 29407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.009s	sys 0.013s
I20260709 13:10:27.057252 26577 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:26.973621 29110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.002s	sys 0.012s
I20260709 13:10:26.878451 29360 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:26.977757 29410 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.001015 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:26.908331 26473 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:26.878301 29157 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.878270 29390 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:26.977167 29166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.010s	sys 0.009s
W20260709 13:10:27.007570 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.016s	sys 0.014s
I20260709 13:10:26.890364 29349 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:26.953408 29264 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:10:27.018402 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:27.005964 26506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.026s
I20260709 13:10:26.996243 29378 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.077404 26510 raft_consensus.cc:2393] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:27.010176 29415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.005s	sys 0.022s
I20260709 13:10:26.971653 29117 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.038959 26501 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:27.007995 29269 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:26.879773 29302 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.089509 26650 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:27.053620 26476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.018s	sys 0.024s
W20260709 13:10:27.090122 26476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.019s	sys 0.024s
I20260709 13:10:27.067397 29443 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:27.073443 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.016s	sys 0.014s
W20260709 13:10:27.099756 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.074669 26506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.001s	sys 0.026s
I20260709 13:10:27.004914 29444 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.024284 29350 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:27.059417 27269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.004s	sys 0.027s
I20260709 13:10:27.085337 26502 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:27.005023 29447 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.070780 29407 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.079943 29110 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.068217 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 159981us
I20260709 13:10:27.072826 29430 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:27.091699 26624 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.031s	sys 0.042s
I20260709 13:10:27.138922 27276 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:10:27.139274 26624 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.032s	sys 0.042s
I20260709 13:10:27.082119 29166 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:27.130398 29450 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:27.058152 28956 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:27.066617 29431 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.007s	sys 0.016s
W20260709 13:10:27.137674 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 168723us
W20260709 13:10:27.133741 27269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.005s	sys 0.027s
W20260709 13:10:27.157016 26655 consensus_meta.cc:287] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.691s	user 0.006s	sys 0.002s
I20260709 13:10:27.159672 26655 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:27.129112 29389 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:27.090675 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 1.05061e+06us
I20260709 13:10:27.161514 26476 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:27.134382 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:27.135051 28904 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:27.151954 29431 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.007s	sys 0.016s
I20260709 13:10:27.138574 29442 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:27.141767 29110 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.144321 29443 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.142498 29407 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.147419 29391 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.315126 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 305804us
I20260709 13:10:27.341948 29117 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.342653 29431 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.182562 29457 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.343349 29431 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.343675 29457 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.342020 29468 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:27.342211 29269 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.197449 29393 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.203389 29360 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:27.347061 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 240682us
I20260709 13:10:27.152365 29454 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:27.160531 29419 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:27.200042 29400 consensus_meta.cc:287] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.003s
W20260709 13:10:27.363415 26657 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.005s	sys 0.019s
I20260709 13:10:27.150925 29166 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.195612 29349 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.187500 29302 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:10:27.184005 29329 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54880 (request call id 89) took 3847 ms. Trace:
I20260709 13:10:27.189807 29150 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.198559 29157 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.204660 28956 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.202875 29350 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.447471 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1987) took 1304 ms. Trace:
I20260709 13:10:27.448238 29110 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.194757 29410 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.449079 29325 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.183378 29447 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.191838 29444 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.195461 29459 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:27.450107 29459 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:27.451010 29459 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.452289 29459 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:27.375039 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 414513us
I20260709 13:10:27.436935 29385 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.453796 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:27.209323 28904 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.429976 29360 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.368063 29393 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.345165 29391 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.364573 29442 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.446516 29349 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:27.476977 29393 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.477268 29349 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.477619 29407 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.151294 29450 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.183844 29238 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:27.178886 29389 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:27.378818 26657 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.005s	sys 0.020s
I20260709 13:10:27.453941 29385 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.458122 29447 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.377183 29456 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.445675 29460 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:27.459682 26622 leader_election.cc:336] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 2.503s (SENT)
I20260709 13:10:27.447866 26509 rpcz_store.cc:276] 0709 13:10:26.143419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.032242 (+888823us) service_pool.cc:224] Handling call
0709 13:10:27.036907 (+  4665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.037260 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.037289 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.037883 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.155573 (+117690us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:27.155602 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.155650 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.447270 (+291620us) raft_consensus.cc:1685] finished
0709 13:10:27.447292 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.447412 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14072,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":17606,"thread_start_us":117326,"threads_started":1,"wal-append.queue_time_us":308195}
I20260709 13:10:27.456717 29398 raft_consensus.cc:3055] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:27.470906 29360 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.454473 27270 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:27.479730 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.366335 29269 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.457355 29302 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.527874 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 373129us
I20260709 13:10:27.535651 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 354) took 1419 ms. Trace:
I20260709 13:10:27.396938 29454 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.552944 26502 rpcz_store.cc:276] 0709 13:10:26.116807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.144265 (+ 27458us) service_pool.cc:224] Handling call
0709 13:10:27.535257 (+1390992us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54000a7dd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:27.535593 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647628672}
I20260709 13:10:27.418587 29400 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.475301 29431 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:27.555722 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.565284 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.574393 26509 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:27.376842 29468 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.564086 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:27.575222 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.575377 26502 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:27.483104 29305 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:27.545230 29342 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.584s	user 0.025s	sys 0.034s
W20260709 13:10:27.584861 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 128637us
W20260709 13:10:27.629408 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43648us
I20260709 13:10:27.636082 26549 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:27.564709 29416 consensus_meta.cc:287] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.001s
I20260709 13:10:27.637710 26549 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:27.551800 29238 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.642611 26505 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:27.624728 29342 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.666s	user 0.026s	sys 0.034s
I20260709 13:10:27.573385 29123 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:27.641585 27240 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:27.643363 26549 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:27.644465 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:27.650010 29468 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.655979 26509 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:27.572535 29349 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.645955 29157 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:27.571719 29360 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:27.564837 29443 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.648403 29305 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.650010 28904 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.573279 29390 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.671587 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.580804 29457 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.553834 29398 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:27.625030 29431 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.658988 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.635655 29110 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:10:27.663658 27272 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:27.661991 29393 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:27.640688 28956 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:27.544075 29447 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.574692 29302 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.654471 29416 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:27.674618 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.674880 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:27.676496 26654 raft_consensus.cc:2410] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:10:27.659719 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.700428 26652 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:27.668644 29468 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.729421 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.564378 29456 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:27.686275 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.581703 29460 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.731663 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.694435 29376 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.734238 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.695112 29475 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:27.734817 26652 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:27.437806 29329 rpcz_store.cc:276] 0709 13:10:23.354606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.354850 (+   244us) service_pool.cc:224] Handling call
0709 13:10:23.758150 (+403300us) ts_tablet_manager.cc:1151] Deleting tablet 057c1e97d7fb407aaf9cf119a0b63a37
0709 13:10:23.758242 (+    92us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:10:25.238356 (+1480114us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:26.160851 (+922495us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:27.159986 (+999135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":259884,"tablet-delete.queue_time_us":365452,"thread_start_us":278213,"threads_started":1}
I20260709 13:10:27.641502 29350 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:10:27.735857 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.736632 26652 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:27.702603 29454 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.704295 29166 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:27.671319 29157 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.718856 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2570) took 2463 ms. Trace:
I20260709 13:10:27.671463 29349 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:27.641160 26625 connection.cc:256] RPC call timeout handler was delayed by -1.5615987149999455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
I20260709 13:10:27.689778 28956 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:27.721005 29447 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.724843 29269 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.725032 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 458) took 2647 ms. Trace:
I20260709 13:10:27.699057 26651 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:27.749042 28956 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:27.750231 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.750819 26651 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:27.751832 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:27.727304 29302 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.654757 29238 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.730121 26549 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:27.747561 27273 rpcz_store.cc:276] 0709 13:10:25.077221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.516117 (+438896us) service_pool.cc:224] Handling call
0709 13:10:25.813754 (+297637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.837650 (+ 23896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.724806 (+1887156us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54006117d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:27.724945 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546951040}
I20260709 13:10:27.757050 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:27.756502 26549 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:27.757671 27273 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:27.758019 26549 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:27.758940 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:27.760035 29166 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:27.760567 29166 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.761003 29166 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:27.761117 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:27.762800 26549 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:27.722749 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.741410 26502 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:27.777935 26653 raft_consensus.cc:2410] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:27.763693 29350 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:27.758122 29349 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:27.754096 26651 raft_consensus.cc:1240] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:27.741613 26579 rpcz_store.cc:276] 0709 13:10:25.255677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.689921 (+434244us) service_pool.cc:224] Handling call
0709 13:10:25.713920 (+ 23999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.992268 (+1278348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.718500 (+726232us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001c3ed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:27.718767 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2938014976}
I20260709 13:10:27.775496 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.779290 26652 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:27.789122 26509 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:27.800153 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:27.813200 29471 log.cc:927] Time spent T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:10:27.813338 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.814332 26651 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:27.787571 29350 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.815208 29350 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.815330 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:27.816290 26651 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.816654 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:27.818385 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.795783 29349 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:27.818995 26502 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:27.798231 27270 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:27.820072 29110 consensus_queue.cc:1059] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:27.821190 29110 raft_consensus.cc:3055] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:27.821602 29110 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:27.793923 29454 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:27.839385 29391 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:27.795291 29468 raft_consensus.cc:697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:27.844110 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.856730 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.861927 26502 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:27.840862 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:27.864362 27273 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:27.698966 29393 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.828809 29349 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:27.699209 29431 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.863551 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 753) took 2951 ms. Trace:
I20260709 13:10:27.728209 29387 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.868170 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.735016 29475 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:27.734009 29376 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:27.927867 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:27.918139 26651 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:27.965154 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 353) took 2077 ms. Trace:
I20260709 13:10:27.898242 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.874969 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.967061 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:27.980031 26508 rpcz_store.cc:276] 0709 13:10:25.887761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.938879 (+ 51118us) service_pool.cc:224] Handling call
0709 13:10:27.964909 (+2026030us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b54000a87d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:27.965064 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74843392}
I20260709 13:10:27.998615 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:27.998987 26548 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:27.910316 29450 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:27.994297 29484 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:10:27.955087 29227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.989s	user 0.023s	sys 0.044s
I20260709 13:10:27.978147 29477 consensus_queue.cc:1059] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:10:28.006160 29227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.043s	user 0.024s	sys 0.045s
I20260709 13:10:27.995977 29387 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:27.997318 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:27.978192 27278 rpcz_store.cc:276] 0709 13:10:24.912374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.912495 (+   121us) service_pool.cc:224] Handling call
0709 13:10:24.912820 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.985632 (+ 72812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.863314 (+2877682us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b54006f2f54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:27.863493 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86468480}
I20260709 13:10:27.931367 29456 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.000385 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:27.840286 29454 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:27.869500 29460 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.939874 29400 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:27.842273 29416 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 13:10:27.922086 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.011927 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.012379 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:27.999883 29361 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:28.013993 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:28.003013 29443 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:27.959981 29482 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:10:27.866987 29398 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:28.010540 29409 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 2.288s	user 0.003s	sys 0.018s
I20260709 13:10:28.016006 29456 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:28.019635 26548 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:28.006855 29477 raft_consensus.cc:3055] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:28.024008 29477 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:28.024344 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1776) took 1065 ms. Trace:
I20260709 13:10:28.024748 26650 rpcz_store.cc:276] 0709 13:10:26.959424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.959557 (+   133us) service_pool.cc:224] Handling call
0709 13:10:26.959815 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.128959 (+169144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.024106 (+895147us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400168354. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:28.024275 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292962560}
I20260709 13:10:28.015240 29454 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:28.029539 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:28.029765 29095 raft_consensus.cc:3055] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:28.030208 29095 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:28.030387 26650 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:28.031203 29274 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.031016 29095 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.032315 29095 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.022277 29363 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:10:27.913945 29110 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:28.026784 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.031388 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:28.040725 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:28.041404 26504 raft_consensus.cc:2376] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7. Re-sending same reply.
I20260709 13:10:28.041548 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:27.940315 29468 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.042778 27278 raft_consensus.cc:2393] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:28.044263 26650 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:28.046056 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.055007 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:28.025849 29393 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:28.058302 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.059870 26504 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:28.060842 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.061400 26504 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:28.062260 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.058614 26650 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:28.065151 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.068009 29166 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.016111 28956 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:28.026350 29460 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:28.063313 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.045002 29398 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:28.042207 29475 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:28.075700 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:28.078044 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.077898 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.056824 29365 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:28.082965 27273 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:28.058089 29482 raft_consensus.cc:3055] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:28.086666 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.056814 29376 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:28.087375 27278 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:28.089367 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.089772 29431 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.089977 27278 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:28.091013 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.084981 29482 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:28.024989 29477 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.088421 29483 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.074673 29110 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:28.093120 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.094729 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.069391 29350 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:28.081038 29460 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:28.097077 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:28.083235 29352 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:28.104238 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 459) took 3026 ms. Trace:
I20260709 13:10:28.108886 29378 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.105329 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1973) took 3088 ms. Trace:
I20260709 13:10:28.118726 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.119675 26651 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:28.122568 27278 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:28.121296 26507 rpcz_store.cc:276] 0709 13:10:25.016380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.016490 (+   110us) service_pool.cc:224] Handling call
0709 13:10:25.068086 (+ 51596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.366235 (+1298149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.105061 (+1738826us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003539d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:28.105240 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415604608}
I20260709 13:10:28.125155 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.125092 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:28.125784 26504 raft_consensus.cc:1813] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Handling vote request from an unknown peer ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:28.121074 27275 rpcz_store.cc:276] 0709 13:10:25.077461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.815626 (+738165us) service_pool.cc:224] Handling call
0709 13:10:25.816001 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.139104 (+323103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.139148 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.139696 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.967940 (+828244us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:26.967995 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.103788 (+1135793us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54004cc554. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:28.103854 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.103916 (+    62us) raft_consensus.cc:1685] finished
0709 13:10:28.103930 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.104168 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217353,"raft.queue_time_us":222820,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":67994,"spinlock_wait_cycles":315403648,"thread_start_us":700501,"threads_started":1,"wal-append.queue_time_us":966487}
I20260709 13:10:28.130360 26504 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:28.096328 29443 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:28.133104 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:28.120735 29460 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:28.134830 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.104238 29483 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.138815 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.136823 26507 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:28.139568 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.140015 27275 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:28.140164 27278 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:28.142150 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1983) took 2080 ms. Trace:
I20260709 13:10:28.142668 29157 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.143960 29238 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:28.146348 26504 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:28.147251 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1989) took 1252 ms. Trace:
W20260709 13:10:28.148839 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.152518 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.154136 26658 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:28.147722 26504 rpcz_store.cc:276] 0709 13:10:26.894744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.136425 (+1241681us) service_pool.cc:224] Handling call
0709 13:10:28.146056 (+  9631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.146914 (+   858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.147187 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:28.142589 26506 rpcz_store.cc:276] 0709 13:10:26.061299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.117847 (+ 56548us) service_pool.cc:224] Handling call
0709 13:10:26.133019 (+ 15172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.133266 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:26.494050 (+360784us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.102176 (+608126us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.102486 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.719886 (+617400us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b180028c660. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:28.141637 (+421751us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b180028c660. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f882c921060 00007f882c933716 00007f882c944287 00007f882c944208
0709 13:10:28.141780 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.141823 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:28.141879 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.141950 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.142076 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1027613,"prepare.queue_time_us":969310,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":118,"raft.queue_time_us":1067466,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":8778,"spinlock_wait_cycles":26593920,"thread_start_us":934766,"threads_started":2,"wal-append.queue_time_us":1034270}
W20260709 13:10:28.158669 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 997180us
I20260709 13:10:28.160153 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:28.163327 26506 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:28.147439 29482 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.169716 29415 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:28.171280 26507 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:28.172183 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1990) took 1277 ms. Trace:
I20260709 13:10:28.172576 26507 rpcz_store.cc:276] 0709 13:10:26.894976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.140114 (+1245138us) service_pool.cc:224] Handling call
0709 13:10:28.161643 (+ 21529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.171825 (+ 10182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.172098 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:28.174220 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.174922 27278 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:28.175989 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:28.176576 27273 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:28.177810 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.178786 27275 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:10:28.179564 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 463) took 1273 ms. Trace:
I20260709 13:10:28.179790 27275 rpcz_store.cc:276] 0709 13:10:26.906027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.148705 (+1242678us) service_pool.cc:224] Handling call
0709 13:10:28.178501 (+ 29796us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:28.179253 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.179500 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:28.158706 29036 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.187363 29036 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:28.190315 27278 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:10:28.197304 26655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1771) took 2314 ms (client timeout 2201 ms). Trace:
I20260709 13:10:28.287391 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 465) took 1380 ms. Trace:
W20260709 13:10:28.289700 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 129667us
I20260709 13:10:28.289633 27278 rpcz_store.cc:276] 0709 13:10:26.906650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.175607 (+1268957us) service_pool.cc:224] Handling call
0709 13:10:28.189933 (+ 14326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.287171 (+ 97238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.287341 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:28.287999 27275 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:28.287081 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 351) took 2403 ms. Trace:
W20260709 13:10:28.288367 26655 rpcz_store.cc:269] 0709 13:10:25.876622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.883114 (+  6492us) service_pool.cc:224] Handling call
0709 13:10:28.190357 (+2307243us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400108e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:28.190503 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541116288}
I20260709 13:10:28.292690 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 466) took 1385 ms. Trace:
I20260709 13:10:28.293080 26502 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:28.303622 27273 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:28.304514 27275 rpcz_store.cc:276] 0709 13:10:26.906922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.180289 (+1273367us) service_pool.cc:224] Handling call
0709 13:10:28.287825 (+107536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.292446 (+  4621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.292636 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:28.311192 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.312258 26584 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:28.318109 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.318143 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:28.318899 26655 raft_consensus.cc:2376] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7. Re-sending same reply.
I20260709 13:10:28.319306 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.318917 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.321213 26507 raft_consensus.cc:1275] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:28.324877 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.325459 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.194157 29166 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.326212 26583 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:28.327148 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.327559 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:28.328073 27278 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:28.332782 26582 raft_consensus.cc:2410] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:10:28.332496 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.292479 26503 rpcz_store.cc:276] 0709 13:10:25.883460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.884552 (+  1092us) service_pool.cc:224] Handling call
0709 13:10:25.932850 (+ 48298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:27.059055 (+1126205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.059107 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:27.074317 (+ 15210us) log.cc:844] Serialized 52 byte log entry
0709 13:10:27.533912 (+459595us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:27.668909 (+134997us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.274130 (+605221us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.286716 (+ 12586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.286827 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.286867 (+    40us) raft_consensus.cc:1685] finished
0709 13:10:28.286877 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.287023 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":804152,"prepare.queue_time_us":261896,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":771130,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":27219,"thread_start_us":1446458,"threads_started":3,"wal-append.queue_time_us":557832}
I20260709 13:10:28.332907 26655 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:28.334231 26584 raft_consensus.cc:2410] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:28.333436 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 764) took 1169 ms. Trace:
I20260709 13:10:28.334792 27278 rpcz_store.cc:276] 0709 13:10:27.163962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.301717 (+1137755us) service_pool.cc:224] Handling call
0709 13:10:28.327837 (+ 26120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.333213 (+  5376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.333380 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:28.255808 29415 raft_consensus.cc:697] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:28.336668 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.292203 29483 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:28.320107 26581 raft_consensus.cc:2376] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7. Re-sending same reply.
I20260709 13:10:28.336309 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:28.336913 26507 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:28.337432 26579 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:28.291848 29427 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:28.308097 29400 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:28.346037 27273 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:28.347748 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.278182 29454 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.328773 29449 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.351675 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:28.351830 27275 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:28.350559 26655 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:28.354146 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:28.354856 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 174677us
I20260709 13:10:28.354921 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.355309 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.354856 26655 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.278390 29443 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:28.349474 29421 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 2.418s	user 0.010s	sys 0.022s
I20260709 13:10:28.356050 26474 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:28.357182 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.356746 26506 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:28.363371 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.366190 26655 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:28.367475 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:28.350294 29452 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.370648 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.373986 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.372273 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.375478 26581 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:28.370564 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:28.357474 29325 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:28.371603 29426 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:28.375519 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.395445 26503 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:28.375488 26655 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:10:28.380124 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.349819 29400 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:28.384989 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.386073 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.386884 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.354079 29460 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.356725 29449 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.376061 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.393715 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:28.438634 26583 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:28.438796 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 45213.6us
I20260709 13:10:28.439950 26474 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:28.372038 29410 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:28.396445 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.396848 29387 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.437060 26584 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.437541 26502 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:28.441262 26503 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:28.441344 26580 raft_consensus.cc:2410] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:10:28.444279 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.436445 26581 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:28.446905 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.447707 26504 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:28.451248 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.451874 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.452934 26474 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:28.448472 29311 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:28.454180 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 760) took 3378 ms. Trace:
I20260709 13:10:28.456478 26507 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:28.486058 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.458323 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.486685 26581 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:28.377949 29452 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:28.445248 29410 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.486856 26504 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:28.486232 27274 rpcz_store.cc:276] 0709 13:10:25.075373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.084008 (+  8635us) service_pool.cc:224] Handling call
0709 13:10:25.084305 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.212611 (+128306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.212654 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.229637 (+ 16983us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.514847 (+285210us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:25.514905 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.723131 (+2208226us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400668d54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:27.723180 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.292762 (+569582us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:28.453938 (+161176us) raft_consensus.cc:1685] finished
0709 13:10:28.453962 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.454109 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5200,"raft.queue_time_us":7018,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5172,"spinlock_wait_cycles":305190144,"thread_start_us":201613,"threads_started":1,"wal-append.queue_time_us":591102}
I20260709 13:10:28.464092 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:28.492884 26502 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:28.453949 29312 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:28.449530 29110 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.397895 29325 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.484717 29095 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.502306 29095 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.506299 29095 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:28.506887 29497 log.cc:927] Time spent T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:28.508061 29460 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.508975 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 732) took 2374 ms. Trace:
I20260709 13:10:28.509176 29454 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.509387 27276 rpcz_store.cc:276] 0709 13:10:26.134277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.459266 (+324989us) service_pool.cc:224] Handling call
0709 13:10:26.471394 (+ 12128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.140658 (+669264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.508717 (+1368059us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b5400600254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:28.508917 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534639488}
I20260709 13:10:28.509960 29325 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.510558 29325 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:28.510753 29400 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:28.512178 29389 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.492162 29410 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:28.392777 29415 consensus_queue.cc:237] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:28.451465 29352 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:28.521703 26583 raft_consensus.cc:2410] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:28.523356 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.524698 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.527110 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.456910 29166 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.530843 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.531701 26581 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
W20260709 13:10:28.506953 29494 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:10:28.535651 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.540239 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.542222 26576 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:28.455770 29430 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:10:28.566001 26502 raft_consensus.cc:2410] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:10:28.528458 29349 consensus_meta.cc:287] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.005s
I20260709 13:10:28.568567 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.569176 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:28.622907 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.627390 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.597538 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.619714 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.631359 26576 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:28.629808 26583 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:28.633477 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:28.635298 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 182444us
I20260709 13:10:28.530375 29110 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:28.640308 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.638237 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.642526 26502 raft_consensus.cc:2393] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:28.640956 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.638480 26583 raft_consensus.cc:2393] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:28.643271 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.644872 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:28.633745 29311 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:28.645228 26576 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:28.647257 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.529980 29352 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.563385 29166 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:28.648983 26578 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:28.659318 26581 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:28.660434 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.662174 26576 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:10:28.664918 29398 consensus_meta.cc:287] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
I20260709 13:10:28.664942 26584 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:28.634826 29349 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:28.818940 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 733) took 2684 ms. Trace:
I20260709 13:10:28.867111 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:28.950580 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.773232 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.735447 26581 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:28.733206 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.701762 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2571) took 3415 ms. Trace:
W20260709 13:10:28.769788 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.861995 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:28.882210 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.985985 26548 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:28.918205 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1757) took 1150 ms. Trace:
W20260709 13:10:28.677083 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.918529 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 474242us
I20260709 13:10:28.907130 26655 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:28.988415 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:28.986647 26651 rpcz_store.cc:276] 0709 13:10:27.776285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.123822 (+347537us) service_pool.cc:224] Handling call
0709 13:10:28.133180 (+  9358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.133388 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:28.134059 (+   671us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.917760 (+783701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.917829 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:28.917889 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.917974 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.918136 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":590892,"prepare.queue_time_us":247,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":591685,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5676,"thread_start_us":192362,"threads_started":1,"wal-append.queue_time_us":256605}
I20260709 13:10:28.882768 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:28.989684 26507 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:28.875298 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:27.896085 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 057c1e97d7fb407aaf9cf119a0b63a37 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:10:28.917143 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.881779 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.669864 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.992498 26508 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:28.992990 26583 raft_consensus.cc:2410] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:28.671906 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:28.993422 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2007) took 1023 ms. Trace:
I20260709 13:10:28.982888 26577 rpcz_store.cc:276] 0709 13:10:25.259953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.738969 (+479016us) service_pool.cc:224] Handling call
0709 13:10:25.769613 (+ 30644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.065171 (+1295558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.674719 (+1609548us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540015ca54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:28.674926 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2960681856}
I20260709 13:10:28.994065 26508 rpcz_store.cc:276] 0709 13:10:27.969996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.998301 (+ 28305us) service_pool.cc:224] Handling call
0709 13:10:28.881630 (+883329us) spinlock_profiling.cc:243] Waited 886 us on lock 0x7b5800010598. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:10:28.993277 (+111647us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2038656}
I20260709 13:10:28.996393 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:28.646696 29356 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.876713 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1786) took 1207 ms. Trace:
I20260709 13:10:29.007685 26474 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:28.995186 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.012404 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.022346 26576 raft_consensus.cc:2393] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:29.022306 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:28.861471 29417 raft_consensus.cc:3055] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:29.019158 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:28.981454 27277 rpcz_store.cc:276] 0709 13:10:26.134571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.677539 (+542968us) service_pool.cc:224] Handling call
0709 13:10:26.769224 (+ 91685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.890730 (+121506us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:27.345546 (+454816us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.485383 (+139837us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:27.485457 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:27.485523 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.818642 (+1333119us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54005aafd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:28.818697 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.818860 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12206,"prepare.queue_time_us":499469,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":87930,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":49643,"spinlock_wait_cycles":278883712,"thread_start_us":576303,"threads_started":2,"wal-append.queue_time_us":350422,"wal-append.run_cpu_time_us":1355,"wal-append.run_wall_time_us":1001377}
W20260709 13:10:29.031879 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 45984.1us
I20260709 13:10:28.770329 29352 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.022825 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.018597 26655 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:29.068264 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.058383 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.882120 29227 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.068471 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:28.948570 28956 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:28.905797 29110 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:28.940635 29378 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:29.065599 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 58690.6us
I20260709 13:10:29.094022 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:29.093797 29378 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:29.094432 26658 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1751) took 5219 ms (client timeout 1999 ms). Trace:
I20260709 13:10:29.095036 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:29.094930 26658 rpcz_store.cc:269] 0709 13:10:23.874663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.874790 (+   127us) service_pool.cc:224] Handling call
0709 13:10:29.094208 (+5219418us) spinlock_profiling.cc:243] Waited 4.26 s on lock 0x7b5400167e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:29.094324 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9790780160}
I20260709 13:10:29.064078 26577 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:29.096437 29378 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.097404 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:29.067564 29387 consensus_meta.cc:287] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
I20260709 13:10:29.098359 29387 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:29.098580 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:29.099469 29387 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:29.099876 29505 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:29.100068 29387 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:29.100656 29505 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:29.016059 29430 consensus_queue.cc:1059] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:10:29.101651 29505 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:29.016423 26393 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 1.12043e+06us
I20260709 13:10:29.069460 29417 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:29.103888 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2566) took 3892 ms. Trace:
I20260709 13:10:29.104306 26578 rpcz_store.cc:276] 0709 13:10:25.211493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.688397 (+476904us) service_pool.cc:224] Handling call
0709 13:10:25.691957 (+  3560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.659479 (+2967522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.103594 (+444115us) spinlock_profiling.cc:243] Waited 2.96 s on lock 0x7b54003dfed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:29.103823 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6799235328}
I20260709 13:10:29.104449 29417 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.070586 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.068428 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.107375 26581 raft_consensus.cc:2410] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:29.108285 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.108956 26581 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:28.948807 29449 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:28.779991 29350 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.078636 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:29.122195 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 43674.4us
I20260709 13:10:29.122855 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1775) took 3228 ms. Trace:
I20260709 13:10:29.123731 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:29.072918 26509 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:29.069495 29504 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:28.846261 28986 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.080443 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.019124 29166 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.127441 26585 raft_consensus.cc:2410] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:28.874028 29452 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.084395 29361 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:29.135116 29361 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:29.135507 29361 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:29.138314 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:28.754410 29311 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.140102 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:29.140518 28956 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:29.066319 26656 rpcz_store.cc:276] 0709 13:10:27.669049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.669225 (+   176us) service_pool.cc:224] Handling call
0709 13:10:27.669540 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.669809 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:27.971903 (+302094us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.998642 (+ 26739us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.778735 (+780093us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18002c7d00. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:28.875997 (+ 97262us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b18002c7d00. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f882c921060 00007f882c933716 00007f882c944287 00007f882c944208
0709 13:10:28.876198 (+   201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.876267 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:28.876366 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.876464 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.876636 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":872201,"prepare.queue_time_us":255600,"prepare.run_cpu_time_us":173,"prepare.run_wall_time_us":176,"raft.queue_time_us":882335,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":7281,"spinlock_wait_cycles":8805504,"thread_start_us":314041,"threads_started":2,"wal-append.queue_time_us":72293}
I20260709 13:10:29.101861 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:29.096385 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.142166 26658 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:29.081135 29427 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.142401 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.143358 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.143090 29427 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.143972 26658 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:29.144574 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.144882 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.064630 29348 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:29.073675 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:29.115850 26507 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:28.773862 29380 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:29.145977 26655 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.146267 26656 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:29.146556 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.147362 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.147740 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.148044 26656 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:29.148523 26507 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:29.146570 26658 raft_consensus.cc:2410] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 7 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:29.118310 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:29.149318 26505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 1980) took 3093 ms (client timeout 2025 ms). Trace:
I20260709 13:10:28.881418 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 457) took 3804 ms. Trace:
I20260709 13:10:29.149641 26659 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:29.149340 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.079042 29356 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.150780 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:29.151309 26659 raft_consensus.cc:2376] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5. Re-sending same reply.
I20260709 13:10:29.152200 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:29.152655 26659 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:29.153084 26577 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.149197 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:29.153844 26656 raft_consensus.cc:2376] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5. Re-sending same reply.
I20260709 13:10:29.132084 29406 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.132884 29504 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:29.134377 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.138695 29453 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.077544 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.119079 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:29.163596 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.149782 26505 rpcz_store.cc:269] 0709 13:10:26.055611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.055718 (+   107us) service_pool.cc:224] Handling call
0709 13:10:29.149101 (+3093383us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002fc454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:29.149227 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3486762752}
I20260709 13:10:29.200031 26503 raft_consensus.cc:2376] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6. Re-sending same reply.
I20260709 13:10:29.149816 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.200783 26581 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:29.154731 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.154984 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.020798 29349 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.203809 26548 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:29.204259 26658 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:29.205039 26548 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:29.205961 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:29.206302 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:29.142674 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:29.200146 26508 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:29.123390 26657 rpcz_store.cc:276] 0709 13:10:25.882926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.055323 (+172397us) service_pool.cc:224] Handling call
0709 13:10:26.066433 (+ 11110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.556600 (+490167us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:27.532849 (+976249us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.880432 (+1347583us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.880509 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:28.880573 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.110615 (+230042us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54001027d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:29.110663 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.110881 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":881442,"prepare.queue_time_us":1265185,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":882414,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":50,"spinlock_wait_cycles":940822400,"thread_start_us":1266192,"threads_started":2,"wal-append.queue_time_us":457429,"wal-append.run_cpu_time_us":1085,"wal-append.run_wall_time_us":1001115}
I20260709 13:10:29.198714 26507 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:28.934468 29458 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.184s
I20260709 13:10:29.202347 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:28.781183 29410 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.205086 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.227783 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:29.207917 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.160420 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.229053 26584 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:29.229782 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:29.180867 26655 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:29.230404 27276 raft_consensus.cc:2376] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7. Re-sending same reply.
I20260709 13:10:29.230355 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.232530 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.233939 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:29.236182 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:29.237720 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:29.198786 29417 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.241717 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:29.241739 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.243064 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:29.243602 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.243958 27273 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:29.244405 26508 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:29.198246 29406 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.241739 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.222452 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.223994 26656 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:29.247469 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.247725 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.248081 26509 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:29.225852 26659 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
W20260709 13:10:29.226178 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.120157 29306 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.228011 26658 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:29.208585 26651 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:29.218206 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.246596 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.251545 26508 raft_consensus.cc:2376] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7. Re-sending same reply.
W20260709 13:10:29.246433 29411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.241s	user 0.026s	sys 0.056s
I20260709 13:10:29.252820 29110 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:29.253670 29110 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:29.253885 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.255312 26656 raft_consensus.cc:2410] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:29.101302 29387 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.262379 27243 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.216492 29348 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.264235 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.248895 26655 raft_consensus.cc:2410] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:29.265424 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:29.266077 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 182791us
I20260709 13:10:29.267096 26659 raft_consensus.cc:2410] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:29.232812 29166 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:29.272317 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.273022 26507 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:29.116318 29227 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.266479 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:29.263221 29411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.279s	user 0.026s	sys 0.056s
I20260709 13:10:29.232959 29350 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:29.252306 29406 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.251399 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:29.275033 26622 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:29.284272 26658 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:29.276918 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.285238 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.268518 26504 raft_consensus.cc:2393] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:29.266227 29282 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.228219 29407 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:10:29.294554 26501 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:10:29.304229 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 76506.8us
I20260709 13:10:29.305537 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:29.307114 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.308029 26507 raft_consensus.cc:2410] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:29.305364 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.296111 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.292217 27240 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:29.310621 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:29.312183 26509 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:29.305545 26548 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.313881 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:29.314139 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.315243 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.318660 27240 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.321766 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.322418 26507 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:29.314450 26548 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.274178 29458 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.324400 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:29.320858 26651 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:29.329434 26655 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:29.331916 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 93676.7us
I20260709 13:10:29.331723 27240 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.291406 29475 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:29.290548 29427 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.333199 29274 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.351787 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.360174 26509 raft_consensus.cc:2393] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:29.352065 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 89772.3us
I20260709 13:10:29.266140 29306 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.343501 26657 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:29.327368 29386 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.365373 27278 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:29.327679 29238 raft_consensus.cc:2764] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:29.361470 26659 raft_consensus.cc:3055] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:29.385601 26659 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:29.329533 29350 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:29.327152 29391 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:10:29.386907 26622 leader_election.cc:336] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.602s (SENT)
I20260709 13:10:29.390003 26507 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:29.364114 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.350276 29348 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.352108 29475 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:29.353271 29378 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:10:29.358289 29274 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.360538 26476 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:29.416057 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 55586.3us
I20260709 13:10:29.416694 26476 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.327342 29389 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:10:29.366580 29123 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:29.410559 26509 pending_rounds.cc:85] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 3
I20260709 13:10:29.417863 26476 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.418190 26509 pending_rounds.cc:107] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:10:29.418581 26509 raft_consensus.cc:2889] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:29.414870 26502 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:29.365386 29386 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:29.418591 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.426527 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.384486 29427 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.346415 29458 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.426744 26476 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:29.430344 26510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 1971) took 4398 ms (client timeout 1970 ms). Trace:
W20260709 13:10:29.427235 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.383464 29356 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.391335 26659 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.389396 29350 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:29.433171 26651 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:29.434405 26476 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:29.430728 26510 rpcz_store.cc:269] 0709 13:10:25.015832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.025005 (+  9173us) service_pool.cc:224] Handling call
0709 13:10:29.414413 (+4389408us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b540022f454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:29.414556 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4529309952}
W20260709 13:10:29.438294 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.408918 29404 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.410907 29475 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:29.384858 29450 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:10:29.402536 29348 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.442976 26476 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:29.443641 29430 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:29.389937 29110 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.429100 29386 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.428602 29448 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.434405 29311 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:29.477710 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 108909us
I20260709 13:10:29.425480 29274 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.391162 29361 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:29.480553 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 148926us
I20260709 13:10:29.488595 26510 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:29.432835 29349 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.434599 29452 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.353355 29504 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.439617 29350 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.480741 26476 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.425097 29376 consensus_queue.cc:1059] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:10:29.445312 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 462) took 2539 ms. Trace:
I20260709 13:10:29.499354 27240 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.436362 29411 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.478494 29348 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.510536 27271 rpcz_store.cc:276] 0709 13:10:26.905734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.428909 (+2523175us) service_pool.cc:224] Handling call
0709 13:10:29.444727 (+ 15818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.444924 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.444953 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.445008 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:29.445056 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.445127 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.445249 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:29.432986 29352 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:10:29.501549 26577 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:29.485219 29448 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.475018 29404 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:29.519176 29516 log.cc:927] Time spent T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:10:29.519459 29449 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:29.519846 29361 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.485719 29505 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.435837 29427 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.503652 29410 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.155859 27269 rpcz_store.cc:276] 0709 13:10:25.076977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.404938 (+327961us) service_pool.cc:224] Handling call
0709 13:10:25.575448 (+170510us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:26.166711 (+591263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.166756 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:26.315101 (+148345us) log.cc:844] Serialized 52 byte log entry
0709 13:10:27.202140 (+887039us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:27.202208 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.202305 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.636262 (+1433957us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b18004022e0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:28.817313 (+181051us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b540069b7a0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c89edbe 00007f882c8a9930 00007f882c8a98d8 00007f882c8a9858 00007f882c8a9813 00007f882c8a8a9c 00007f8832794626 00007f883278edd8 00007f882c8e57cb 00007f882c8e82c0
0709 13:10:28.817712 (+   399us) raft_consensus.cc:1685] finished
0709 13:10:28.817755 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.881347 (+ 63592us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":281073,"raft.queue_time_us":407488,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5081,"spinlock_wait_cycles":108214912,"thread_start_us":936925,"threads_started":2,"wal-append.queue_time_us":869498}
I20260709 13:10:29.508666 29521 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.517226 29311 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:29.509714 29349 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.522205 29448 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:29.578151 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 149395us
I20260709 13:10:29.587723 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.588825 26651 raft_consensus.cc:2410] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:10:29.593390 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 83882.8us
I20260709 13:10:29.595000 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:29.571444 29505 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:29.606643 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 120587us
I20260709 13:10:29.581238 29376 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.613318 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 114119us
I20260709 13:10:29.614162 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.615092 26548 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.586366 29227 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:29.618907 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 225438us
I20260709 13:10:29.594619 29385 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.597776 29282 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:29.618434 26548 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.629258 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:29.591078 29523 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.597147 29306 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.584079 29450 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:10:29.634034 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:29.604666 29505 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.634994 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:29.605417 29391 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:29.651121 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2480) took 1161 ms. Trace:
I20260709 13:10:29.651623 26502 rpcz_store.cc:276] 0709 13:10:28.489902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.645098 (+155196us) service_pool.cc:224] Handling call
0709 13:10:29.414565 (+769467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.419248 (+  4683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.650891 (+231643us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b540022f450. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:29.651052 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754878336}
I20260709 13:10:29.645816 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:29.597084 29352 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:10:29.646939 29517 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:10:29.647083 29306 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:29.647485 29404 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.619010 29150 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:29.647743 29309 consensus_queue.cc:260] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.616034 29376 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.656306 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:29.661057 26622 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.675789 27271 raft_consensus.cc:1813] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Handling vote request from an unknown peer ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.676519 27271 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:29.676425 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:29.677606 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.664547 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:29.678763 27274 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:29.666203 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:29.666524 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:29.666594 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2481) took 1143 ms. Trace:
I20260709 13:10:29.679354 27277 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:29.650079 29385 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:29.670372 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.679497 27273 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:29.679422 26508 rpcz_store.cc:276] 0709 13:10:28.523406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.346792 (+823386us) service_pool.cc:224] Handling call
0709 13:10:29.355071 (+  8279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.355353 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:29.578630 (+223277us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.666264 (+ 87634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.666315 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:29.666365 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.666425 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.666537 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":258198,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":3935,"thread_start_us":275472,"threads_started":2}
I20260709 13:10:29.684928 26508 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:29.656224 29533 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.667539 29227 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:29.662614 29166 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:29.685002 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.650596 29452 consensus_queue.cc:1059] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:29.662823 29528 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:29.667299 29458 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:29.676043 29450 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:29.696406 26653 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:29.675475 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:29.683077 29385 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:29.703359 27278 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
W20260709 13:10:29.707957 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 89582.5us
I20260709 13:10:29.678354 29404 consensus_queue.cc:1059] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:10:29.693135 29227 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:29.696056 29166 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.714336 27271 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:10:29.723069 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 1988) took 2828 ms. Trace:
I20260709 13:10:29.703430 29442 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:29.707046 29450 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:29.711127 29385 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:29.724367 29227 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:29.712190 29391 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.715778 29458 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:29.707508 29414 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:10:29.746284 29530 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:10:29.747367 29511 log.cc:927] Time spent T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
I20260709 13:10:29.710328 29150 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:29.747839 29386 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.748675 29150 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.710888 27270 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.753005 29123 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:29.725291 29522 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:10:29.731304 29178 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:10:29.753494 29123 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:29.734174 29427 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.732400 29238 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:10:29.726536 26501 rpcz_store.cc:276] 0709 13:10:26.894476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.084420 (+189944us) service_pool.cc:224] Handling call
0709 13:10:27.129484 (+ 45064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.304443 (+2174959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.722741 (+418298us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400194e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:29.723006 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4978580864}
I20260709 13:10:29.714387 29527 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:29.758054 29527 raft_consensus.cc:697] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:29.759004 29527 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.761965 29352 raft_consensus.cc:3055] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:29.762398 29352 raft_consensus.cc:740] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:29.763185 29352 consensus_queue.cc:260] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.764295 29352 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:29.765205 29417 consensus_meta.cc:287] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.001s
I20260709 13:10:29.765595 29546 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:29.721326 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.705696 27269 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:29.725732 29166 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:29.704239 29309 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:29.704965 29528 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.736423 29450 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.742627 29378 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:29.747611 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2484) took 1106 ms. Trace:
I20260709 13:10:29.766052 29546 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.784891 26509 rpcz_store.cc:276] 0709 13:10:28.640845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.386533 (+745688us) service_pool.cc:224] Handling call
0709 13:10:29.410360 (+ 23827us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:29.434302 (+ 23942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.434354 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:29.435202 (+   848us) log.cc:844] Serialized 52 byte log entry
0709 13:10:29.588236 (+153034us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:29.663361 (+ 75125us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.663681 (+   320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.663759 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.747376 (+ 83617us) raft_consensus.cc:1685] finished
0709 13:10:29.747396 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.747553 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4114,"prepare.queue_time_us":96629,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":4349,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":22182,"thread_start_us":165221,"threads_started":2,"wal-append.queue_time_us":205936}
W20260709 13:10:29.788878 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.769551 29123 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.794814 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2591) took 1039 ms. Trace:
I20260709 13:10:29.795203 26576 rpcz_store.cc:276] 0709 13:10:28.755220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.789494 (+ 34274us) service_pool.cc:224] Handling call
0709 13:10:29.794588 (+1005094us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54002a9ed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:29.794752 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81815936}
I20260709 13:10:29.796622 26583 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:29.797832 29386 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.765241 29505 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.800340 29505 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.791357 29546 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:29.801733 29349 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.803618 29406 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.808878 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:29.810757 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.801306 27241 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.782995 29493 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:29.822520 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 203028us
I20260709 13:10:29.814795 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:29.814893 29348 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.815542 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.824443 26657 raft_consensus.cc:2393] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:29.818204 29475 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:29.788308 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 113215us
W20260709 13:10:29.821638 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.821858 27241 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:29.840032 27241 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:10:29.791592 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 114108us
I20260709 13:10:29.804581 29535 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:29.825407 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.839670 26549 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.786628 29528 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:29.843257 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.846628 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.851816 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.852798 26622 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.850539 27241 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.854633 27241 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.823320 29386 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:29.856069 26549 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.857300 26549 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:29.822768 29493 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:29.859068 26549 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:29.862576 29414 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:29.823423 29274 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.863937 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.864662 26503 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:29.865214 29274 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.865875 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:29.867749 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.868847 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.872057 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2479) took 1419 ms. Trace:
I20260709 13:10:29.872479 26504 rpcz_store.cc:276] 0709 13:10:28.452640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.490305 (+ 37665us) service_pool.cc:224] Handling call
0709 13:10:29.871866 (+1381561us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54000023d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:29.871986 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677161728}
I20260709 13:10:29.850754 29378 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:29.874794 29507 log.cc:927] Time spent T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 1.105s	user 0.001s	sys 0.002s
I20260709 13:10:29.874962 29348 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.878499 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:29.880244 29385 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.881376 26651 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:29.882422 27272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 761) took 4806 ms. Trace:
I20260709 13:10:29.882572 29385 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:29.883630 29513 log.cc:927] Time spent T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.533s	user 0.000s	sys 0.001s
I20260709 13:10:29.883817 29406 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.848692 29350 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.855520 29539 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.885731 29539 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.886813 29350 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.848006 29419 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.848753 29538 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.888170 29419 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.888343 29538 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:29.888643 29419 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.888805 29538 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.890267 26509 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:29.890949 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.891602 26501 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:29.841725 29535 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:29.885306 29520 log.cc:927] Time spent T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 13:10:29.882928 27272 rpcz_store.cc:276] 0709 13:10:25.075724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.084468 (+  8744us) service_pool.cc:224] Handling call
0709 13:10:26.395577 (+1311109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.698319 (+1302742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.874045 (+1175726us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400845154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:29.882174 (+1008129us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400845150. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:29.882318 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5821028992}
I20260709 13:10:29.884981 29430 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.893124 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.897921 26507 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:10:29.898859 26505 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:10:29.902899 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 50174.3us
I20260709 13:10:29.855335 29238 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.900876 29414 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:29.858475 29526 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.898995 29036 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:29.855304 29547 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.893882 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.860860 29417 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:29.914402 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.909267 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.903687 26549 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:29.858264 29533 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.915973 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:29.916740 26508 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:29.919190 26548 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.920768 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:29.925709 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.926563 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:29.928642 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:29.913846 29523 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.910487 29274 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.932673 27276 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:29.914893 29547 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.932608 26549 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.931455 26622 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.937321 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:29.936112 26549 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.935920 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:29.939443 27277 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
W20260709 13:10:29.944862 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.920589 29414 raft_consensus.cc:697] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:29.938117 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.937668 29361 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:29.957108 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:29.957111 27243 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:29.957737 27276 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.958622 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:29.959385 29178 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:29.929423 29036 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:10:29.960286 29352 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.961225 29406 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:29.961961 29406 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:29.956523 29361 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.963024 29361 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:29.962929 29406 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.930775 29549 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:29.968652 26549 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:29.970368 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:29.932911 29539 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:29.961349 29352 raft_consensus.cc:3055] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:29.929613 27270 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:29.927629 29350 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:10:29.972693 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.946808 29465 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.940980 29385 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:29.973244 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.973330 26652 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:29.947046 29378 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:29.984642 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:29.940148 29547 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.997192 26654 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:29.951063 29417 raft_consensus.cc:697] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:30.000577 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:29.959331 29123 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.983050 29545 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:10:30.007696 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:29.929136 29493 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.011896 29493 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:30.013650 29414 consensus_queue.cc:237] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.017153 29274 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.999544 26656 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.994736 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2489) took 1078 ms. Trace:
I20260709 13:10:29.983487 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:30.020228 27277 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:30.008781 29538 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.020463 26580 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:29.995865 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:29.968828 29523 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:10:30.024844 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.025733 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 564) took 1061 ms. Trace:
I20260709 13:10:29.974702 29352 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:29.974924 29178 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:29.973199 29348 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:30.031104 26581 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:30.028585 26584 rpcz_store.cc:276] 0709 13:10:28.964345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.229777 (+265432us) service_pool.cc:224] Handling call
0709 13:10:29.230083 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.230939 (+   856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.230964 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.248380 (+ 17416us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.366195 (+117815us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:29.386068 (+ 19873us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.415012 (+ 28944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.415080 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.884750 (+469670us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:30.019329 (+134579us) raft_consensus.cc:1685] finished
0709 13:10:30.025476 (+  6147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.025655 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33670,"prepare.queue_time_us":19702,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":29781,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":30808,"spinlock_wait_cycles":12598528,"thread_start_us":112001,"threads_started":1,"wal-append.queue_time_us":242029}
I20260709 13:10:29.996731 29404 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:29.998818 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.034636 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:30.040114 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.995446 27276 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:30.041612 26506 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:30.019997 26510 rpcz_store.cc:276] 0709 13:10:28.916636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.505156 (+588520us) service_pool.cc:224] Handling call
0709 13:10:29.505426 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.505679 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:29.618349 (+112670us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.970958 (+352609us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b1800278020. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882c4d14bc 00007f882981f48b 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c923a
0709 13:10:29.994360 (+ 23402us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.994416 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:29.994464 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.994530 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.994674 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2033,"prepare.queue_time_us":151407,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":23313,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5781,"spinlock_wait_cycles":10564992,"thread_start_us":162633,"threads_started":2,"wal-append.queue_time_us":123987}
I20260709 13:10:30.043664 29117 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.048696 29450 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.048856 29117 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.049522 29282 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:30.050067 29282 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:30.052584 29117 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:29.996996 29546 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.054893 29352 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.055650 29546 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:30.056376 29352 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:30.056784 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.057229 29482 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:30.041775 29404 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:30.061889 29512 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.771s	user 0.003s	sys 0.000s
I20260709 13:10:30.062111 29404 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.999378 29378 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.063306 29378 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:30.063382 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1794) took 2300 ms. Trace:
I20260709 13:10:30.022264 29475 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:30.063788 26650 rpcz_store.cc:276] 0709 13:10:27.762971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.064422 (+301451us) service_pool.cc:224] Handling call
0709 13:10:28.070704 (+  6282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.933429 (+862725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.933487 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.934133 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.074324 (+140191us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:29.074366 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.074444 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.061268 (+986824us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:30.063077 (+  1809us) raft_consensus.cc:1685] finished
0709 13:10:30.063097 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.063320 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":862221,"raft.queue_time_us":868723,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2305,"spinlock_wait_cycles":138089728,"thread_start_us":99300,"threads_started":1,"wal-append.queue_time_us":261408}
I20260709 13:10:30.065467 29166 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.066834 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:30.066969 29178 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:30.067562 29166 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.067631 29178 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:29.974974 29227 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.073912 26576 raft_consensus.cc:2368] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7.
I20260709 13:10:30.075604 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:30.076119 26656 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:30.076449 26650 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:29.968391 29448 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:29.997849 29110 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:30.080873 29356 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:30.079828 29538 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.106226 26507 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:30.114441 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.083527 27270 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:30.118425 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 180362us
I20260709 13:10:30.122692 26577 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:30.104779 29110 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.126703 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:30.138007 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:30.138111 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:30.138985 26652 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:30.138104 26650 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:30.140136 26504 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:30.138967 26508 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:30.107564 29356 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:30.145787 29227 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:30.146061 29361 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.146178 29356 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.148469 27271 raft_consensus.cc:2955] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:30.150862 29450 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:30.157593 29178 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.159377 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:30.159965 26657 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:30.162889 29448 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:30.163628 29448 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:30.164296 29448 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.103039 29417 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.166293 26657 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:30.167192 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:30.168764 26650 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:30.169821 27277 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
W20260709 13:10:30.175269 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.180722 29348 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:30.183476 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:30.184118 26504 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:30.139075 29110 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:30.185492 26473 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:30.188010 26473 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:30.197221 29504 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:30.198820 29117 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:30.201531 29504 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.201877 29117 raft_consensus.cc:697] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:30.202042 29504 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:30.178735 29528 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.204273 26650 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:30.153393 29419 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.185310 29356 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:30.208532 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.184353 29178 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:30.229005 26508 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:30.231128 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:30.236301 26508 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:30.239771 26504 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:30.201345 29465 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:30.241753 26509 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:30.242671 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:30.185140 29547 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.245831 26501 raft_consensus.cc:2410] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:30.186009 29404 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.249854 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 556) took 1378 ms. Trace:
I20260709 13:10:30.250293 26583 rpcz_store.cc:276] 0709 13:10:28.871328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.083441 (+212113us) service_pool.cc:224] Handling call
0709 13:10:29.796460 (+713019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.797016 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.249647 (+452631us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54002a9ed0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:30.249797 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638831360}
I20260709 13:10:30.230193 29342 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:30.234023 29178 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:30.262195 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.333915 26473 leader_election.cc:336] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.534s (SENT)
I20260709 13:10:30.338769 29448 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:30.339721 29378 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.340662 26577 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:30.376819 29506 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.606s	user 0.002s	sys 0.002s
I20260709 13:10:30.399952 29528 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.401651 29178 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:30.351070 29342 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.403997 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:30.405057 29482 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:30.405714 29342 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:30.356884 26622 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:30.357383 29458 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:30.363934 26659 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:30.368902 29547 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:30.409927 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 53108.2us
I20260709 13:10:30.410938 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:30.412189 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:30.413682 26579 raft_consensus.cc:2410] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:10:30.370709 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2574) took 1912 ms. Trace:
I20260709 13:10:30.414543 26580 rpcz_store.cc:276] 0709 13:10:28.458555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.120811 (+662256us) service_pool.cc:224] Handling call
0709 13:10:30.020257 (+899446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.027524 (+  7267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.370526 (+343002us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54002f03d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:30.370652 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881080064}
I20260709 13:10:30.373946 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:30.365032 29361 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.299079 29282 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.374785 26652 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:30.417907 26548 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:30.419535 26506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 364) took 2076 ms (client timeout 2177 ms). Trace:
W20260709 13:10:30.420116 26506 rpcz_store.cc:269] 0709 13:10:28.343489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.412058 (+ 68569us) service_pool.cc:224] Handling call
0709 13:10:30.419326 (+2007268us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54002fba54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:30.419461 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3654623616}
I20260709 13:10:30.374989 29538 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:30.375919 29376 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:30.376055 29404 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.425652 26659 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:30.376223 29532 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:30.353166 29503 log.cc:927] Time spent T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.598s	user 0.009s	sys 0.005s
I20260709 13:10:30.383626 29477 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.384992 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 632) took 1609 ms. Trace:
I20260709 13:10:30.206897 29117 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:30.391366 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 57488.9us
I20260709 13:10:30.205308 29348 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.395833 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:30.395495 29535 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.506827 29535 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:30.425379 26625 connection.cc:256] RPC call timeout handler was delayed by -1.3007635760000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 13:10:30.424273 26622 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:10:30.351366 29561 log.cc:927] Time spent T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.145s	user 0.000s	sys 0.002s
I20260709 13:10:30.435478 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1812) took 1219 ms. Trace:
I20260709 13:10:30.438226 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:30.439046 26655 rpcz_store.cc:276] 0709 13:10:28.775597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.283555 (+507958us) service_pool.cc:224] Handling call
0709 13:10:29.329238 (+ 45683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.329918 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.384791 (+1054873us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b5400106650. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:30.384931 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104123776}
I20260709 13:10:30.509298 26503 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:30.508656 26625 connection.cc:256] RPC call timeout handler was delayed by -1.2683635759999561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 13:10:30.420608 26548 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:30.512152 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 91603.5us
W20260709 13:10:30.512908 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 88710.3us
I20260709 13:10:30.395560 29378 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:30.409946 29458 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:30.435111 29546 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:30.514000 26659 rpcz_store.cc:276] 0709 13:10:29.216567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.340781 (+124214us) service_pool.cc:224] Handling call
0709 13:10:29.361349 (+ 20568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.363424 (+1002075us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5800770fd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8850aa 00007f882c907447 00007f882c91ffe7 00007f882c9217de 00007f882c92bb49 00007f882c92c416 00007f882c928d8f 00007f882c92883e 00007f88318ed419 00007f882ae64bd4
0709 13:10:30.435137 (+ 71713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.435426 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429323136}
W20260709 13:10:30.522909 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 142971us
I20260709 13:10:30.517510 26501 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:30.436370 29527 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:30.434289 29166 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.517843 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:30.521926 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:30.435716 29389 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:30.434655 29547 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:30.524358 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:30.534626 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 130795us
W20260709 13:10:30.537923 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.437817 29526 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:30.530366 26652 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:30.546183 26503 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:30.530956 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:30.546204 29546 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:30.437343 29380 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:10:30.509497 29419 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.435954 29036 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:10:30.546397 29526 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:30.548192 26548 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:30.531910 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:30.436410 29532 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:30.550994 26507 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:30.435103 29482 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:10:30.436163 29274 consensus_queue.cc:1059] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:10:30.520959 29342 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.518671 29376 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:30.436535 29227 consensus_queue.cc:1059] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:10:30.518586 29385 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:30.552675 29523 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.548942 29465 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:30.510301 29110 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.529767 29527 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.552721 29410 raft_consensus.cc:2764] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:10:30.587412 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:30.596491 27277 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:30.565182 26581 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:30.599288 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:30.547654 29546 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.562120 29389 raft_consensus.cc:697] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:30.602352 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 90964.5us
I20260709 13:10:30.556526 29547 raft_consensus.cc:697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:30.603161 26625 connection.cc:256] RPC call timeout handler was delayed by -1.1027635759999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 13:10:30.604751 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:30.605492 27276 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:30.549927 29166 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.606540 27240 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:30.594193 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:30.592049 29376 raft_consensus.cc:697] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:30.631470 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.631932 26625 connection.cc:256] RPC call timeout handler was delayed by -1.0351571760002116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:10:30.594444 29378 raft_consensus.cc:3055] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:30.597245 29527 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:30.594074 29303 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.633854 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:30.634729 26655 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:30.634619 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:30.646682 27275 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:30.633868 26659 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:30.645040 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 131385us
I20260709 13:10:30.646708 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:30.649827 29303 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.585089 29342 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.549074 29526 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.652659 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:30.556041 29430 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:10:30.653457 26650 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:30.655273 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:30.653995 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:30.657169 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.654241 26655 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:30.657809 26657 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:30.609014 29385 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:30.604208 29533 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.632118 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:30.659571 27273 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:30.662314 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:30.634071 29378 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:30.595063 29523 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.659358 26654 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:30.667032 26659 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:30.665913 26650 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:30.602120 29465 raft_consensus.cc:697] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:30.664623 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:30.652079 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:30.703135 26651 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:30.673415 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:30.677722 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:30.714797 29566 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:10:30.715546 29303 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.716239 29303 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:30.716593 29303 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:30.716985 29303 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:30.597343 29458 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.718089 29458 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:30.596977 29532 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.721248 29532 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:30.723328 29465 consensus_queue.cc:237] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.725737 29376 consensus_queue.cc:237] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:30.728435 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.728833 29547 consensus_queue.cc:237] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:30.733515 27274 raft_consensus.cc:2410] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:30.735018 29523 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.737747 27276 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:30.712329 27275 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:30.750424 27276 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:30.663519 29282 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.732296 29385 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:30.754221 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 147963us
I20260709 13:10:30.725423 29380 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:30.762362 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:30.670672 29533 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.749636 29309 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.790580 29282 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:30.819890 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.828245 29303 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.799422 29309 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.796887 29570 consensus_queue.cc:1059] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:30.834169 29342 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:30.791814 29453 raft_consensus.cc:3055] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:30.757822 29389 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:30.804299 29504 consensus_meta.cc:287] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.004s
I20260709 13:10:30.838892 29533 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:30.839548 27272 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:30.788558 29378 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.801795 29282 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:30.845633 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 181084us
I20260709 13:10:30.828972 29527 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.853695 26625 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:30.857460 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:30.860190 26625 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:30.865705 26625 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:30.870927 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:30.871802 26577 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:30.848461 29453 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:30.879923 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:30.882128 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.857126 29282 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:30.861068 27270 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:30.929988 26577 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
W20260709 13:10:30.973026 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 209125us
I20260709 13:10:30.986020 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:30.862020 29575 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:30.882810 29458 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:30.850939 29504 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:30.861179 29450 consensus_queue.cc:1059] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:10:30.921550 29535 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:31.028733 29303 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:30.873946 29572 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.174s
W20260709 13:10:31.045105 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.024051 29430 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:31.027254 29458 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:31.049125 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.046103 29477 consensus_meta.cc:287] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.002s
W20260709 13:10:31.262234 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.041898 29309 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:31.046932 29303 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:31.039953 29576 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:31.315802 26510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.023s	sys 0.036s
I20260709 13:10:31.247825 29458 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:31.326037 26510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.023s	sys 0.037s
I20260709 13:10:31.043628 29535 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.344929 26582 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 2.
W20260709 13:10:31.325521 27242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.028s	sys 0.052s
W20260709 13:10:31.346590 27242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.028s	sys 0.052s
I20260709 13:10:31.317971 29342 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.040360 29453 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.320820 29578 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.318096 29576 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:31.334250 29546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.026s	sys 0.038s
I20260709 13:10:31.346093 29548 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.360788 29453 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:31.246786 29430 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:31.358723 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 493107us
I20260709 13:10:31.337548 29303 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:31.362848 29579 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 13:10:31.375551 26625 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.384588 29548 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.363914 29342 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.403404 26476 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.401388 29376 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:31.388765 29546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.026s	sys 0.039s
I20260709 13:10:31.366786 29385 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:31.398772 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.443887 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.444512 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.429922 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.013s	sys 0.046s
I20260709 13:10:31.409214 29527 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:31.446106 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.014s	sys 0.046s
I20260709 13:10:31.451982 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:31.408655 29410 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:31.458016 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.370362 29578 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:31.430454 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 441967us
W20260709 13:10:31.438424 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 62988.6us
I20260709 13:10:31.401695 29303 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.452134 26509 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:31.446902 26577 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:31.452597 26503 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:31.465411 26506 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:31.466516 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:31.454010 26508 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:31.467229 26578 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:31.468724 26625 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.456483 26584 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:31.444974 29591 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:31.458652 26583 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:31.452560 29426 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:31.452883 29504 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:31.470068 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:31.510061 27276 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:31.510237 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1743) took 3163 ms. Trace:
I20260709 13:10:31.510538 26578 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:31.510839 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:31.510623 26579 rpcz_store.cc:276] 0709 13:10:28.346456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.437991 (+ 91535us) service_pool.cc:224] Handling call
0709 13:10:31.510028 (+3072037us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b5400020dd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:31.510159 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4510977408}
I20260709 13:10:31.511739 27276 raft_consensus.cc:2393] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:31.512513 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:31.513154 27276 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:31.460655 29410 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.474565 29571 raft_consensus.cc:3055] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:31.513947 29571 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:31.514245 29578 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:31.461687 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.515177 29410 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:31.476292 26625 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.472005 29166 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:31.469844 29465 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.474926 29303 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:31.479256 29584 log.cc:927] Time spent T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:31.479666 29385 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:31.448400 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 568557us
I20260709 13:10:31.519604 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.520294 26625 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:31.521507 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.469846 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:31.483800 26503 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:31.489650 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:31.525048 26504 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:31.525717 26625 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:31.490940 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.491879 29577 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:10:31.492190 26473 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.492543 29117 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:31.531581 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.496827 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:31.444365 29376 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.500737 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 786) took 1573 ms. Trace:
I20260709 13:10:31.538029 27271 rpcz_store.cc:276] 0709 13:10:29.927279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.927388 (+   109us) service_pool.cc:224] Handling call
0709 13:10:29.936750 (+  9362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:29.937275 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.937306 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:29.954662 (+ 17356us) log.cc:844] Serialized 534 byte log entry
0709 13:10:30.059722 (+105060us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b180046ff00. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c90d1 00007f882c8e4a0f
0709 13:10:30.108856 (+ 49134us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:30.157393 (+ 48537us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.179109 (+ 21716us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.183559 (+  4450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.183626 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.462323 (+1278697us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b180046ff00. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:31.500459 (+ 38136us) raft_consensus.cc:1685] finished
0709 13:10:31.500489 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.500658 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10949,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":3907,"raft.queue_time_us":22088,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":16654,"spinlock_wait_cycles":20984320,"thread_start_us":48942,"threads_started":1,"wal-append.queue_time_us":241555}
W20260709 13:10:31.502270 29586 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:31.449493 29309 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:10:31.503392 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:31.542150 26506 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:31.542218 26504 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:31.503791 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:31.506065 29535 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:31.468132 29581 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:10:31.455001 29580 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:31.507125 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:31.508176 27275 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:10:31.497280 29282 consensus_meta.cc:287] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.000s
I20260709 13:10:31.365618 29576 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:31.492446 29430 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:31.448915 29477 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.446331 26476 leader_election.cc:400] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7.
I20260709 13:10:31.516830 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:31.474799 29342 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:31.523126 26583 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:31.539702 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:31.540292 26585 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.015s	sys 0.014s
W20260709 13:10:31.560676 26585 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.015s	sys 0.014s
I20260709 13:10:31.543967 26625 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.519137 29361 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.548942 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.562696 26625 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:31.557898 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2030) took 1437 ms. Trace:
I20260709 13:10:31.523972 29591 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:31.566846 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:31.550519 27273 raft_consensus.cc:2376] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5. Re-sending same reply.
I20260709 13:10:31.529290 29227 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:31.558132 26476 leader_election.cc:403] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:31.563867 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.567878 27271 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:31.568324 26504 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:31.540925 29410 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:31.570521 26625 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.564038 26510 rpcz_store.cc:276] 0709 13:10:30.120544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.120718 (+   174us) service_pool.cc:224] Handling call
0709 13:10:30.121068 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:30.125038 (+  3970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.125070 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:30.125880 (+   810us) log.cc:844] Serialized 52 byte log entry
0709 13:10:30.795945 (+670065us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b1800278140. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c90d1 00007f882c8e4a0f
0709 13:10:31.332813 (+536868us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:31.332870 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.332987 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.551610 (+218623us) raft_consensus.cc:1685] finished
0709 13:10:31.551639 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.557804 (+  6165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":541,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5978,"spinlock_wait_cycles":9418496,"thread_start_us":536604,"threads_started":1,"wal-append.queue_time_us":1303332}
I20260709 13:10:31.574108 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:31.573547 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 127422us
I20260709 13:10:31.575838 26476 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:31.585479 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.590713 26506 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:31.595899 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.586375 26580 raft_consensus.cc:2410] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:31.524333 29465 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.602437 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.602783 26548 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:31.603681 26584 raft_consensus.cc:2410] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:31.558668 29309 consensus_queue.cc:1243] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:31.589855 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.575238 29274 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:31.609200 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:31.615449 26504 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:31.609668 26476 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:31.572412 29477 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.577925 29342 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7.
I20260709 13:10:31.584447 29430 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:31.583577 29546 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:31.560209 29580 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.631711 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:31.631968 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:31.630432 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.562695 29282 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.637271 27273 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:31.557929 27274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0edde491935742d4b076995932d10cc9"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:37164
I20260709 13:10:31.642733 27274 raft_consensus.cc:606] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:31.637424 26577 raft_consensus.cc:2393] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:31.630810 29578 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:31.617221 29309 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:10:31.644503 29578 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.633028 29410 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:31.645659 29410 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:31.646072 29410 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:31.646998 29578 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:31.609187 29596 raft_consensus.cc:2764] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:31.651677 27273 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 13:10:31.652714 29282 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:31.654104 27273 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:31.654333 29526 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:31.654500 29602 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:31.655100 29580 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:31.636535 29117 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:31.655246 29602 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.656019 29117 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.658188 27277 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:31.658304 29117 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:31.615190 29595 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:31.580706 29361 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.648782 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:31.680011 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:31.637723 26583 raft_consensus.cc:2393] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:31.638882 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:31.638592 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:31.626739 26504 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:31.682685 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:31.683768 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:31.671048 26622 leader_election.cc:336] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.507s (SENT)
I20260709 13:10:31.684852 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:31.668784 27277 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
W20260709 13:10:31.686059 26622 leader_election.cc:336] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.597s (SENT)
W20260709 13:10:31.686712 26622 leader_election.cc:336] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.607s (SENT)
I20260709 13:10:31.683830 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.684899 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:31.689584 26504 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:31.650101 29603 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.642398 29430 raft_consensus.cc:697] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:31.696537 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.631260 29426 consensus_queue.cc:1059] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:10:31.707561 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:31.708308 26473 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.654335 29376 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:31.701874 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.712095 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:31.714681 26651 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:31.694077 29575 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:31.724469 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:31.725291 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 654) took 1004 ms. Trace:
I20260709 13:10:31.725629 26657 rpcz_store.cc:276] 0709 13:10:30.721124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.710656 (+989532us) service_pool.cc:224] Handling call
0709 13:10:31.725230 (+ 14574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:31.700902 29166 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.728931 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.709396 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:31.717864 26473 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.730706 26656 raft_consensus.cc:2393] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:31.731132 26473 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.732353 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:31.732416 26473 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.733240 26654 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:31.718361 26653 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:31.704196 27241 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:31.689467 26549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.519s (SENT) [suppressed 46 similar messages]
I20260709 13:10:31.735605 26650 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:31.735605 29593 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:31.735955 27241 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.706288 29117 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.713260 29595 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.739691 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:31.739727 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:31.750051 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:31.742081 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:31.750721 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:31.751034 26655 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:31.751670 26650 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:31.719442 29426 consensus_queue.cc:1243] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:31.722716 29504 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:31.752808 26651 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:31.753729 26657 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:31.713007 29454 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:31.753875 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 183425us
I20260709 13:10:31.764915 29596 consensus_queue.cc:1059] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:31.759936 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 70509.3us
I20260709 13:10:31.760485 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:31.765959 29571 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.766691 26659 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:31.723724 29376 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.767349 29571 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:31.767530 29376 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.741055 27241 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:31.770113 29538 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:31.770587 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:31.770732 29583 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:10:31.772763 26549 leader_election.cc:336] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.579s (SENT)
W20260709 13:10:31.773391 29594 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:10:31.774318 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.775080 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 793) took 1120 ms. Trace:
I20260709 13:10:31.775712 26583 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:31.775696 26625 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.782661 26625 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.784565 26584 pending_rounds.cc:85] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 6
I20260709 13:10:31.784425 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.784989 26584 pending_rounds.cc:107] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:10:31.785357 26584 raft_consensus.cc:2889] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:31.776119 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:31.786199 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.787070 26577 raft_consensus.cc:2393] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:31.790311 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:31.771350 26504 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:31.775434 27275 rpcz_store.cc:276] 0709 13:10:30.654794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.739109 (+ 84315us) service_pool.cc:224] Handling call
0709 13:10:31.507744 (+768635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.550541 (+ 42797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.774898 (+224357us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b5400780350. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:31.775023 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766767360}
I20260709 13:10:31.797236 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.737223 29609 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.798159 26502 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:31.799741 26583 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:10:31.797456 26578 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:31.806919 26583 pending_rounds.cc:85] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 3
I20260709 13:10:31.807222 26583 pending_rounds.cc:107] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:10:31.807149 26625 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.749253 29282 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:31.740831 29578 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:31.807708 26583 raft_consensus.cc:2889] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:31.740176 29602 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:31.706085 29603 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.798301 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.741160 29342 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:31.837710 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:31.842887 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:31.845347 26582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 555) took 2974 ms (client timeout 2174 ms). Trace:
W20260709 13:10:31.845885 26582 rpcz_store.cc:269] 0709 13:10:28.870973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.874978 (+  4005us) service_pool.cc:224] Handling call
0709 13:10:31.845109 (+2970131us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b5400076cd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:31.845260 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5349840256}
I20260709 13:10:31.846920 26654 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:31.847440 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:31.848362 26654 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:31.754315 28986 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:31.741686 29309 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:31.840042 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:31.840767 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:31.740103 29166 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.806754 29546 consensus_queue.cc:1059] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:10:31.850468 29538 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:31.816857 26549 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:31.870513 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 53753.9us
I20260709 13:10:31.871018 29619 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.871464 29603 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:31.871603 29619 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.872174 26549 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:31.874400 29610 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:31.875023 29166 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:31.852342 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 81561us
I20260709 13:10:31.875571 29610 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:31.875965 29610 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:31.876940 27241 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:31.853636 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.834569 29611 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:31.897181 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:31.898485 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.863622 29465 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:31.809248 29450 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:31.842051 29389 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.864584 29309 raft_consensus.cc:697] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:31.864765 29477 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:31.851416 29596 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.762769 29595 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.872076 29603 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:31.874853 29454 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:31.854638 26501 raft_consensus.cc:2393] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:31.848313 26658 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:31.752039 29117 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:31.900688 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 149777us
I20260709 13:10:31.863866 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:31.866464 29458 consensus_meta.cc:287] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.003s
I20260709 13:10:31.840576 29575 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:31.797464 29426 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:10:31.904711 26510 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:31.935861 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 240457us
I20260709 13:10:31.903899 29617 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:31.903751 29612 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:31.939078 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.939858 26510 raft_consensus.cc:2393] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:31.915073 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.876771 29610 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.925976 26583 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:31.924804 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 322092us
I20260709 13:10:31.927795 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.857069 29578 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:10:31.911955 29389 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.930536 27240 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:31.834712 29609 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.912390 26582 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:10:31.907393 29166 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:10:31.952136 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:31.851778 29430 consensus_queue.cc:237] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.952863 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:31.959635 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:31.959859 29532 raft_consensus.cc:3055] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:31.960286 29532 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:31.960566 29378 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:31.960747 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:31.961067 29609 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:31.961385 29426 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:31.954859 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:31.956156 26501 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:31.909952 29465 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:10:31.958211 26582 pending_rounds.cc:85] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 6
I20260709 13:10:31.965083 26582 pending_rounds.cc:107] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:10:31.965384 26582 raft_consensus.cc:2889] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:31.940604 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:31.963195 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:31.956941 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1755) took 1100 ms. Trace:
I20260709 13:10:31.905638 29623 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:10:31.970232 26510 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:31.940327 29617 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.931234 29603 raft_consensus.cc:697] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:31.976238 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:31.935110 29619 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:31.978188 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:31.981351 27274 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:31.981710 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:31.962533 29602 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:31.961855 29426 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:31.986109 26505 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 7. Ops: []
I20260709 13:10:31.975100 29609 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:31.969851 26585 rpcz_store.cc:276] 0709 13:10:30.856762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.856925 (+   163us) service_pool.cc:224] Handling call
0709 13:10:30.886655 (+ 29730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.886909 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:31.561044 (+674135us) log.cc:844] Serialized 14 byte log entry
0709 13:10:31.956621 (+395577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:31.956665 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:31.956705 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.956794 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.956891 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13035,"prepare.queue_time_us":721733,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":58249,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":970361,"threads_started":3,"wal-append.queue_time_us":137093}
I20260709 13:10:31.985611 26658 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:31.965325 29538 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.004038 26505 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:31.979858 29608 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:31.980082 28956 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:31.986136 27240 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:31.983331 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:31.989208 29618 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.935027 29458 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.918219 29596 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.965076 29450 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:31.932443 29593 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:10:31.988155 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:31.975076 29611 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:31.986802 27273 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:31.961074 29532 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:31.982435 29617 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:31.983335 29615 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.048243 26651 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:32.049778 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:32.050520 27273 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:32.015501 29475 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:32.057787 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 180705us
I20260709 13:10:32.047538 29621 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.987741 29583 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:32.031293 29625 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:31.982877 29624 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:32.006507 29454 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:31.998981 29610 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:32.044369 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:32.013150 27240 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:32.085237 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 72191us
I20260709 13:10:32.061923 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:32.086288 27273 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:32.087831 27273 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:32.049672 29450 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:32.088788 29450 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:31.987288 29361 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:31.993639 29309 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.052029 29532 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:32.069000 29596 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.071270 29410 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.072108 29426 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.096779 29426 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:32.097867 29410 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.098551 26505 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:32.091666 29450 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:32.075531 29535 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:32.105094 29535 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:32.106199 29535 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:32.107714 29535 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:32.029886 29609 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:10:32.077353 29576 consensus_meta.cc:287] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.003s
I20260709 13:10:32.110275 29576 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.058049 29477 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:32.059445 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.057832 29312 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:32.114145 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.114195 29312 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:32.115623 26653 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:32.116641 29312 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:32.113279 29576 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.104277 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:32.137670 26622 leader_election.cc:336] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 2.006s (SENT)
I20260709 13:10:32.077526 29376 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:32.055382 29615 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.145107 29615 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.149794 27276 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:32.149678 29454 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.152001 29454 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.152249 27274 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:32.153883 29573 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:32.154439 29573 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:32.154938 29595 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:32.166147 26503 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:32.165946 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:32.168674 27274 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:32.063269 29475 raft_consensus.cc:697] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:32.145439 27272 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:32.082530 29583 raft_consensus.cc:697] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:32.054109 29603 consensus_queue.cc:237] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:32.179471 29580 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.182189 29117 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:32.066577 29621 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.190445 29504 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:32.198416 29475 consensus_queue.cc:237] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.155324 29573 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.191859 29580 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.202381 29602 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:32.202196 29583 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.202912 29602 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:32.206214 29548 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.211493 29617 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.213182 29617 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:32.216266 29621 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:32.248260 26510 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:32.251770 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.255975 29117 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.257252 29117 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.259639 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:32.261206 26658 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.261294 29117 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.261879 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:32.262776 29117 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:32.263778 29117 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.265549 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:32.267285 29458 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:32.269686 29477 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:32.274668 27274 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:32.275185 29477 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:32.294029 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 306103us
I20260709 13:10:32.299630 29621 consensus_queue.cc:1059] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:32.302944 26579 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:32.305998 29623 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:32.297416 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:32.315289 29623 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:32.306051 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:32.311028 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:32.311693 29117 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.327762 29623 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:32.330088 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:32.329790 29623 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:32.330950 29458 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:32.331053 26653 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:32.340106 29477 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.343102 29477 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.351446 26658 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:32.354655 29110 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:32.354463 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:32.354566 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:32.375244 29282 raft_consensus.cc:993] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:10:32.375563 27269 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:32.375758 26581 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:32.376084 29621 raft_consensus.cc:1081] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:10:32.378563 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:32.379175 26658 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:32.380442 29303 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:32.380869 29303 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:32.356860 27270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 795) took 1516 ms. Trace:
I20260709 13:10:32.381918 27270 rpcz_store.cc:276] 0709 13:10:30.840661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.840855 (+   194us) service_pool.cc:224] Handling call
0709 13:10:30.841192 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.972824 (+131632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.356222 (+1383398us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b54003fe8d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:32.356598 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18681600}
I20260709 13:10:32.383596 26507 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:32.382740 29303 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.386023 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:32.386409 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:32.387066 26658 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:32.387372 26656 raft_consensus.cc:2376] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6. Re-sending same reply.
I20260709 13:10:32.388971 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:32.390913 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:32.391871 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 62515.6us
I20260709 13:10:32.392103 26650 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:32.394632 29342 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:32.395259 29342 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:32.385394 29303 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.409747 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:32.410271 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:32.409016 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:32.421515 26473 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:32.424535 29504 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:32.425118 29504 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.425639 29504 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:32.426962 29389 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:32.430037 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:32.431468 26580 raft_consensus.cc:2393] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:32.431506 29117 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:32.421712 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:32.438014 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:32.440177 27241 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:32.442114 29389 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:32.442938 29282 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:32.443635 29282 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:32.445006 29282 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.442190 29617 consensus_queue.cc:1059] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:10:32.450825 29475 raft_consensus.cc:3055] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:32.451447 29475 raft_consensus.cc:740] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:32.439402 26580 raft_consensus.cc:2410] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:32.461172 26507 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:32.463680 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:32.408802 29342 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.466686 26659 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:32.471175 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:32.472302 29475 consensus_queue.cc:260] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.474519 29475 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.474826 29572 raft_consensus.cc:3055] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:32.475508 29572 raft_consensus.cc:740] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:32.480571 29309 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:32.481384 29309 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.481910 29385 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:32.481918 29309 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:32.477051 29572 consensus_queue.cc:260] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:32.491987 29342 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:32.493013 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.492928 29572 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:32.511336 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 49003.3us
I20260709 13:10:32.467589 26655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0edde491935742d4b076995932d10cc9"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39256
I20260709 13:10:32.503024 29617 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.514196 26579 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:32.514315 29617 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.517010 29617 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:32.517751 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.521478 29535 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:32.521903 29571 consensus_queue.cc:1059] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:32.523290 29312 raft_consensus.cc:3055] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:32.523700 29312 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:32.524766 29312 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:32.526383 29312 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.513652 26655 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.532353 26655 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.533546 29482 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.534358 29482 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.537012 29482 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.540699 29380 consensus_queue.cc:1059] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:32.541982 29458 raft_consensus.cc:3055] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:32.542376 29458 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:32.543581 29458 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.544157 29573 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.545043 29573 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.546114 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:32.547015 27275 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:32.543604 27270 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:32.548004 29573 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:32.551074 29036 raft_consensus.cc:3055] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:32.551637 29036 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:32.545218 29458 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.551074 26549 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:32.559602 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:32.561084 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:32.582417 26655 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.563135 29166 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:10:32.601068 26650 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:32.615338 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:32.616109 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:32.616457 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:32.616894 26509 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:32.613297 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 72594.8us
I20260709 13:10:32.620398 27275 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:32.619326 29604 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:32.622345 29604 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:32.622911 29604 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.622145 29609 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:10:32.622392 29166 consensus_queue.cc:1243] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:32.632156 27270 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:32.595621 29036 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.634888 29036 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:32.635764 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:32.638748 26653 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:10:32.639503 29609 consensus_queue.cc:1243] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:32.640645 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:32.640285 29166 raft_consensus.cc:3055] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:32.641719 27277 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:32.641664 29166 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:32.644487 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:32.638886 29547 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:32.643280 29166 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.646780 29547 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:32.648222 29547 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:32.650171 29616 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:32.651827 29580 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:32.652920 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 71638.3us
I20260709 13:10:32.654958 27240 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:32.656822 29618 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:32.660384 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 44070.6us
I20260709 13:10:32.661798 27277 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:32.668426 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:32.661621 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:32.678813 27278 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:32.679479 26549 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:32.682094 26549 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:32.682487 29548 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:32.683689 29548 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.684541 29548 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.686084 29609 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:32.688041 26579 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:32.692919 29609 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:32.652887 29166 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:32.698911 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:32.701818 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 81641.3us
I20260709 13:10:32.657480 29526 raft_consensus.cc:3055] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:32.706712 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.682301 29482 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:32.710913 26509 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:32.677742 29618 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.713861 26655 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.608425 29602 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:32.723275 26549 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:32.713692 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:32.719625 29453 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.719987 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:32.702261 29609 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.673062 29309 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.719368 29618 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:32.731978 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:32.708479 29526 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:32.703768 29475 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:10:32.728957 29453 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.737864 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:32.738287 29649 log.cc:927] Time spent T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.125s	user 0.000s	sys 0.004s
I20260709 13:10:32.710816 29482 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:32.738646 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:32.740043 29361 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:32.740195 26549 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:32.731633 29609 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.742604 29602 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:32.736588 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:32.709966 29504 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.711269 29117 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:10:32.747659 26580 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:32.762951 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:32.765038 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.765810 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.765781 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:32.772989 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:32.747476 29580 consensus_queue.cc:1059] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:10:32.777390 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:32.765928 29117 consensus_queue.cc:1243] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer b1f40e8672c549d3b4be7862ac07b7e2 log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:32.785580 26473 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:32.786789 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:32.787392 29625 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:32.787537 26507 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:32.794566 26549 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:32.796888 29526 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:32.797920 29606 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:32.798530 29606 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.799047 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:32.799448 29606 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.775450 29623 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:32.807286 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 387) took 1171 ms. Trace:
I20260709 13:10:32.788187 29625 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.798532 29526 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:32.808189 26510 rpcz_store.cc:276] 0709 13:10:31.637520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.972787 (+335267us) service_pool.cc:224] Handling call
0709 13:10:31.973055 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.249537 (+276482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.801491 (+551954us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54001847d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:32.807203 (+  5712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631139584}
I20260709 13:10:32.794282 29117 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:32.868510 29453 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.875216 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:32.876010 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 86671.8us
W20260709 13:10:32.877588 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.811280 29504 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:32.860057 29625 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:32.879405 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:32.889007 26581 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:32.869995 29117 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.892855 26507 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:32.894594 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:32.893870 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:32.886368 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:32.885874 29623 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:32.927767 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:32.942235 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.970207 27243 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:32.926932 29504 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:32.962551 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:32.909857 29117 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:32.928850 29623 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:32.992288 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 45115us
I20260709 13:10:33.004871 26655 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:33.019138 26510 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:32.959683 26503 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:33.025774 29274 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:33.026644 29274 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:33.033479 29352 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:10:33.039783 26656 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:32.995028 29504 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.060765 26652 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:33.006211 29623 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:33.006464 29309 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:33.061980 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:33.023417 29342 consensus_meta.cc:287] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.000s
I20260709 13:10:33.062429 29504 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:33.070309 29653 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.314s	user 0.001s	sys 0.001s
I20260709 13:10:33.070107 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:33.071693 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:10:33.073060 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.029441 29274 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:33.093753 26654 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:32.924295 29482 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:33.101064 29621 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:33.101195 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:33.103098 26577 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:33.103036 29621 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:33.063529 27272 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:33.105147 26504 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:33.056707 29580 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:10:33.099177 29648 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
I20260709 13:10:33.065862 29303 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:10:33.135560 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:33.136396 26582 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:33.137108 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:33.137741 26576 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:33.140417 29419 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:33.142590 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:33.143543 29547 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:33.144054 29547 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:33.144448 29547 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:33.146461 29482 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:33.148221 29645 log.cc:927] Time spent T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.673s	user 0.000s	sys 0.010s
W20260709 13:10:33.156873 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 85368.3us
I20260709 13:10:33.169411 29352 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:33.174853 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.176071 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.157892 29303 consensus_queue.cc:1243] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:33.186090 26582 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:33.187033 26577 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:33.165642 29380 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.204000 29380 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:33.208570 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 412058us
I20260709 13:10:33.250597 26654 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:33.266080 26576 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:33.282991 26653 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:33.211472 29458 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.285830 26650 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 13:10:33.254143 29651 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:10:33.294320 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:33.287595 29604 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.002s
I20260709 13:10:33.299181 26650 pending_rounds.cc:85] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 3
W20260709 13:10:33.282665 29548 consensus_meta.cc:287] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.594s	user 0.005s	sys 0.010s
I20260709 13:10:33.314847 26656 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:10:33.331964 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.349995 29380 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:33.361958 26577 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:33.363005 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.368937 29036 consensus_meta.cc:287] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.002s
I20260709 13:10:33.281894 29621 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:33.255467 29453 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:10:33.370831 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:33.308543 26650 pending_rounds.cc:107] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:10:33.379397 26650 raft_consensus.cc:2889] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:33.386358 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.310464 29274 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.388633 26476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.013s	sys 0.035s
W20260709 13:10:33.380609 29609 consensus_meta.cc:287] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.004s
W20260709 13:10:33.393226 26476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.014s	sys 0.035s
W20260709 13:10:33.395792 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 616361us
I20260709 13:10:33.427095 26582 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:33.372172 29604 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:33.432994 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 340341us
I20260709 13:10:33.372423 29548 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:33.460237 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 688566us
I20260709 13:10:33.496222 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:33.497665 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 331860us
I20260709 13:10:33.386202 29458 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:33.509042 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:33.455533 29535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.009s	sys 0.016s
I20260709 13:10:33.517263 27278 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:33.461504 29312 raft_consensus.cc:3055] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:33.519589 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 328843us
I20260709 13:10:33.517815 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:33.398105 29609 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:33.530531 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.532888 27270 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:33.457072 29274 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:33.565547 26581 consensus_meta.cc:287] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.653s	user 0.006s	sys 0.001s
I20260709 13:10:33.599498 26581 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:33.439004 29621 consensus_queue.cc:1059] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:10:33.600378 26585 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:33.570600 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 63792.1us
W20260709 13:10:33.592507 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.533793 26654 pending_rounds.cc:85] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 5
I20260709 13:10:33.607785 26654 pending_rounds.cc:107] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:10:33.608219 26654 raft_consensus.cc:2889] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:33.569940 29665 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.522235 29312 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:33.606030 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:33.565487 29606 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.000s
I20260709 13:10:33.648079 26584 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:33.518136 29117 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:33.661170 29348 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.648818 26474 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:33.661738 29348 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:33.661829 29606 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:33.664064 29606 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:33.664146 29348 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:33.609687 29665 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:33.666496 29342 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.667254 29342 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:33.668411 29665 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:33.671181 29504 consensus_meta.cc:287] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.003s
I20260709 13:10:33.671737 29504 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:33.668438 29342 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:10:33.673651 29342 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:33.674118 29504 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:33.671725 27270 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:33.612262 29453 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.688061 26578 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:33.696481 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.697297 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 96599.5us
I20260709 13:10:33.570119 29535 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:33.717720 26509 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:33.677524 29655 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:10:33.677742 29603 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.687584 29274 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:33.708071 29419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.007s	sys 0.044s
W20260709 13:10:33.732730 26506 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.016s	sys 0.010s
W20260709 13:10:33.737185 26506 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.017s	sys 0.010s
I20260709 13:10:33.702209 29580 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.706007 29361 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.009s	sys 0.017s
I20260709 13:10:33.724418 26577 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:33.745662 29668 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.733872 29036 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.736702 29419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.007s	sys 0.044s
W20260709 13:10:33.746866 29618 consensus_meta.cc:287] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.987s	user 0.012s	sys 0.000s
I20260709 13:10:33.706736 29621 consensus_queue.cc:1059] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:10:33.747247 29604 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:33.747918 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:33.752827 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 146940us
I20260709 13:10:33.677855 29659 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.165s
I20260709 13:10:33.679685 29453 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:33.762081 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.012s	sys 0.076s
W20260709 13:10:33.763665 27275 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.111s	sys 0.167s
W20260709 13:10:33.776551 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.012s	sys 0.076s
W20260709 13:10:33.776643 27275 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.112s	sys 0.167s
W20260709 13:10:33.753288 29361 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.009s	sys 0.017s
I20260709 13:10:33.778190 29674 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.777997 29036 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:33.778487 26510 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:33.780686 26509 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:33.761072 29419 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:33.789158 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.749733 29535 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:33.835038 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 802) took 1206 ms. Trace:
I20260709 13:10:33.743391 29603 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:33.839351 29609 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:33.871027 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:33.873839 26503 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:33.874477 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:33.793421 29482 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.000s
I20260709 13:10:33.752417 29580 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:33.792925 29616 raft_consensus.cc:3055] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:33.900614 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:33.771799 29618 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:33.910547 26510 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:33.904490 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.912431 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:33.834285 29548 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:33.916898 27270 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.772670 29668 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:33.891184 29458 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:33.914182 29657 log.cc:927] Time spent T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:10:33.936275 27274 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:33.840206 27275 rpcz_store.cc:276] 0709 13:10:32.628965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.629141 (+   176us) service_pool.cc:224] Handling call
0709 13:10:32.640445 (+ 11304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:32.647030 (+  6585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.647062 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:32.724331 (+ 77269us) log.cc:844] Serialized 52 byte log entry
0709 13:10:33.172941 (+448610us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:33.786250 (+613309us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.834699 (+ 48449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.834780 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.834819 (+    39us) raft_consensus.cc:1685] finished
0709 13:10:33.834829 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.834977 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48140,"raft.queue_time_us":52640,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":1021000,"threads_started":2,"wal-append.queue_time_us":450450}
I20260709 13:10:33.901466 29274 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.937875 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:33.903450 29616 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:33.951861 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 204043us
I20260709 13:10:33.954457 26509 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:33.956558 26504 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:33.956998 27270 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:33.958966 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:33.960151 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:33.960672 26656 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:33.921384 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 494640us
I20260709 13:10:33.974378 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:33.971271 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 305929us
I20260709 13:10:33.917011 29683 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:33.984360 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.987753 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 129866us
W20260709 13:10:33.964710 29166 consensus_meta.cc:287] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.245s	user 0.009s	sys 0.005s
I20260709 13:10:33.994750 26503 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:10:33.995790 26625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.021s	sys 0.026s
W20260709 13:10:33.996122 26625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.022s	sys 0.027s
I20260709 13:10:33.953868 29117 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:34.003969 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:33.951140 29609 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.983383 27269 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:34.006572 26549 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:34.009346 29625 consensus_meta.cc:287] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.093s	user 0.010s	sys 0.005s
W20260709 13:10:34.064772 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 58275.4us
I20260709 13:10:34.065268 29625 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.065999 29674 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:10:34.066524 29671 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:10:34.066794 29674 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:34.067905 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2056) took 1174 ms. Trace:
I20260709 13:10:34.068063 29674 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.068337 26505 rpcz_store.cc:276] 0709 13:10:32.893349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.893462 (+   113us) service_pool.cc:224] Handling call
0709 13:10:32.893834 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.104572 (+210738us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:33.104602 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.135481 (+ 30879us) log.cc:844] Serialized 26 byte log entry
0709 13:10:33.610579 (+475098us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:33.610640 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.610754 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.067510 (+456756us) raft_consensus.cc:1685] finished
0709 13:10:34.067531 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.067690 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18226,"raft.queue_time_us":419870,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":141,"thread_start_us":661092,"threads_started":2,"wal-append.queue_time_us":704967}
I20260709 13:10:34.070012 29458 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.070556 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:34.070643 29458 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.071319 26505 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:34.072763 26579 raft_consensus.cc:2393] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:34.073760 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1776) took 1057 ms. Trace:
I20260709 13:10:34.074201 26585 rpcz_store.cc:276] 0709 13:10:33.015925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.016154 (+   229us) service_pool.cc:224] Handling call
0709 13:10:33.600203 (+584049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.610567 (+ 10364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.073490 (+462923us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b5400100250. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:34.073664 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240434560}
I20260709 13:10:34.074716 29348 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:33.971940 29548 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.922765 29036 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:33.983253 29659 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:34.012844 26580 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:10:34.003005 29621 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:10:34.085453 27243 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:34.020409 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:34.086571 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1777) took 1032 ms. Trace:
I20260709 13:10:34.086862 26651 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:34.025060 29677 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.026374 29535 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:34.013406 29166 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:34.027264 26476 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:34.027968 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:34.028724 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:34.029868 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:34.113837 27273 raft_consensus.cc:2376] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6. Re-sending same reply.
W20260709 13:10:34.030289 27274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 503) took 1368 ms (client timeout 1663 ms). Trace:
W20260709 13:10:34.030737 29526 consensus_meta.cc:287] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.166s	user 0.012s	sys 0.000s
W20260709 13:10:34.031086 29623 consensus_meta.cc:287] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.938s	user 0.012s	sys 0.001s
I20260709 13:10:34.031693 29678 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.016824 29274 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:33.988890 27272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 801) took 1361 ms (client timeout 1632 ms). Trace:
I20260709 13:10:34.012603 29419 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.034176 29606 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.037215 29604 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.135766 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:34.037748 29663 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.038075 26659 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:34.038118 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 394) took 1326 ms. Trace:
I20260709 13:10:34.038769 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:34.039220 29660 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:34.040181 29669 raft_consensus.cc:3055] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:34.046284 29616 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:33.994808 29602 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.047564 26501 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:34.048339 29380 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:34.050285 26402 catalog_manager.cc:5697] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.057776 29453 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:34.058192 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:34.060784 29603 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:34.156801 29274 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:34.061959 29664 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:10:34.149114 29606 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.032876 29312 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.159325 29312 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.158969 29660 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.160207 29606 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:34.087146 26579 rpcz_store.cc:276] 0709 13:10:33.054261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.054421 (+   160us) service_pool.cc:224] Handling call
0709 13:10:34.086330 (+1031909us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540015c554. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:34.086489 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2311424896}
W20260709 13:10:34.091914 27278 consensus_meta.cc:287] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.001s
I20260709 13:10:34.161089 27278 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:34.084645 26580 pending_rounds.cc:85] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 6
I20260709 13:10:34.161792 26580 pending_rounds.cc:107] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:10:34.162070 26580 raft_consensus.cc:2889] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.092692 29475 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.096926 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2057) took 1176 ms. Trace:
W20260709 13:10:34.097657 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 92833.2us
I20260709 13:10:34.166563 27243 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:34.102469 29618 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:34.102360 29548 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.191334 29548 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:34.104297 29668 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:34.192788 29616 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:34.105945 29547 consensus_meta.cc:287] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.961s	user 0.013s	sys 0.000s
I20260709 13:10:34.106268 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.194114 29547 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.194998 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.196481 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.107410 29625 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:34.091354 26401 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48166 (request call id 195) took 11476 ms (client timeout 15000 ms). Trace:
I20260709 13:10:34.115751 26656 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:34.196974 29547 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:34.114823 27274 rpcz_store.cc:269] 0709 13:10:32.661413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.668001 (+  6588us) service_pool.cc:224] Handling call
0709 13:10:34.030090 (+1362089us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54005aafd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:34.030231 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2890408192}
W20260709 13:10:34.123710 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.135142 26504 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:34.142088 27270 raft_consensus.cc:2376] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6. Re-sending same reply.
I20260709 13:10:34.143002 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:34.018385 29683 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.119205 29036 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:34.149537 26652 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:34.120033 29166 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.108315 29348 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:10:34.153193 29602 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.154649 27276 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:34.160312 29658 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:34.094609 29580 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:34.164075 27275 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 13:10:34.121882 29659 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:34.276546 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 241024us
I20260709 13:10:34.168967 26510 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:10:34.172771 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 157147us
I20260709 13:10:34.178138 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:34.137722 29678 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.166805 29477 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.167033 29380 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.179219 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2614) took 1403 ms. Trace:
I20260709 13:10:34.180964 26402 catalog_manager.cc:5697] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 5 to 6, term changed from 3 to 5, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to <none>, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 5 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:10:34.313949 26657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.010s	sys 0.008s
I20260709 13:10:34.143805 29669 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:34.148542 29663 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:34.133145 27272 rpcz_store.cc:269] 0709 13:10:32.607448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.614765 (+  7317us) service_pool.cc:224] Handling call
0709 13:10:33.950972 (+1336207us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b5400817754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:33.968480 (+ 17508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133258112}
I20260709 13:10:34.184206 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:34.319381 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 162604us
I20260709 13:10:34.185467 29458 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:34.141391 29389 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.186210 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.165985 26507 rpcz_store.cc:276] 0709 13:10:32.934034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.934287 (+   253us) service_pool.cc:224] Handling call
0709 13:10:32.991812 (+ 57525us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:33.392640 (+400828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.392688 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:33.507303 (+114615us) log.cc:844] Serialized 52 byte log entry
0709 13:10:33.872566 (+365263us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:33.872607 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.872701 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.096678 (+223977us) raft_consensus.cc:1685] finished
0709 13:10:34.096699 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.096871 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1183,"raft.queue_time_us":460682,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":69611,"thread_start_us":615444,"threads_started":2,"wal-append.queue_time_us":472715}
I20260709 13:10:34.198104 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.114492 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.123258 29621 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:10:34.152127 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 158391us
I20260709 13:10:34.138880 26508 rpcz_store.cc:276] 0709 13:10:32.582205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.584782 (+  2577us) service_pool.cc:224] Handling call
0709 13:10:32.605048 (+ 20266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:32.614877 (+  9829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.614910 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:32.615495 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:10:33.096875 (+481380us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:33.096916 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.096986 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.676773 (+579787us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:33.898703 (+221930us) raft_consensus.cc:1685] finished
0709 13:10:33.898728 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.908460 (+  9732us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4901,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":11773,"spinlock_wait_cycles":23987968,"thread_start_us":480937,"threads_started":1,"wal-append.queue_time_us":844315}
I20260709 13:10:34.334785 26650 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:34.208760 26654 raft_consensus.cc:2393] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:34.207253 29036 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.231956 29683 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:34.339128 29687 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.350308 29687 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.351464 29166 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:34.352854 29687 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:34.352483 29669 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.353801 29380 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:34.354208 29669 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.355437 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.135979 29526 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:10:34.356779 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.118489 29609 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.359143 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.360131 29609 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:34.242185 26505 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:34.360850 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:34.256305 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 45752.7us
I20260709 13:10:34.361661 26502 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:10:34.362141 26502 pending_rounds.cc:85] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 2
I20260709 13:10:34.362401 26502 pending_rounds.cc:107] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:10:34.362648 26502 raft_consensus.cc:2889] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.357388 26650 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:34.362903 29663 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:34.363765 26622 leader_election.cc:336] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.746s (SENT)
I20260709 13:10:34.108294 29677 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:34.287093 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 120623us
I20260709 13:10:34.364902 29659 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.366142 27243 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:34.289284 27277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.007s	sys 0.015s
W20260709 13:10:34.369506 27277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.007s	sys 0.016s
I20260709 13:10:34.369938 26655 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:34.370066 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:34.370851 26579 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:34.371342 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.372922 26654 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:34.364955 26622 leader_election.cc:336] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.778s (SENT)
I20260709 13:10:34.376420 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:34.311803 26506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.005s	sys 0.013s
I20260709 13:10:34.127378 29623 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:34.383031 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 52784.2us
I20260709 13:10:34.384325 26625 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:34.314802 26657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.011s	sys 0.008s
W20260709 13:10:34.310220 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 194863us
I20260709 13:10:34.386293 29380 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:34.386713 29380 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:34.387126 29380 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.388435 29677 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:34.390038 29526 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:34.390949 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1866) took 1177 ms. Trace:
I20260709 13:10:34.391364 26657 rpcz_store.cc:276] 0709 13:10:33.213705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.213843 (+   138us) service_pool.cc:224] Handling call
0709 13:10:33.214147 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.214353 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:33.759389 (+545036us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.390589 (+631200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.390651 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:34.390701 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.390762 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.390876 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64784,"prepare.queue_time_us":757760,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"thread_start_us":1110656,"threads_started":2}
I20260709 13:10:34.392617 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:34.393867 26657 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:34.394132 26578 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:34.394217 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:34.318701 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 195626us
W20260709 13:10:34.395196 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.396207 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:34.328732 29653 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:10:34.323035 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45459.7us
I20260709 13:10:34.325050 26503 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:34.340060 26509 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:10:34.281195 29658 raft_consensus.cc:697] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:34.289142 29668 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:34.342881 29458 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:34.434259 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.435127 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:34.343120 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:34.344997 29602 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:34.443372 26625 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:34.345692 26474 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:34.345526 29389 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.346279 29661 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.346493 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:34.382436 26506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.006s	sys 0.013s
I20260709 13:10:34.372287 29667 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:34.396777 26584 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.321451 29477 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.453462 26659 raft_consensus.cc:2410] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:34.313208 26580 rpcz_store.cc:276] 0709 13:10:32.776045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.776217 (+   172us) service_pool.cc:224] Handling call
0709 13:10:32.781437 (+  5220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.162560 (+1381123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.178885 (+ 16325us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001c34d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:34.179146 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2821061504}
I20260709 13:10:34.447546 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:34.401386 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:34.430969 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 44997.7us
I20260709 13:10:34.385322 29623 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:34.197305 26401 rpcz_store.cc:269] 0709 13:10:22.573583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.573927 (+   344us) service_pool.cc:224] Handling call
0709 13:10:34.049482 (+11475555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:23.791436 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:23.931987 (+140551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:23.932035 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:10:23.932053 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:23.933061 (+  1008us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:23.933142 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:23.933168 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:10:23.933956 (+   788us) tablet.cc:701] Row locks acquired
0709 13:10:23.933998 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:10:23.934150 (+   152us) write_op.cc:270] Start()
0709 13:10:23.934299 (+   149us) write_op.cc:276] Timestamp: P: 1783602623934086 usec, L: 0
0709 13:10:23.934316 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:10:23.935022 (+   706us) log.cc:844] Serialized 3628 byte log entry
0709 13:10:24.062893 (+127871us) op_driver.cc:464] REPLICATION: finished
0709 13:10:24.432384 (+369491us) write_op.cc:301] APPLY: starting
0709 13:10:24.485165 (+ 52781us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:24.531860 (+ 46695us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:24.531986 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:24.533172 (+  1186us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:24.533462 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:10:24.533503 (+    41us) write_op.cc:312] APPLY: finished
0709 13:10:24.533977 (+   474us) log.cc:844] Serialized 71 byte log entry
0709 13:10:24.534182 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:24.534300 (+   118us) write_op.cc:454] Released schema lock
0709 13:10:24.534368 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:24.534819 (+   451us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:24.534862 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40847,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":328502,"apply.run_cpu_time_us":3576,"apply.run_wall_time_us":119162,"num_ops":9,"prepare.queue_time_us":422201,"prepare.run_cpu_time_us":10942,"prepare.run_wall_time_us":216919,"raft.queue_time_us":54495,"raft.run_cpu_time_us":11415,"raft.run_wall_time_us":257982,"replication_time_us":128277,"thread_start_us":709521,"threads_started":4,"wal-append.queue_time_us":69978,"wal-append.run_cpu_time_us":17422,"wal-append.run_wall_time_us":1530142}]]}
W20260709 13:10:34.439653 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 343551us
I20260709 13:10:34.455360 26549 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:34.436877 26651 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:34.451915 26625 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:34.398267 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:34.460336 26548 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:34.457803 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2058) took 1464 ms. Trace:
W20260709 13:10:34.470212 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 105278us
I20260709 13:10:34.483160 27276 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:34.464345 26402 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 3 to 4, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 4 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.538468 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:34.429198 29621 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:10:34.549467 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:34.465938 26506 rpcz_store.cc:276] 0709 13:10:32.996025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.008360 (+ 12335us) service_pool.cc:224] Handling call
0709 13:10:33.064053 (+ 55693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.094223 (+ 30170us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:33.741914 (+647691us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.457201 (+715287us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.457431 (+   230us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.457478 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:34.457517 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.457610 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.457737 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":513561,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":11287,"thread_start_us":1291690,"threads_started":2,"wal-append.queue_time_us":581484}
I20260709 13:10:34.552086 26579 raft_consensus.cc:2410] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:10:34.542026 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 86726.7us
I20260709 13:10:34.441263 29677 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:34.570313 27278 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:34.575882 26549 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:34.567071 29458 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:34.577613 29458 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:34.577659 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:34.580082 27272 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:34.582175 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 236576us
I20260709 13:10:34.583849 26474 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:34.584664 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 770) took 1157 ms. Trace:
W20260709 13:10:34.599750 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 158689us
I20260709 13:10:34.600781 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:34.585330 26474 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:34.554838 29687 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.619236 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:34.625193 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 55208.2us
I20260709 13:10:34.638752 26549 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:34.564103 29602 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:34.645015 27276 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:34.527328 29661 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.585121 27277 rpcz_store.cc:276] 0709 13:10:33.427516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.434783 (+  7267us) service_pool.cc:224] Handling call
0709 13:10:33.512518 (+ 77735us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:33.655903 (+143385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.655948 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:33.732670 (+ 76722us) log.cc:844] Serialized 52 byte log entry
0709 13:10:34.370007 (+637337us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:34.370327 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.370520 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.370602 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.584412 (+213810us) raft_consensus.cc:1685] finished
0709 13:10:34.584433 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.584592 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32034,"prepare.queue_time_us":645,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":130337,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":4838,"thread_start_us":598242,"threads_started":1,"wal-append.queue_time_us":687249}
I20260709 13:10:34.562271 29623 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:34.654564 26622 leader_election.cc:336] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.811s (SENT)
W20260709 13:10:34.656607 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 55942.3us
I20260709 13:10:34.578243 29458 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:34.582134 29274 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:34.617293 29312 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:34.669698 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:34.673144 29547 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:34.667290 29602 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:34.674326 29404 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.675114 29606 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:34.675277 26548 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:34.676797 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:34.677747 27243 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:10:34.678951 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.643167 29666 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.648641 29482 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:34.706616 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:34.651314 29677 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:34.643321 29117 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:34.684583 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 232759us
I20260709 13:10:34.684751 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:34.712638 26581 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:34.559260 29715 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 13:10:34.692668 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.693410 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.685771 29604 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.723543 26582 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:34.653352 29687 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.698680 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:34.676074 29309 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:34.726727 26659 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:34.705936 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:34.710062 26652 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:34.711804 26506 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:10:34.721863 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 136622us
I20260709 13:10:34.692113 29547 raft_consensus.cc:697] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:34.732792 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:34.706920 29482 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.731231 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:34.755466 26503 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:34.736295 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 61101.5us
I20260709 13:10:34.701368 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:34.758113 27272 raft_consensus.cc:2376] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4. Re-sending same reply.
I20260709 13:10:34.732571 26402 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 3 to 4, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 4 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:34.709012 29274 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:34.772142 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.761930 26402 catalog_manager.cc:5697] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 4 to 5, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 5 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.774685 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:34.777262 26509 raft_consensus.cc:2410] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:34.781008 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:34.762629 29482 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:34.782265 29662 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:34.667754 29658 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.733611 29678 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:34.733804 29724 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.786538 29724 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:34.787366 29721 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:10:34.788197 29687 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:34.790431 29718 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.791098 29718 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.792207 29274 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.795332 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:34.776319 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:34.801149 26502 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:34.806056 26581 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:34.807210 26584 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:10:34.762840 29623 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:34.700888 29404 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.732263 29604 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:34.819569 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:34.822456 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:34.815415 26581 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:34.821424 26650 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.821934 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.841710 26651 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:34.835688 29687 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:10:34.809302 29718 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:34.897931 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.869918 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:34.910480 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:34.731209 29666 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:34.912002 26651 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:34.912834 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 56859.5us
I20260709 13:10:34.912135 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.810567 29678 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.909986 29380 consensus_meta.cc:287] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.002s
I20260709 13:10:34.800529 29606 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:10:34.898191 29704 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:10:34.931294 26653 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:34.931478 26585 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:34.933296 26503 raft_consensus.cc:2393] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:34.816767 29701 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:10:34.816108 29709 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.818468 29623 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.817039 29714 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.816169 29684 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.002996 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 348934us
I20260709 13:10:34.926189 29309 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.980496 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:34.816504 29726 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:34.816699 29702 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:34.998461 26651 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:34.979543 26657 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:34.822455 29348 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.154s
I20260709 13:10:34.850064 29602 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:35.003885 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.048928 26509 raft_consensus.cc:2393] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:34.975078 29716 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:10:35.005051 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:34.931591 29166 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:10:34.816722 29683 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.158s
W20260709 13:10:35.016590 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 136219us
I20260709 13:10:34.994019 29718 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.984771 26502 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
W20260709 13:10:35.047245 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 235688us
I20260709 13:10:35.047375 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:35.050297 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.053104 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:35.090778 26653 raft_consensus.cc:1813] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Handling vote request from an unknown peer ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:35.059149 26655 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
W20260709 13:10:35.094065 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.849933 29660 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:35.023743 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.007006 29623 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:35.021368 29036 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:34.944984 29380 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:35.018695 29702 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.970716 29678 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:35.095850 26503 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
I20260709 13:10:35.116966 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.058250 29687 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:35.125547 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 121837us
I20260709 13:10:35.048043 29348 consensus_queue.cc:1243] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:35.111039 26474 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:35.102186 26653 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:10:35.115664 29718 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:35.160858 29718 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:35.161103 29389 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:35.162029 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.162708 26510 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:35.162884 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:35.082376 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1790) took 1031 ms. Trace:
I20260709 13:10:35.163971 26650 rpcz_store.cc:276] 0709 13:10:34.051184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.363487 (+312303us) service_pool.cc:224] Handling call
0709 13:10:34.817788 (+454301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.850803 (+ 33015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.082151 (+231348us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54002da850. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:35.082311 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043785088}
I20260709 13:10:35.115311 29666 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:35.013048 29714 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:35.097843 29677 raft_consensus.cc:697] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:35.014017 29684 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:35.143507 26658 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:35.144114 29687 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:35.144980 26622 leader_election.cc:336] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.894s (SENT)
W20260709 13:10:35.147138 29717 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 13:10:35.150393 29678 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:35.118749 29702 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:35.240995 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:35.151144 29690 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:35.152877 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.153700 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.155577 29603 raft_consensus.cc:3055] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:35.245138 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:35.156337 29669 consensus_meta.cc:287] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.002s
I20260709 13:10:35.158178 29724 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:35.163571 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:34.974284 29547 consensus_queue.cc:237] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:35.166616 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.213446 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.117604 29036 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:35.122395 29661 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:35.222296 29692 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:35.227191 26622 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:35.227447 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 116566us
I20260709 13:10:35.229477 29684 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:35.230635 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.231417 29705 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:35.232722 29729 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:10:35.156426 29458 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:35.235805 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.238104 29677 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:35.238817 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 697517us
I20260709 13:10:35.476970 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:35.474489 26503 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:35.240188 26579 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:35.241439 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 154232us
I20260709 13:10:35.116227 29726 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:10:35.241475 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.241328 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.481437 26576 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:35.256978 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.295441 26656 raft_consensus.cc:2410] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:35.251643 26505 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:10:35.295141 26504 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:35.482167 26502 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 3.
W20260709 13:10:35.298380 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 620671us
I20260709 13:10:35.483247 27243 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:35.484779 27243 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:35.301038 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.304140 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.168853 29674 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.128s
W20260709 13:10:35.295617 29616 consensus_meta.cc:287] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.102s	user 0.015s	sys 0.000s
I20260709 13:10:35.306277 26582 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:35.306318 29604 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:35.306360 26658 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:35.248801 29603 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:35.314402 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.319278 29714 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:35.510330 26509 raft_consensus.cc:2410] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:35.334139 29477 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:35.336835 29380 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:35.372802 29404 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:35.551144 26580 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:35.388957 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.389932 29117 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:35.478035 29664 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 13:10:35.431411 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 510739us
I20260709 13:10:35.442619 26510 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
W20260709 13:10:35.443254 29727 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.435s	user 0.004s	sys 0.000s
I20260709 13:10:35.444052 29658 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:35.437007 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 516) took 1418 ms. Trace:
I20260709 13:10:35.407255 29734 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.458134 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:35.462406 26508 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:35.565521 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:35.567979 26510 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:35.466331 26476 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:35.448007 29482 consensus_meta.cc:287] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.665s	user 0.013s	sys 0.000s
I20260709 13:10:35.463868 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.430323 29274 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:35.487527 27277 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:35.488189 27243 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:35.582616 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 94527.7us
I20260709 13:10:35.583664 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:35.488976 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.469118 29723 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.005s	sys 0.019s
I20260709 13:10:35.490329 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:35.482290 26505 pending_rounds.cc:85] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 7
I20260709 13:10:35.303437 29618 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:35.456472 29745 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:10:35.488126 29669 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:35.469436 29661 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:10:35.492427 29526 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:35.492777 29475 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:35.605746 26507 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:35.605759 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:35.608049 26650 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:35.609823 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:35.610747 27277 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:35.576846 29729 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:10:35.531971 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 387037us
I20260709 13:10:35.550161 27274 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
W20260709 13:10:35.392386 29711 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:10:35.554174 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:35.627871 26502 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.637962 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.640280 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.554286 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.536022 29731 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:10:35.554920 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.642765 26504 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:35.643149 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.643785 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:35.556613 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.644819 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.556797 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:35.645901 27278 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
W20260709 13:10:35.591601 29723 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.005s	sys 0.019s
I20260709 13:10:35.557602 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.647087 26585 raft_consensus.cc:2410] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:35.558013 29117 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:35.558218 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:35.558969 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:35.650771 26576 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:35.501914 29736 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:35.651549 27270 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:35.561599 26549 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:35.652575 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 91130.3us
I20260709 13:10:35.535560 29616 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:35.477703 29705 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:35.592087 26505 pending_rounds.cc:107] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:10:35.600123 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.506176 29712 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 13:10:35.665105 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 207063us
I20260709 13:10:35.666038 26474 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:35.488970 29687 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:35.564198 29692 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.566046 27271 rpcz_store.cc:276] 0709 13:10:34.018865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.187900 (+169035us) service_pool.cc:224] Handling call
0709 13:10:34.202851 (+ 14951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.233685 (+ 30834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.233734 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.320648 (+ 86914us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.600529 (+279881us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:34.648591 (+ 48062us) log.cc:844] Serialized 14 byte log entry
0709 13:10:35.297747 (+649156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.297817 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.297853 (+    36us) raft_consensus.cc:1685] finished
0709 13:10:35.297869 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.436751 (+138882us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b5400428e50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:35.436917 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":648870,"prepare.queue_time_us":51898,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":655083,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":48104,"spinlock_wait_cycles":63150720,"thread_start_us":202558,"threads_started":1,"wal-append.queue_time_us":748198}
I20260709 13:10:35.565726 29684 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:35.626225 29309 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.647982 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.649276 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:35.459189 29036 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:35.653278 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.694767 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:35.653833 26549 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:35.696267 26549 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:35.651029 29723 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:35.697837 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:35.657011 29744 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:35.657074 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:35.657500 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 591) took 1265 ms. Trace:
I20260709 13:10:35.657769 29419 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.660313 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.600790 29621 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:35.601954 29658 consensus_queue.cc:1243] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:35.617301 29274 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:35.599108 29618 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.602423 29669 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.668141 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:35.647816 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.682504 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:35.654431 26548 connection.cc:256] RPC call timeout handler was delayed by -1.6808790430000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:10:35.654227 26502 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:35.698556 27270 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:35.647742 29661 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:35.649158 29667 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:35.596668 29482 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:35.581430 29734 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:35.661963 26505 raft_consensus.cc:2889] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.714237 26549 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:35.996649 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:35.715718 29603 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.027304 29734 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:36.027555 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:36.027773 29603 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.022393 29618 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:35.713732 29117 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:36.029358 29621 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:36.030104 29117 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:36.030625 26508 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:36.030397 29621 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.032718 26583 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:35.755272 29711 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:35.997406 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 803) took 1578 ms. Trace:
I20260709 13:10:36.022015 26585 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
W20260709 13:10:35.996155 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 334266us
I20260709 13:10:36.035151 29274 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:36.022828 29661 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:36.023983 29744 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:35.801662 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:35.698338 29723 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:35.948942 29731 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:35.731801 29754 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:35.699318 29526 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.668232 29616 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.021931 29669 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:36.038480 29742 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.550s	user 0.001s	sys 0.000s
I20260709 13:10:36.027305 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:36.056100 27270 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:35.946400 26652 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:36.033730 29482 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:35.697400 29692 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:36.061741 29526 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.062425 29705 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:36.063172 29754 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:36.063450 29692 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:36.063915 29526 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:36.039548 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 573255us
I20260709 13:10:35.803087 29684 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:35.754345 29404 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:36.042130 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.071161 29616 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:36.071409 29684 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:36.071892 29616 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.072368 29616 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.074005 27276 raft_consensus.cc:2410] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:36.073915 29749 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.076742 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:36.037421 26577 rpcz_store.cc:276] 0709 13:10:34.391893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.395277 (+  3384us) service_pool.cc:224] Handling call
0709 13:10:34.395600 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.449585 (+ 53985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.449707 (+   122us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.456807 (+  7100us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.677848 (+221041us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:34.677957 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.678089 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.442629 (+764540us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:35.657189 (+214560us) raft_consensus.cc:1685] finished
0709 13:10:35.657211 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.657440 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55566,"raft.queue_time_us":56993,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":70796,"spinlock_wait_cycles":55833984,"thread_start_us":98819,"threads_started":1,"wal-append.queue_time_us":269103}
I20260709 13:10:35.920569 29664 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:36.044821 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 330629us
I20260709 13:10:36.034415 27275 rpcz_store.cc:276] 0709 13:10:34.418966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.434033 (+ 15067us) service_pool.cc:224] Handling call
0709 13:10:34.434417 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.451012 (+ 16595us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:34.551498 (+100486us) log.cc:844] Serialized 14 byte log entry
0709 13:10:35.238403 (+686905us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b1800418600. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f88307fd58f 00007f882983c571 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd
0709 13:10:35.300309 (+ 61906us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.306163 (+  5854us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.306346 (+   183us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:35.306379 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.306442 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.997008 (+690566us) raft_consensus.cc:1685] finished
0709 13:10:35.997118 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.997305 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":664496,"prepare.queue_time_us":84891,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":47,"raft.queue_time_us":604252,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":32096,"spinlock_wait_cycles":4502784,"thread_start_us":117614,"threads_started":1,"wal-append.queue_time_us":178631}
W20260709 13:10:36.025491 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 359523us
I20260709 13:10:35.930867 29303 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.044844 29744 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.081094 26474 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:35.997773 29736 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:36.057679 29745 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:36.064494 29526 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:36.035197 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:36.078363 27277 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:36.076488 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:36.079614 26476 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:36.064013 26504 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.092084 26474 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:36.092442 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:36.094009 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:36.081720 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:36.064330 29754 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:36.074569 29749 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.075835 29404 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.123214 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:36.102030 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:36.079000 29602 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.053066 29731 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:36.136515 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 60137.8us
I20260709 13:10:36.078898 29753 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:36.134479 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:36.139657 27277 raft_consensus.cc:1813] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Handling vote request from an unknown peer ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:36.140445 27277 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:36.086879 29664 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:36.053834 29419 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:36.085786 29747 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:10:36.079128 29482 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.126263 26585 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:36.145531 27271 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 4: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:36.142807 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:36.145246 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:36.145427 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 63818.4us
I20260709 13:10:36.144066 29687 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.079952 29380 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:36.100644 29745 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:36.149174 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 57173.2us
I20260709 13:10:36.106856 29658 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:36.132863 29274 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:36.139714 29702 consensus_meta.cc:287] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.837s	user 0.014s	sys 0.000s
I20260709 13:10:36.132587 29404 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.154280 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:36.082454 29692 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:10:36.082906 29303 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.160163 26585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:10:36.160290 29036 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:36.158317 29482 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.145265 29664 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:36.161671 29419 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:36.162523 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:36.167148 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1892) took 1396 ms. Trace:
I20260709 13:10:36.167375 29731 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:36.169220 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1888) took 1457 ms. Trace:
I20260709 13:10:36.199126 26657 rpcz_store.cc:276] 0709 13:10:34.711526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.019565 (+308039us) service_pool.cc:224] Handling call
0709 13:10:35.019865 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.715706 (+695841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.715744 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:35.715801 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:35.715855 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.168958 (+453103us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b5400169254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:36.169003 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.169164 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599740800}
I20260709 13:10:36.106379 29736 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.132661 29760 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:36.124366 29723 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.145315 29753 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:36.220324 29753 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:36.214344 29760 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:36.220940 29705 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:36.221736 29760 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.225466 29723 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:36.228937 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:36.232247 26583 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:36.172063 29309 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.140542 29661 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.161731 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:36.182091 26577 raft_consensus.cc:2368] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6.
W20260709 13:10:36.184828 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.184939 26474 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:36.191655 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 110809us
I20260709 13:10:36.129765 29526 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.194139 26658 rpcz_store.cc:276] 0709 13:10:34.771250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.913038 (+141788us) service_pool.cc:224] Handling call
0709 13:10:36.166960 (+1253922us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54001f5c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:36.167064 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308957568}
I20260709 13:10:36.202428 29731 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:36.202533 29692 raft_consensus.cc:3055] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:36.204268 29751 log.cc:927] Time spent T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
I20260709 13:10:36.181777 29274 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:36.206805 29749 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:36.209167 29482 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:36.181011 29745 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:36.213604 26509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.020s	sys 0.076s
W20260709 13:10:36.288909 26509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.020s	sys 0.076s
I20260709 13:10:36.139197 29602 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.203097 29684 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:10:36.298585 29482 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:36.190538 29702 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:36.284646 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99847us
I20260709 13:10:36.300052 26474 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:36.265950 26583 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:36.294503 29602 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:36.295524 29708 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.053s	user 0.003s	sys 0.000s
I20260709 13:10:36.296022 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1878) took 1615 ms. Trace:
I20260709 13:10:36.280118 29692 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:36.259258 29616 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:36.234144 29669 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.275579 29348 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:36.304878 26507 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:36.298955 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1890) took 1564 ms. Trace:
I20260709 13:10:36.282294 29274 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.304636 26656 rpcz_store.cc:276] 0709 13:10:34.680162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.680271 (+   109us) service_pool.cc:224] Handling call
0709 13:10:36.295768 (+1615497us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b5400109354. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:36.295947 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331085696}
I20260709 13:10:36.284157 29658 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:36.304023 29672 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:36.329797 26474 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:36.318372 29623 consensus_meta.cc:287] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.196s	user 0.009s	sys 0.006s
I20260709 13:10:36.320977 26655 rpcz_store.cc:276] 0709 13:10:34.734854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.092892 (+358038us) service_pool.cc:224] Handling call
0709 13:10:35.093411 (+   519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.242316 (+148905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.242351 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.242840 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.574182 (+331342us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:35.574282 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.574354 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.298741 (+724387us) raft_consensus.cc:1685] finished
0709 13:10:36.298765 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.298897 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185558,"raft.queue_time_us":200162,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":12535,"thread_start_us":241455,"threads_started":1,"wal-append.queue_time_us":443948}
I20260709 13:10:36.304435 29117 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:36.287194 29731 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.334724 29348 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:36.355669 26474 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:36.357167 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 210148us
I20260709 13:10:36.340325 29303 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:36.358312 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:36.370126 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:36.364601 26504 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:36.341434 29309 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:36.387293 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:36.336095 29672 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.339545 29623 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:36.407027 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 48789.2us
I20260709 13:10:36.406289 29734 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:36.336971 29759 consensus_queue.cc:1059] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:10:36.415920 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 278387us
W20260709 13:10:36.410161 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 54586.7us
I20260709 13:10:36.417344 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:36.409943 26656 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 4.
I20260709 13:10:36.426321 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:36.428560 26659 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:36.427917 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:36.398033 29117 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:36.473768 26585 raft_consensus.cc:606] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:36.474411 26585 raft_consensus.cc:614] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:36.497265 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 250663us
W20260709 13:10:36.504385 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 76597.2us
I20260709 13:10:36.509011 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:36.389815 29380 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:36.486191 26578 raft_consensus.cc:2393] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:36.426438 29734 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.513147 26657 raft_consensus.cc:2410] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:10:36.522348 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 103352us
I20260709 13:10:36.507100 26549 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:36.536185 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:36.537175 26656 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.544582 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:36.550465 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:36.557250 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:36.525954 29734 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.553066 27241 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:36.409050 29692 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.574107 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:36.574395 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 146543us
I20260709 13:10:36.575117 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:36.426848 29763 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:10:36.555303 29754 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:36.547772 29547 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:36.586797 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:36.548521 29736 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:36.599207 26657 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:36.606137 26474 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:36.606779 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 62243.5us
I20260709 13:10:36.573545 29677 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:36.602661 29754 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.608062 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:36.607467 26549 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:36.586390 29282 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:36.583253 29702 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:36.618198 26656 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:36.584794 29526 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:36.647619 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 72565.6us
I20260709 13:10:36.601907 29669 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:36.533660 29348 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.599538 29788 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.611887 29547 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:36.662724 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 55328.2us
I20260709 13:10:36.621290 29282 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.644987 29380 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:36.613547 29736 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:36.667385 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 126728us
I20260709 13:10:36.623378 29754 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.672154 26622 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:36.654604 29731 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:36.671663 29282 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:36.668736 29702 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.714325 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:36.715467 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:36.716189 27275 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:36.718542 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:36.677186 29769 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:36.694303 29736 raft_consensus.cc:697] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:36.725229 29781 log.cc:927] Time spent T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:10:36.726019 29736 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.726814 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:36.728843 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 59723.7us
I20260709 13:10:36.679005 29623 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:36.730768 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2082) took 1094 ms. Trace:
I20260709 13:10:36.680735 29759 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:36.734419 26657 raft_consensus.cc:2393] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:36.735334 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:36.681128 29791 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.735397 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:36.732908 26502 rpcz_store.cc:276] 0709 13:10:35.636311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.296763 (+660452us) service_pool.cc:224] Handling call
0709 13:10:36.297142 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.297524 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.297574 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.298153 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.449044 (+150891us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:36.449103 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.449201 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.730547 (+281346us) raft_consensus.cc:1685] finished
0709 13:10:36.730569 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.730708 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":471,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":161,"thread_start_us":150439,"threads_started":1,"wal-append.queue_time_us":249140}
I20260709 13:10:36.741518 27270 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:36.687965 29672 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:36.750891 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:36.751859 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:36.742251 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 75109.1us
I20260709 13:10:36.753326 26548 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:36.757135 29786 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 13:10:36.758656 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.759472 29766 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:10:36.670970 29788 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:36.761792 29777 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.762557 29777 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:36.765206 29618 consensus_meta.cc:287] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
I20260709 13:10:36.765724 29618 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.766044 29777 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:36.770221 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:36.771507 29772 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 13:10:36.774044 29775 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:10:36.774755 29702 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.775300 29702 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:36.736387 29762 log.cc:927] Time spent T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:10:36.679642 29380 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:36.784795 29623 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:36.718308 29796 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:36.785794 29660 raft_consensus.cc:3055] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:36.785944 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:36.787993 26658 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:36.823995 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:36.808920 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 200886us
I20260709 13:10:36.765574 29547 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:36.965446 26657 raft_consensus.cc:2393] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:10:36.965948 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 212692us
I20260709 13:10:36.967569 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:36.852456 26622 leader_election.cc:336] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 2.230s (SENT)
I20260709 13:10:36.970860 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:36.739706 29687 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:36.954444 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2088) took 1315 ms. Trace:
I20260709 13:10:36.958567 26650 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
W20260709 13:10:37.008105 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.859319 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 406) took 1295 ms. Trace:
I20260709 13:10:36.981132 26509 rpcz_store.cc:276] 0709 13:10:35.639079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.291493 (+652414us) service_pool.cc:224] Handling call
0709 13:10:36.291886 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.292120 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:36.467899 (+175779us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.655866 (+187967us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.953961 (+298095us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:36.954035 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:36.954097 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.954188 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.954363 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38841,"prepare.queue_time_us":520671,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":71,"raft.queue_time_us":101274,"raft.run_cpu_time_us":584,"raft.run_wall_time_us":33449,"thread_start_us":590302,"threads_started":4,"wal-append.queue_time_us":106357}
I20260709 13:10:36.778133 29763 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:37.039260 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 71783.7us
W20260709 13:10:36.902019 26625 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.732s (SENT) [suppressed 20 similar messages]
I20260709 13:10:36.885124 27269 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:36.955109 29785 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
W20260709 13:10:37.043267 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 141273us
I20260709 13:10:37.046939 26658 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:36.825362 29759 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.885119 29771 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:37.051465 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:37.062865 26658 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.979074 29687 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:37.051730 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:37.055368 27241 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:37.009934 26501 rpcz_store.cc:276] 0709 13:10:35.565234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.578454 (+ 13220us) service_pool.cc:224] Handling call
0709 13:10:35.578850 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.694052 (+115202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.694099 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.700191 (+  6092us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.079084 (+378893us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b18002c0560. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c90d1 00007f882c8e4a0f
0709 13:10:36.282817 (+203733us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:36.282872 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.282941 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.778579 (+495638us) raft_consensus.cc:1685] finished
0709 13:10:36.778600 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.859201 (+ 80601us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42938,"raft.queue_time_us":114532,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":33544,"spinlock_wait_cycles":6976896,"thread_start_us":273968,"threads_started":2,"wal-append.queue_time_us":712182}
I20260709 13:10:36.889425 29458 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:36.886195 29616 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.970192 29660 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:37.061579 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:37.078707 26657 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
W20260709 13:10:37.075031 29794 log.cc:927] Time spent T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 13:10:37.082315 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1901) took 1294 ms. Trace:
I20260709 13:10:37.086448 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 410) took 1028 ms. Trace:
I20260709 13:10:37.086846 26509 rpcz_store.cc:276] 0709 13:10:36.058590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.060947 (+1002357us) service_pool.cc:224] Handling call
0709 13:10:37.085955 (+ 25008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.086134 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.086169 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.086208 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:37.086242 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.086295 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.086395 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.083779 26653 rpcz_store.cc:276] 0709 13:10:35.787798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.788123 (+   325us) service_pool.cc:224] Handling call
0709 13:10:35.907182 (+119059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.930806 (+ 23624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.930849 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.023449 (+ 92600us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.190439 (+166990us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:36.190481 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.190547 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.082106 (+891559us) raft_consensus.cc:1685] finished
0709 13:10:37.082125 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.082254 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3066,"raft.queue_time_us":19387,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":988,"thread_start_us":166602,"threads_started":1,"wal-append.queue_time_us":325681}
I20260709 13:10:37.094369 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:37.053017 29702 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:36.788523 29791 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.097577 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:37.095530 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:37.017019 29623 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.059715 29796 raft_consensus.cc:697] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:37.063849 29793 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:37.105793 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 253385us
W20260709 13:10:37.115773 26622 connection.cc:256] RPC call timeout handler was delayed by -1.2263896360000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 13:10:37.116185 26622 connection.cc:256] RPC call timeout handler was delayed by -1.2153836310001225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2687s for a response
I20260709 13:10:37.117811 29705 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:37.080369 29687 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:37.049588 29763 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.117869 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:37.112406 29723 consensus_meta.cc:287] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.886s	user 0.014s	sys 0.000s
I20260709 13:10:37.126214 29799 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:37.128859 29672 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:37.130203 29773 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
W20260709 13:10:37.135568 29734 consensus_meta.cc:287] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
I20260709 13:10:37.136106 29734 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.140453 26658 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:37.141000 29705 raft_consensus.cc:2764] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:37.142916 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1893) took 1557 ms. Trace:
I20260709 13:10:37.143381 26651 rpcz_store.cc:276] 0709 13:10:35.585426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.598098 (+ 12672us) service_pool.cc:224] Handling call
0709 13:10:35.598678 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.804531 (+205853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.804581 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:35.804637 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:35.804683 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.142640 (+1337957us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400106654. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:37.142690 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.142849 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472807168}
I20260709 13:10:37.144940 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:37.146248 29618 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:37.148315 26567 tablet_service.cc:1558] Processing DeleteTablet for tablet 574d2707e806420dab53495563bd03aa with delete_type TABLET_DATA_TOMBSTONED (TS ef2886777a8f45e69e213b02a22ecec7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36124
I20260709 13:10:37.149420 29723 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:37.129624 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:37.152395 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.152839 26653 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:37.067022 29759 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.089533 29616 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.160482 26622 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:37.154738 29785 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:37.153041 26548 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:37.159343 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:37.158360 29764 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:10:37.182997 26622 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:37.190759 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:37.217082 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 64173.1us
I20260709 13:10:37.130234 29672 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:37.219609 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:37.231406 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 176188us
W20260709 13:10:37.223264 29603 consensus_meta.cc:287] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.185s	user 0.009s	sys 0.004s
I20260709 13:10:37.222244 29795 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:37.221300 26548 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:37.220664 29792 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:37.219504 29791 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:37.224264 29771 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.224397 29723 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:37.251230 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 68139us
I20260709 13:10:37.256196 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:37.258554 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:37.261130 26476 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:37.262778 29603 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:37.263423 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:37.245405 29754 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.003s
I20260709 13:10:37.226784 29801 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:37.238824 29783 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.451s	user 0.001s	sys 0.001s
I20260709 13:10:37.240022 29788 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:37.287966 26476 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:37.293789 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 409) took 1623 ms. Trace:
I20260709 13:10:37.297240 26476 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:37.298029 26506 rpcz_store.cc:276] 0709 13:10:35.670702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.577726 (+907024us) service_pool.cc:224] Handling call
0709 13:10:36.603978 (+ 26252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.604205 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:36.912509 (+308304us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.293220 (+380711us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.293344 (+   124us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:37.293421 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.293527 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.293700 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44178,"prepare.queue_time_us":117244,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"thread_start_us":636593,"threads_started":3,"wal-append.queue_time_us":340170}
I20260709 13:10:37.307845 29807 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:37.310065 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 46199.7us
I20260709 13:10:37.244518 29792 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:37.309185 29807 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:37.322882 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 69944.9us
I20260709 13:10:37.267654 29791 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:37.262498 29723 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:37.262172 29661 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:37.313992 29526 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.338133 29723 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:37.292768 29458 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:37.290398 29801 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.244904 29687 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:37.344574 29741 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 1.780s	user 0.002s	sys 0.010s
I20260709 13:10:37.346483 29763 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:37.347182 29526 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.350673 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:37.353442 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 686) took 1310 ms. Trace:
W20260709 13:10:37.355458 29800 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.580s	user 0.002s	sys 0.000s
W20260709 13:10:37.355996 29282 consensus_meta.cc:287] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.632s	user 0.003s	sys 0.007s
I20260709 13:10:37.394244 29623 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:37.394476 29282 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.395244 29790 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:37.395602 29810 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:37.395668 29790 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:37.396262 29794 log.cc:927] Time spent T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:37.396239 29790 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:37.396929 29526 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:37.398022 27273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 776) took 1901 ms (client timeout 2082 ms). Trace:
W20260709 13:10:37.398412 27273 rpcz_store.cc:269] 0709 13:10:35.496655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.497694 (+  1039us) service_pool.cc:224] Handling call
0709 13:10:37.350528 (+1852834us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b5800161a98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804e9c 00007f8829804a5b 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:10:37.397948 (+ 47420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11891584}
I20260709 13:10:37.359654 29723 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.400734 29723 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:37.361106 29787 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.608s	user 0.001s	sys 0.001s
I20260709 13:10:37.392099 26654 rpcz_store.cc:276] 0709 13:10:36.042903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.043072 (+   169us) service_pool.cc:224] Handling call
0709 13:10:36.043436 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.247785 (+204349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.247836 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:36.247897 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:36.247948 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.353211 (+1105263us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54001d47d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:37.353260 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.353386 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469323648}
I20260709 13:10:37.401744 26508 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:37.365262 26503 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:37.402318 29791 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.367343 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.370294 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39748 (request call id 17) took 1875 ms. Trace:
I20260709 13:10:37.403332 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 408) took 1756 ms. Trace:
I20260709 13:10:37.403453 26585 rpcz_store.cc:276] 0709 13:10:35.509119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.158262 (+649143us) service_pool.cc:224] Handling call
0709 13:10:37.370022 (+1211760us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54000d8754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c923853 00007f88318f160a 00007f882ae777d4 00007f882ae77762 00007f882ae77691 00007f882ae7760c 00007f882ae768c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:37.370174 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671444736}
W20260709 13:10:37.366897 29808 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:37.314638 29380 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:37.404706 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.397295 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2638) took 1839 ms. Trace:
I20260709 13:10:37.371508 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1784) took 2688 ms. Trace:
I20260709 13:10:37.325683 29672 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.406054 26580 rpcz_store.cc:276] 0709 13:10:34.683207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.683322 (+   115us) service_pool.cc:224] Handling call
0709 13:10:34.698579 (+ 15257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.557108 (+858529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.371123 (+1814015us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54003d1154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:37.371404 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956906368}
I20260709 13:10:37.406841 29616 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:37.407439 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.373659 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:37.377095 26625 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:37.408983 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:37.318696 29664 consensus_meta.cc:287] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.116s	user 0.008s	sys 0.005s
W20260709 13:10:37.376616 29745 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.085s	user 0.009s	sys 0.001s
I20260709 13:10:37.319619 29792 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:37.320057 29795 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:37.383791 29458 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.357399 29661 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.434847 29723 consensus_queue.cc:1059] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:37.436020 29723 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:37.436194 29661 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:37.436426 29723 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:37.429281 29745 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.402724 26503 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:37.404590 29791 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:37.370409 29759 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:37.429196 29795 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:37.468825 29795 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:37.405673 29274 consensus_meta.cc:287] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.071s	user 0.006s	sys 0.006s
I20260709 13:10:37.322037 29807 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:37.380271 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 121785us
I20260709 13:10:37.402519 26654 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: [3.3-6.4]
I20260709 13:10:37.483784 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:37.484548 26654 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:37.403332 26584 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:37.486263 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 595) took 1168 ms. Trace:
I20260709 13:10:37.409344 26659 raft_consensus.cc:1240] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:37.412577 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.403753 26507 rpcz_store.cc:276] 0709 13:10:35.646979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.338836 (+691857us) service_pool.cc:224] Handling call
0709 13:10:36.349674 (+ 10838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.350008 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.350035 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.369472 (+ 19437us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.578328 (+208856us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:37.057933 (+479605us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.268869 (+210936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.268940 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.360249 (+ 91309us) spinlock_profiling.cc:243] Waited 9.26 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:37.403047 (+ 42798us) raft_consensus.cc:1685] finished
0709 13:10:37.403159 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.403274 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4031,"prepare.queue_time_us":95825,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":8610,"raft.queue_time_us":62389,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":13793,"spinlock_wait_cycles":21292416,"thread_start_us":760025,"threads_started":3,"wal-append.queue_time_us":280775}
I20260709 13:10:37.261936 29796 consensus_queue.cc:237] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.425120 26625 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:37.383162 29801 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:37.427385 29769 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.000s
I20260709 13:10:37.292455 29754 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.430044 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 407) took 1838 ms. Trace:
I20260709 13:10:37.493988 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:37.494625 26659 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
W20260709 13:10:37.495790 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 70747.8us
I20260709 13:10:37.438726 29458 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:37.408546 26583 rpcz_store.cc:276] 0709 13:10:35.558192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.301672 (+743480us) service_pool.cc:224] Handling call
0709 13:10:36.304151 (+  2479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.320794 (+ 16643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.320839 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.333898 (+ 13059us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.541908 (+208010us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:36.541949 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.542018 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.397062 (+855044us) raft_consensus.cc:1685] finished
0709 13:10:37.397083 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.397238 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16264,"raft.queue_time_us":94705,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":16103,"thread_start_us":194879,"threads_started":1,"wal-append.queue_time_us":371752}
W20260709 13:10:37.336215 29744 consensus_meta.cc:287] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.252s	user 0.014s	sys 0.000s
I20260709 13:10:37.400900 29687 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:37.420804 29404 consensus_meta.cc:287] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.220s	user 0.014s	sys 0.000s
I20260709 13:10:37.396929 29282 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:37.390439 26653 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:37.490490 29807 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.465976 29745 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:37.409838 29822 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:37.486694 26584 rpcz_store.cc:276] 0709 13:10:36.318318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.366937 (+1048619us) service_pool.cc:224] Handling call
0709 13:10:37.486183 (+119246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.431046 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:37.496634 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 147508us
I20260709 13:10:37.533036 26659 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:37.481956 29661 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.493788 26510 rpcz_store.cc:276] 0709 13:10:35.591615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.592217 (+   602us) service_pool.cc:224] Handling call
0709 13:10:35.617177 (+ 24960us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:35.646955 (+ 29778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.646987 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:35.666229 (+ 19242us) log.cc:844] Serialized 52 byte log entry
0709 13:10:36.902006 (+1235777us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b18002f7a00. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c90d1 00007f882c8e4a0f
0709 13:10:37.158266 (+256260us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:37.158321 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.158417 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.429764 (+271347us) raft_consensus.cc:1685] finished
0709 13:10:37.429783 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.429990 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85142,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":123313,"spinlock_wait_cycles":107014400,"thread_start_us":256072,"threads_started":1,"wal-append.queue_time_us":1560393}
I20260709 13:10:37.464725 26503 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.537781 26585 raft_consensus.cc:2393] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:37.423501 29664 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.542822 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1812) took 1010 ms. Trace:
I20260709 13:10:37.497885 29769 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:37.542136 26580 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:37.516970 29788 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:37.548687 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 596) took 1210 ms. Trace:
I20260709 13:10:37.550272 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.551258 26503 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:37.540971 29760 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.318s	user 0.010s	sys 0.004s
I20260709 13:10:37.537925 29734 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:37.490428 29274 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.437395 29723 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.517346 29827 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
W20260709 13:10:37.620512 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 323469us
I20260709 13:10:37.576265 26654 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
W20260709 13:10:37.618336 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 118680us
W20260709 13:10:37.670451 26504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2080) took 2035 ms (client timeout 2176 ms). Trace:
W20260709 13:10:37.645781 26473 leader_election.cc:336] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.582s (SENT)
I20260709 13:10:37.673930 26654 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:37.674166 26473 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:37.674021 26504 rpcz_store.cc:269] 0709 13:10:35.635176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.643515 (+  8339us) service_pool.cc:224] Handling call
0709 13:10:37.670238 (+2026723us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54000023d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:37.670356 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964987648}
I20260709 13:10:37.675428 26654 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:37.552795 26580 rpcz_store.cc:276] 0709 13:10:36.338757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.408386 (+1069629us) service_pool.cc:224] Handling call
0709 13:10:37.548606 (+140220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.547722 26659 rpcz_store.cc:276] 0709 13:10:36.532532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.512050 (+979518us) service_pool.cc:224] Handling call
0709 13:10:37.512456 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.542584 (+ 30128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.542771 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.679468 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.575825 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.671859 26583 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 3.
I20260709 13:10:37.680578 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:37.682217 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.682426 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.683228 26502 raft_consensus.cc:2410] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:37.684008 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 597) took 1311 ms. Trace:
I20260709 13:10:37.684293 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:37.685223 26578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2631) took 2328 ms (client timeout 2235 ms). Trace:
I20260709 13:10:37.685420 26509 raft_consensus.cc:2410] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:10:37.656749 29748 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.739s	user 0.000s	sys 0.006s
I20260709 13:10:37.684396 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.688827 26622 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:37.689502 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.619877 29687 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.687119 26625 leader_election.cc:400] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6.
I20260709 13:10:37.687706 26501 raft_consensus.cc:2368] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6.
W20260709 13:10:37.685653 26578 rpcz_store.cc:269] 0709 13:10:35.344432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.027295 (+682863us) service_pool.cc:224] Handling call
0709 13:10:37.672520 (+1645225us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54000d8754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:37.672649 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027573120}
I20260709 13:10:37.693902 26625 leader_election.cc:403] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:37.688158 26504 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:37.552644 29788 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.538249 29404 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.690299 26509 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:37.691051 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 599) took 1157 ms. Trace:
I20260709 13:10:37.695106 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.691493 26659 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:37.636605 29822 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:37.703109 26507 raft_consensus.cc:2410] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:37.684397 26583 rpcz_store.cc:276] 0709 13:10:36.372731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.540518 (+1167787us) service_pool.cc:224] Handling call
0709 13:10:37.681086 (+140568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.697271 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.537545 29744 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.699190 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.705340 26625 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:37.683259 29791 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:37.706899 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.707551 26578 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 2.
I20260709 13:10:37.708875 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.692314 29734 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:37.705616 26506 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:37.713932 29734 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:37.714476 29734 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:37.680327 29684 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:10:37.717896 29684 consensus_queue.cc:1243] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:10:37.759466 29833 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:37.552022 29661 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.770934 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:37.768160 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.771806 26659 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:37.768858 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.769320 26580 rpcz_store.cc:276] 0709 13:10:36.533202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.678938 (+1145736us) service_pool.cc:224] Handling call
0709 13:10:37.690454 (+ 11516us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.772655 29822 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.680533 29677 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:10:37.773317 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:37.776660 26580 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:37.777738 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1802) took 1017 ms. Trace:
I20260709 13:10:37.778160 26584 rpcz_store.cc:276] 0709 13:10:36.760856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.696680 (+935824us) service_pool.cc:224] Handling call
0709 13:10:37.777666 (+ 80986us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.778574 26659 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:37.778872 26583 raft_consensus.cc:2368] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5.
I20260709 13:10:37.780040 26577 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:37.781177 29839 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6.
I20260709 13:10:37.781366 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.782219 26584 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:37.783217 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.784087 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 598) took 1356 ms. Trace:
I20260709 13:10:37.785351 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 600) took 1050 ms. Trace:
I20260709 13:10:37.785247 26584 rpcz_store.cc:276] 0709 13:10:36.428135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.782936 (+1354801us) service_pool.cc:224] Handling call
0709 13:10:37.784023 (+  1087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.787156 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2081) took 2151 ms. Trace:
I20260709 13:10:37.785943 26583 rpcz_store.cc:276] 0709 13:10:36.734881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.705859 (+970978us) service_pool.cc:224] Handling call
0709 13:10:37.785287 (+ 79428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.679541 29760 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.701732 29788 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:37.789599 26659 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:37.787866 26503 rpcz_store.cc:276] 0709 13:10:35.635452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.364600 (+1729148us) service_pool.cc:224] Handling call
0709 13:10:37.365075 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.786800 (+421725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.786831 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.786874 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:37.786915 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.786980 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.787087 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16376}
I20260709 13:10:37.805236 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2086) took 2167 ms. Trace:
W20260709 13:10:37.807394 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 102133us
I20260709 13:10:37.806407 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:37.805769 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:37.808065 26509 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:37.808406 26578 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:37.809396 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:37.770009 29791 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:37.820693 26476 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:37.807667 26505 rpcz_store.cc:276] 0709 13:10:35.637937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.374608 (+1736671us) service_pool.cc:224] Handling call
0709 13:10:37.375047 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.375476 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:37.375522 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.376143 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.543154 (+167011us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:37.543204 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.543275 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.790986 (+247711us) raft_consensus.cc:1685] finished
0709 13:10:37.791023 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.805169 (+ 14146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49028,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":166627,"threads_started":1,"wal-append.queue_time_us":385401}
I20260709 13:10:37.697772 29687 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.839795 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:37.840857 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 139112us
I20260709 13:10:37.840924 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:37.841054 26473 leader_election.cc:336] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.628s (SENT)
I20260709 13:10:37.843690 26503 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:37.776337 29684 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.846529 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.719228 29840 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:37.850557 26584 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:37.844762 26510 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:37.844190 26622 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:37.770814 29618 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.854355 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.854593 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:37.855710 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:37.856510 27270 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:37.856822 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.860203 26579 raft_consensus.cc:2368] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9.
I20260709 13:10:37.836688 29791 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:37.882579 26579 raft_consensus.cc:1240] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:37.878183 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1793) took 3022 ms. Trace:
I20260709 13:10:37.885231 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 593) took 2271 ms. Trace:
I20260709 13:10:37.840713 29812 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:37.886862 29830 log.cc:927] Time spent T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:10:37.886526 29791 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:37.890149 29835 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:10:37.891093 29837 log.cc:927] Time spent T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:10:37.885684 26579 rpcz_store.cc:276] 0709 13:10:35.613964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.882041 (+2268077us) service_pool.cc:224] Handling call
0709 13:10:37.882409 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.884979 (+  2570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.885176 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.845424 29827 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:37.939564 27272 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:37.940532 26579 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:37.854573 29380 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:37.905385 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:37.907482 29036 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.910243 29844 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.911792 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 687) took 1846 ms. Trace:
I20260709 13:10:37.892383 29458 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.912473 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1804) took 1404 ms. Trace:
I20260709 13:10:37.968838 26655 rpcz_store.cc:276] 0709 13:10:36.508202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.508304 (+   102us) service_pool.cc:224] Handling call
0709 13:10:36.526698 (+ 18394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.658415 (+1131717us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b18001bf760. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882c4d14bc 00007f882981f48b 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f8829839455 00007f882c921060 00007f882c921bfb 00007f882c92c64b
0709 13:10:37.658600 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.658639 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.669662 (+ 11023us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.769038 (+ 99376us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:37.769083 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.769161 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.912201 (+143040us) raft_consensus.cc:1685] finished
0709 13:10:37.912220 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.912412 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79421,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":1027,"spinlock_wait_cycles":72308480,"thread_start_us":180896,"threads_started":2,"wal-append.queue_time_us":190397}
I20260709 13:10:37.914002 29687 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:37.914402 29822 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:37.914693 27274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 805) took 3494 ms (client timeout 1684 ms). Trace:
I20260709 13:10:37.861450 29618 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.915261 29274 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:37.915766 27275 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:37.915023 29282 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.917227 29834 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:37.918036 29750 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 2.016s	user 0.003s	sys 0.000s
I20260709 13:10:37.919056 29658 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.867774 26476 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:37.885535 26581 rpcz_store.cc:276] 0709 13:10:34.855675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.922350 (+ 66675us) service_pool.cc:224] Handling call
0709 13:10:34.936625 (+ 14275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.011481 (+ 74856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.011626 (+   145us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.140894 (+129268us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b2c00010828. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882b222a11 00007f882b232372 00007f882c964a01 00007f882c92943a 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2
0709 13:10:35.168231 (+ 27337us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.511014 (+342783us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:35.511054 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.511124 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.655938 (+2144814us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:37.877520 (+221582us) raft_consensus.cc:1685] finished
0709 13:10:37.877551 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.878104 (+   553us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9660,"raft.queue_time_us":3627,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":62976128,"thread_start_us":209653,"threads_started":1,"wal-append.queue_time_us":413418}
W20260709 13:10:37.920643 29818 log.cc:927] Time spent T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.484s	user 0.000s	sys 0.002s
I20260709 13:10:37.921167 26509 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:37.991279 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.870267 26503 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:37.923907 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.926608 29734 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.926847 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.928444 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.997398 26502 raft_consensus.cc:2410] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:37.997150 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1806) took 1482 ms. Trace:
I20260709 13:10:37.930815 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 519) took 2374 ms. Trace:
I20260709 13:10:37.918079 29821 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:37.931627 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.931814 29725 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:37.877851 29792 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:37.934521 29801 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.903272 29677 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:37.843194 29790 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.933504 26580 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:38.005348 26580 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:10:37.947240 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 92709.1us
I20260709 13:10:38.006170 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:37.955267 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 594) took 2336 ms. Trace:
I20260709 13:10:37.955948 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.007534 27277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:37164
I20260709 13:10:38.007896 26505 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:38.008100 27277 raft_consensus.cc:606] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:37.968865 29036 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.960661 27270 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:37.962313 27272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 773) took 2461 ms. Trace:
I20260709 13:10:37.965265 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2646) took 1312 ms. Trace:
I20260709 13:10:37.892457 29661 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:37.921025 29795 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.041972 29795 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.044618 29618 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:37.974092 27274 rpcz_store.cc:269] 0709 13:10:34.419916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.420572 (+   656us) service_pool.cc:224] Handling call
0709 13:10:37.914498 (+3493926us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54006a4fd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:37.914601 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233670528}
I20260709 13:10:37.915087 29526 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:37.897593 29812 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:37.977283 26653 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:37.857786 29684 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.047614 29526 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.049886 29684 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:37.963202 29702 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:37.980567 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:37.966924 26652 rpcz_store.cc:276] 0709 13:10:36.065604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.077380 (+ 11776us) service_pool.cc:224] Handling call
0709 13:10:36.086582 (+  9202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.158824 (+ 72242us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:36.193831 (+ 35007us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.349648 (+155817us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.349888 (+   240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:36.349948 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:36.350011 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.669044 (+1319033us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b1800381760. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c522 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:37.909628 (+240584us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b1800381760. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882980a2a6 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419
0709 13:10:37.911437 (+  1809us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b54002d9e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:37.911499 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.911701 (+   202us) inbound_call.cc:177] Queueing success response
0709 13:10:37.931458 (+ 19757us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b1800381760. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c522 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
Metrics: {"mutex_wait_us":17496,"prepare.queue_time_us":36951,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":1710,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":19814,"spinlock_wait_cycles":273719168,"thread_start_us":155131,"threads_started":1,"wal-append.queue_time_us":342122,"wal-append.run_cpu_time_us":2576,"wal-append.run_wall_time_us":1234349}
I20260709 13:10:37.985915 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:38.051201 26506 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:37.997253 29282 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:37.989856 29822 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:37.998768 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.002490 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:37.997902 26658 rpcz_store.cc:276] 0709 13:10:36.514788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.220066 (+705278us) service_pool.cc:224] Handling call
0709 13:10:37.220394 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.225235 (+  4841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.225272 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.230823 (+  5551us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.511587 (+280764us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:37.690971 (+179384us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.852420 (+161449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.852495 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.996872 (+144377us) raft_consensus.cc:1685] finished
0709 13:10:37.996900 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.997071 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83884,"prepare.queue_time_us":156941,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":36,"raft.queue_time_us":100408,"raft.run_cpu_time_us":2125,"raft.run_wall_time_us":41527,"thread_start_us":448678,"threads_started":3,"wal-append.queue_time_us":375558}
I20260709 13:10:37.981455 29791 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:38.055081 29482 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:38.058842 29482 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:38.059250 29482 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.061396 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:38.062091 29811 log.cc:927] Time spent T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.752s	user 0.002s	sys 0.000s
I20260709 13:10:38.062060 26657 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:38.063102 29819 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.627s	user 0.001s	sys 0.001s
W20260709 13:10:37.893862 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 84534us
I20260709 13:10:38.066728 29822 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.067137 29822 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.069700 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.061431 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.070696 26509 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
W20260709 13:10:38.057233 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 54839.7us
I20260709 13:10:38.006759 26580 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:38.008461 27277 raft_consensus.cc:614] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:37.852254 29840 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:38.007081 26579 rpcz_store.cc:276] 0709 13:10:35.618908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.939955 (+2321047us) service_pool.cc:224] Handling call
0709 13:10:37.940307 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.940983 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.955209 (+ 14226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:38.010087 26581 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:10:38.007252 26501 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:38.074402 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1806) took 1304 ms. Trace:
I20260709 13:10:38.074810 26581 rpcz_store.cc:276] 0709 13:10:36.770181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.999053 (+1228872us) service_pool.cc:224] Handling call
0709 13:10:38.009700 (+ 10647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.074143 (+ 64443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.074347 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:38.015415 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:37.999737 27269 rpcz_store.cc:276] 0709 13:10:35.556339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.557932 (+  1593us) service_pool.cc:224] Handling call
0709 13:10:37.930595 (+2372663us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400845154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:37.930752 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2743330176}
I20260709 13:10:38.016511 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.080058 26654 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:38.080281 26502 raft_consensus.cc:2368] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6.
I20260709 13:10:38.016995 29036 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:38.020283 29779 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 1.372s	user 0.003s	sys 0.010s
I20260709 13:10:38.022818 29754 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:38.031744 29404 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:38.047607 29812 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:37.997493 29658 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.025547 29692 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.026273 29844 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:38.037380 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.039135 29458 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:38.051461 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 65651us
I20260709 13:10:38.030403 29274 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:10:38.029484 26622 leader_election.cc:400] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6.
W20260709 13:10:38.117980 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 88677.7us
I20260709 13:10:38.118201 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:38.119073 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.106659 29844 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:38.049901 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.120083 29844 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.013724 26583 rpcz_store.cc:276] 0709 13:10:36.653097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.964020 (+1310923us) service_pool.cc:224] Handling call
0709 13:10:37.964433 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.964803 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.964845 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.964905 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:37.964960 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.965039 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.965192 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4542}
I20260709 13:10:38.035403 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1797) took 2527 ms. Trace:
I20260709 13:10:38.055711 29821 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:38.066445 29789 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.281s	user 0.002s	sys 0.000s
I20260709 13:10:38.074882 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.013525 27272 rpcz_store.cc:276] 0709 13:10:35.478782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.482942 (+  4160us) service_pool.cc:224] Handling call
0709 13:10:35.559947 (+ 77005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.939401 (+2379454us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b5400721120. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8a0dc0 00007f882c92b1c0 00007f882c92c231 00007f882c928d8f 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c
0709 13:10:37.940162 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.940422 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93909888}
I20260709 13:10:38.067162 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:38.072970 26549 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:38.081267 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.087405 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.087805 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.083288 29840 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:38.090672 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.134675 26509 raft_consensus.cc:2393] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:38.065379 29734 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.004470 29834 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.011991 29672 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:10:38.028837 29660 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:37.988420 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 120726us
I20260709 13:10:38.149487 26622 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:38.150216 26476 leader_election.cc:400] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9.
I20260709 13:10:38.150612 26476 leader_election.cc:403] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:38.116431 26657 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
W20260709 13:10:38.104349 29807 consensus_meta.cc:287] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 13:10:38.120944 26577 rpcz_store.cc:276] 0709 13:10:35.508034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.238669 (+730635us) service_pool.cc:224] Handling call
0709 13:10:36.275264 (+ 36595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.780488 (+1505224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.035068 (+254580us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540015c054. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:38.035323 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3460104960}
I20260709 13:10:38.057252 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.124641 26510 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.136857 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:38.131389 26501 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:38.080741 29702 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:38.144397 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 71513us
I20260709 13:10:38.087167 29482 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.156968 26657 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:38.164902 26622 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.167613 26549 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:38.169050 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.168294 26658 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:38.159140 26656 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.173915 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.174568 26503 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:38.146126 29526 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:38.180929 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:38.182610 26622 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:38.185488 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:38.158799 29661 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.187357 29684 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.188285 29684 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:38.176683 29625 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:38.189680 29036 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:38.190207 29801 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.192059 29482 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.195647 29684 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:38.197175 26578 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:38.197872 29677 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:38.200626 26622 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.164453 29753 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:38.211617 26656 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:38.225641 29658 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.237296 26656 raft_consensus.cc:1240] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:38.187507 29845 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:38.159544 29404 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:38.232421 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:38.209420 26503 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
W20260709 13:10:38.228701 29746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.465s	user 0.026s	sys 0.026s
W20260709 13:10:38.241468 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 264993us
I20260709 13:10:38.165511 29825 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:10:38.281279 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2628) took 2938 ms. Trace:
I20260709 13:10:38.167662 29807 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:38.279054 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 46708.2us
I20260709 13:10:38.287789 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:38.281806 26576 rpcz_store.cc:276] 0709 13:10:35.343217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.209718 (+866501us) service_pool.cc:224] Handling call
0709 13:10:36.210087 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.417483 (+207396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.417518 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.424098 (+  6580us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.621820 (+197722us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:36.621867 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.621952 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.065914 (+1443962us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:38.267778 (+201864us) raft_consensus.cc:1685] finished
0709 13:10:38.267811 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.281213 (+ 13402us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109954,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8311,"spinlock_wait_cycles":126869888,"thread_start_us":317206,"threads_started":2,"wal-append.queue_time_us":313998}
I20260709 13:10:38.177309 29743 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:10:38.282723 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:38.226332 29846 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:38.177484 29745 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:10:38.268186 29677 raft_consensus.cc:697] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:38.290817 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.241480 29736 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:38.280208 29746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.512s	user 0.026s	sys 0.026s
I20260709 13:10:38.295564 26622 leader_election.cc:400] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6.
I20260709 13:10:38.335085 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:38.246857 29482 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.275390 29712 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:38.339905 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 167296us
I20260709 13:10:38.286276 29404 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:38.285713 29380 raft_consensus.cc:2764] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:38.299885 29753 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:38.290432 29825 consensus_queue.cc:1243] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:38.285943 29658 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.287155 29845 raft_consensus.cc:697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:38.355458 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.310602 29743 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:38.285861 27243 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:38.357492 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 71706.7us
I20260709 13:10:38.359404 27243 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.324067 29282 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:38.333881 29736 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:38.351708 29166 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:10:38.343171 29274 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:38.382184 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2083) took 2745 ms. Trace:
I20260709 13:10:38.382786 26508 rpcz_store.cc:276] 0709 13:10:35.636935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.145637 (+1508702us) service_pool.cc:224] Handling call
0709 13:10:37.146019 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.402127 (+256108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.381846 (+979719us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540008edd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:38.382105 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587676416}
I20260709 13:10:38.369185 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.371284 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.347286 29792 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:38.353681 29753 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:38.399508 26505 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:38.361327 29658 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:38.370496 29736 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.375734 29790 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.385385 29526 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:38.407691 29821 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.372833 29282 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:38.348758 29482 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.406646 29858 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:38.378213 29274 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:38.365268 29746 consensus_queue.cc:1059] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:10:38.398772 29753 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:38.419158 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.492563 26508 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.401597 29666 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.427603 29404 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:38.434113 29274 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.438966 29845 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.440776 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.503965 26650 raft_consensus.cc:2393] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:38.504988 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.444633 29797 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:38.498615 29666 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.506388 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.507715 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.508821 26650 raft_consensus.cc:2393] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:38.509681 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:38.510169 29744 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:38.510910 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.519126 29664 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.527887 29826 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.528574 29826 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:38.535475 29723 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.521090 26508 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:38.538806 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.542953 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:38.454921 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.459558 26659 raft_consensus.cc:2368] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9.
I20260709 13:10:38.541678 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.460994 29834 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.463106 29658 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:38.465078 29482 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:38.466224 29854 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:10:38.467056 29850 log.cc:927] Time spent T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:38.428722 29282 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.545644 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.546002 29282 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.447007 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1908) took 1669 ms. Trace:
I20260709 13:10:38.546393 26508 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:38.547755 29666 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.399994 29771 consensus_queue.cc:1059] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:10:38.549034 29771 raft_consensus.cc:3055] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:38.549458 29771 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:38.549796 29754 consensus_queue.cc:1059] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:38.546777 26654 rpcz_store.cc:276] 0709 13:10:36.777924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.685603 (+907679us) service_pool.cc:224] Handling call
0709 13:10:37.685843 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.080527 (+394684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.446729 (+366202us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b5400102cd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:38.446945 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906145536}
I20260709 13:10:38.550697 29824 tablet_replica.cc:333] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:10:38.551280 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.552330 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:38.428249 29847 log.cc:927] Time spent T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:10:38.467238 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 695) took 1749 ms. Trace:
I20260709 13:10:38.553701 26653 rpcz_store.cc:276] 0709 13:10:36.718159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.541599 (+823440us) service_pool.cc:224] Handling call
0709 13:10:37.541914 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.047817 (+505903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.466977 (+419160us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b5400140854. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:38.467176 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000703360}
I20260709 13:10:38.554996 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.471184 27241 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.555591 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:38.471378 29309 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:10:38.475559 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1803) took 1714 ms. Trace:
I20260709 13:10:38.556313 29712 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:38.556685 26582 rpcz_store.cc:276] 0709 13:10:36.761227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.986348 (+1225121us) service_pool.cc:224] Handling call
0709 13:10:37.989560 (+  3212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.992145 (+  2585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.992173 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.999831 (+  7658us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.276959 (+277128us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:38.277001 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.277070 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.475320 (+198250us) raft_consensus.cc:1685] finished
0709 13:10:38.475343 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.475495 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":442,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7573,"thread_start_us":259339,"threads_started":1,"wal-append.queue_time_us":377525}
I20260709 13:10:38.558054 29846 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:38.558617 29846 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:38.478477 26585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2647) took 1799 ms (client timeout 1777 ms). Trace:
W20260709 13:10:38.559228 26585 rpcz_store.cc:269] 0709 13:10:36.679125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.412279 (+733154us) service_pool.cc:224] Handling call
0709 13:10:38.478272 (+1065993us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b54003dfed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:38.478407 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112349440}
I20260709 13:10:38.559617 29846 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.560268 29166 raft_consensus.cc:3055] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:38.556329 26508 raft_consensus.cc:2376] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6. Re-sending same reply.
I20260709 13:10:38.560830 29166 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:38.481621 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.488011 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.506501 29797 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:38.563887 26507 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.476775 29702 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.491103 26510 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:38.539938 29660 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:38.540899 29274 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.545169 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.552353 29824 raft_consensus.cc:2243] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:38.555699 29482 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:38.556414 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 85296.8us
I20260709 13:10:38.472589 26658 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:38.474121 29807 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:38.445151 26474 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:38.586835 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 141757us
I20260709 13:10:38.587822 26474 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.555743 26653 raft_consensus.cc:2393] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:38.566756 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 72984.4us
I20260709 13:10:38.469606 29760 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:38.571187 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1916) took 1454 ms. Trace:
I20260709 13:10:38.571520 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.389631 26503 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.582279 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.593739 26506 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:38.582469 29482 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.593114 26652 rpcz_store.cc:276] 0709 13:10:37.116457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.145702 (+1029245us) service_pool.cc:224] Handling call
0709 13:10:38.159909 (+ 14207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.160380 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:38.173650 (+ 13270us) log.cc:844] Serialized 14 byte log entry
0709 13:10:38.570872 (+397222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:38.570924 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:38.570963 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.571035 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.571134 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13440,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":169,"thread_start_us":396564,"threads_started":1}
W20260709 13:10:38.600538 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.598361 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.614214 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.615496 26650 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:38.616287 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.618391 26510 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:38.624820 26503 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:38.627069 29824 raft_consensus.cc:2272] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:38.611984 29482 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:38.598812 29712 consensus_queue.cc:1059] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:38.610538 29666 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:38.628355 29166 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.582823 29458 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:38.634017 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:38.635411 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.648013 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:38.682425 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 47104.6us
I20260709 13:10:38.424719 29677 consensus_queue.cc:237] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:38.389245 29822 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:38.686654 26503 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:10:38.681320 26505 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:38.687407 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 53498.9us
I20260709 13:10:38.600657 29309 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:38.652122 29712 raft_consensus.cc:3055] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:38.630539 29658 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:38.610904 29526 consensus_queue.cc:1059] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 13:10:38.697175 26625 leader_election.cc:336] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.777s (SENT)
I20260709 13:10:38.612353 29618 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:10:38.727075 26404 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 6 to 9, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 9 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.651088 29834 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:38.648398 29812 consensus_meta.cc:287] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.002s
I20260709 13:10:38.733332 26625 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.756060 26501 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:38.756230 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 59105.2us
I20260709 13:10:38.649863 26510 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:38.694372 29712 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:38.721095 26402 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34762 (request call id 321) took 14473 ms (client timeout 15000 ms). Trace:
I20260709 13:10:38.680598 29666 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.652245 29274 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:38.693717 29788 consensus_meta.cc:287] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.851s	user 0.008s	sys 0.003s
I20260709 13:10:38.743546 26474 leader_election.cc:400] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9.
I20260709 13:10:38.686280 29760 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:38.795545 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.747815 26506 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:38.739934 29166 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.729287 29658 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:38.749001 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:38.749430 29458 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:38.751008 29771 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:38.692441 29746 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:38.752856 26404 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 7, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 7 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.807446 26503 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.809777 26404 catalog_manager.cc:5697] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 7, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 7 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.811357 26404 catalog_manager.cc:5697] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 5, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 5 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:38.753865 29759 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:10:38.755110 27240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.040s	sys 0.083s
W20260709 13:10:38.813947 27240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.041s	sys 0.083s
W20260709 13:10:38.814399 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 742054us
I20260709 13:10:38.813858 26404 catalog_manager.cc:5697] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 7, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 7 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.816582 27240 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:38.696777 29683 raft_consensus.cc:3055] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:38.778502 26505 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:38.754549 29795 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.790413 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:38.797384 26658 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:38.754393 29526 raft_consensus.cc:3055] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:38.744095 29834 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:38.775127 29625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.019s	sys 0.031s
I20260709 13:10:38.807742 29458 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:38.648654 29807 consensus_queue.cc:1059] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:10:38.784368 29797 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:38.891914 26473 leader_election.cc:336] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 2.082s (SENT)
W20260709 13:10:38.869781 26551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.021s	sys 0.027s
W20260709 13:10:38.764772 26402 rpcz_store.cc:269] 0709 13:10:24.247508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.247695 (+   187us) service_pool.cc:224] Handling call
0709 13:10:38.720983 (+14473288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:35.660838 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:36.101789 (+440951us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:36.124209 (+ 22420us) write_op.cc:435] Acquired schema lock
0709 13:10:36.130424 (+  6215us) tablet.cc:662] Decoding operations
0709 13:10:36.171872 (+ 41448us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:36.172000 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:36.172031 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:36.172851 (+   820us) tablet.cc:701] Row locks acquired
0709 13:10:36.172907 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:10:36.173122 (+   215us) write_op.cc:270] Start()
0709 13:10:36.173305 (+   183us) write_op.cc:276] Timestamp: P: 1783602636173047 usec, L: 0
0709 13:10:36.173329 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:10:36.202515 (+ 29186us) log.cc:844] Serialized 2060 byte log entry
0709 13:10:37.222500 (+1019985us) op_driver.cc:464] REPLICATION: finished
0709 13:10:37.621536 (+399036us) write_op.cc:301] APPLY: starting
0709 13:10:37.659385 (+ 37849us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:37.703169 (+ 43784us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:37.767071 (+ 63902us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:37.773668 (+  6597us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:37.774018 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:10:37.774075 (+    57us) write_op.cc:312] APPLY: finished
0709 13:10:37.774419 (+   344us) log.cc:844] Serialized 47 byte log entry
0709 13:10:37.802884 (+ 28465us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:37.843601 (+ 40717us) write_op.cc:454] Released schema lock
0709 13:10:37.848673 (+  5072us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:37.887167 (+ 38494us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:37.887199 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41888,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":309249,"apply.run_cpu_time_us":4830,"apply.run_wall_time_us":335128,"num_ops":5,"prepare.queue_time_us":318249,"prepare.run_cpu_time_us":19473,"prepare.run_wall_time_us":752953,"raft.queue_time_us":498909,"raft.run_cpu_time_us":26157,"raft.run_wall_time_us":297674,"replication_time_us":986003,"thread_start_us":907078,"threads_started":4,"wal-append.queue_time_us":406435,"wal-append.run_cpu_time_us":17908,"wal-append.run_wall_time_us":2167281}]]}
W20260709 13:10:38.901789 26551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.025s	sys 0.027s
I20260709 13:10:38.827242 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.856913 26505 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:38.806653 26506 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:10:38.902917 26506 pending_rounds.cc:85] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 3
I20260709 13:10:38.903141 26506 pending_rounds.cc:107] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:10:38.903373 26506 raft_consensus.cc:2889] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:38.734127 29664 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:10:38.840830 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:38.904489 26653 raft_consensus.cc:2410] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:38.781610 29666 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.843406 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:38.839035 26503 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
W20260709 13:10:38.844107 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 475759us
I20260709 13:10:38.911377 26549 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:38.765892 29725 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:38.781881 29743 raft_consensus.cc:697] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:38.870251 26654 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:38.767799 29812 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.856858 29824 ts_tablet_manager.cc:1916] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:38.826967 29760 raft_consensus.cc:697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:38.844611 29625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.020s	sys 0.031s
W20260709 13:10:38.916047 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 72724.3us
I20260709 13:10:38.838670 29683 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:38.855770 29419 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:38.807574 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.817083 26404 catalog_manager.cc:5697] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 2, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.901633 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:38.829483 29658 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:38.803056 29788 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:38.855553 29865 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:10:38.900218 29844 consensus_meta.cc:287] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.780s	user 0.012s	sys 0.000s
W20260709 13:10:38.895298 29661 consensus_meta.cc:287] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.004s
I20260709 13:10:38.921636 26549 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:38.845920 29834 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.840794 29526 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:38.909310 26507 raft_consensus.cc:2410] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:38.885965 29771 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.926172 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:38.881811 29826 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:38.869843 29712 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.808555 29746 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:38.931314 26505 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:38.922081 29036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.015s	sys 0.030s
I20260709 13:10:38.929309 26404 catalog_manager.cc:5697] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 3 to 5, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 5 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.932711 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:38.925841 29801 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:38.933663 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:38.919587 29797 raft_consensus.cc:3055] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:38.935325 26508 raft_consensus.cc:2393] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 3: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:38.938393 26652 raft_consensus.cc:2368] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10.
I20260709 13:10:38.844401 29795 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:38.940022 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:38.946914 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:38.947654 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:38.925717 29618 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:38.925737 29625 raft_consensus.cc:697] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:38.951488 27243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.011s	sys 0.019s
W20260709 13:10:38.985903 27243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.011s	sys 0.019s
I20260709 13:10:38.949225 29661 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9.
I20260709 13:10:38.954047 26655 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:38.927448 29419 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:38.874928 29822 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:38.954901 26656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.010s	sys 0.018s
W20260709 13:10:38.957075 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.999951 26656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.010s	sys 0.018s
I20260709 13:10:38.930070 29117 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:38.933689 29807 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:38.963927 26657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.010s	sys 0.020s
W20260709 13:10:39.015867 26657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.010s	sys 0.021s
I20260709 13:10:38.967775 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:38.969931 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.016716 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 698) took 1081 ms. Trace:
W20260709 13:10:38.986609 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 627245us
I20260709 13:10:39.017838 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:39.018390 26658 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.018426 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:38.952783 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:38.987999 26473 leader_election.cc:336] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.630s (SENT)
I20260709 13:10:39.019074 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:39.019491 26473 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:39.019992 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:38.962831 29758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.010s	sys 0.029s
I20260709 13:10:39.020349 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:39.020573 29758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.010s	sys 0.030s
I20260709 13:10:39.021138 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:39.000525 26653 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:39.021400 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:39.022221 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:38.974604 29036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.016s	sys 0.030s
I20260709 13:10:39.022481 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:39.000684 26474 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:39.026979 26476 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:39.028700 26584 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:39.017144 26656 rpcz_store.cc:276] 0709 13:10:37.934846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.241925 (+307079us) service_pool.cc:224] Handling call
0709 13:10:38.242230 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.242493 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:38.280729 (+ 38236us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.016276 (+735547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.016322 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:39.016358 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.016408 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.016654 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44144,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"thread_start_us":719137,"threads_started":1}
W20260709 13:10:39.030686 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 339585us
I20260709 13:10:38.980571 26404 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 6 to 8, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 8 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.032781 26404 catalog_manager.cc:5697] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 7, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 7 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:39.022317 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:39.004627 26502 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.012s	sys 0.032s
W20260709 13:10:39.034708 26502 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.012s	sys 0.032s
I20260709 13:10:39.002046 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:39.043275 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:39.043524 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:39.043754 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:38.947875 29844 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.046954 27243 leader_election.cc:400] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5.
I20260709 13:10:39.052464 27243 leader_election.cc:403] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:39.047657 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:39.053349 26581 raft_consensus.cc:1813] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Handling vote request from an unknown peer b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:39.053996 26581 raft_consensus.cc:2410] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:10:39.047667 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 94958.5us
I20260709 13:10:39.056037 26583 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:39.044471 26505 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:38.980590 29797 raft_consensus.cc:740] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:39.004305 29419 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:38.974920 29862 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:39.069736 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:39.086540 26579 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:38.985148 29664 consensus_queue.cc:1059] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:10:39.075309 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:39.077992 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:39.078758 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:39.079792 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:39.090849 26585 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:38.980808 29702 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.071s
W20260709 13:10:39.083103 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50540.2us
I20260709 13:10:39.047638 29712 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:38.997547 29790 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:10:39.092386 26404 catalog_manager.cc:5697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 4, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 4 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:39.104882 26658 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:39.004446 29692 consensus_queue.cc:1059] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:10:39.085314 29282 consensus_meta.cc:287] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.002s
I20260709 13:10:39.099911 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:39.102249 26583 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:39.017709 29458 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.113404 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:39.061702 29822 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:39.056892 29856 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:39.063995 29618 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:39.064270 29807 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:39.107064 26509 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
W20260709 13:10:39.120568 29859 log.cc:927] Time spent T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:10:39.126600 29791 raft_consensus.cc:3055] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:39.127120 29661 raft_consensus.cc:3055] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:39.127995 29827 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:39.131266 29844 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:39.028537 29117 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.135623 26404 catalog_manager.cc:5697] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 5, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 5 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.164574 26404 catalog_manager.cc:5697] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 3 to 5, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 5 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:39.144575 26651 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:39.007705 29683 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.113610 29404 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.043951 29526 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.014850 29760 consensus_queue.cc:237] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.174145 29788 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:39.175822 29812 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:39.176965 29526 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:39.166924 29873 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.178035 29873 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.180583 29873 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:39.098513 29674 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:10:39.181870 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 67720.7us
I20260709 13:10:39.182708 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:39.182973 29674 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:39.183420 29674 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:39.184248 29674 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.168206 26404 catalog_manager.cc:5697] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:39.132323 29856 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.132349 29862 raft_consensus.cc:697] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:39.186265 26404 catalog_manager.cc:5697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:39.186653 29862 consensus_queue.cc:237] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.187304 29801 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.188436 29795 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:39.132593 29282 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:39.190397 29736 consensus_meta.cc:287] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.763s	user 0.008s	sys 0.003s
I20260709 13:10:39.190815 29736 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.191347 29282 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:39.141731 29625 consensus_queue.cc:237] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.138343 29618 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.132539 29822 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:39.027706 29743 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.198799 26504 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:39.192842 29674 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:39.206472 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.143671 29791 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:39.145493 29661 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:39.210132 26576 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:39.186035 29856 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:39.135494 29869 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:39.174201 26497 tablet_service.cc:1558] Processing DeleteTablet for tablet 01228e22d88047b6bc2f5a6b74aa2b51 with delete_type TABLET_DATA_TOMBSTONED (TS b9c3761688a64982ae1c4aeb758e09ef not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59074
I20260709 13:10:39.171139 29827 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:39.202036 29618 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:39.211117 29796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.024s	sys 0.056s
I20260709 13:10:39.111599 29746 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.231071 29705 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.262697 29117 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:39.201993 29822 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:39.273442 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2109) took 1049 ms. Trace:
I20260709 13:10:39.273939 26506 rpcz_store.cc:276] 0709 13:10:38.223521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.966770 (+743249us) service_pool.cc:224] Handling call
0709 13:10:38.967138 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.967404 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:38.983779 (+ 16375us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.272874 (+289095us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.273113 (+   239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.273159 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:39.273203 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.273267 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.273386 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19418,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":86,"thread_start_us":286105,"threads_started":1}
I20260709 13:10:39.268142 26504 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:39.203285 29744 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:10:39.235064 29869 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:39.266719 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 239784us
I20260709 13:10:39.286700 29834 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.287114 29666 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:39.266443 29796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.026s	sys 0.056s
I20260709 13:10:39.290510 26622 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:39.296849 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2092) took 1183 ms. Trace:
I20260709 13:10:39.317662 26509 rpcz_store.cc:276] 0709 13:10:38.113279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.454580 (+341301us) service_pool.cc:224] Handling call
0709 13:10:39.296653 (+842073us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540008ded4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:39.296787 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154305920}
W20260709 13:10:39.318251 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 317576us
I20260709 13:10:39.197146 29404 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.166648 29797 consensus_queue.cc:260] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.288393 29458 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:39.263252 29736 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:39.322453 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.334880 26504 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:10:39.320204 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:39.355551 26501 raft_consensus.cc:1217] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-8.5]   Dedup: 3.3->[6.4-8.5]
I20260709 13:10:39.355755 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2584) took 1013 ms. Trace:
I20260709 13:10:39.356129 26504 rpcz_store.cc:276] 0709 13:10:38.342746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.276331 (+933585us) service_pool.cc:224] Handling call
0709 13:10:39.334541 (+ 58210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.355460 (+ 20919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.355698 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.356469 26503 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:39.356146 26501 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: [3.3-8.5]
I20260709 13:10:39.276645 26506 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:39.358418 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2116) took 1076 ms. Trace:
I20260709 13:10:39.360229 26506 rpcz_store.cc:276] 0709 13:10:38.282258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.276015 (+993757us) service_pool.cc:224] Handling call
0709 13:10:39.276325 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.358179 (+ 81854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.358366 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.364609 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:39.358971 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 314887us
I20260709 13:10:39.296586 29869 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:39.377957 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:39.362560 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2575) took 1668 ms. Trace:
I20260709 13:10:39.383119 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:39.357571 29753 consensus_meta.cc:287] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.001s
I20260709 13:10:39.387401 26506 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:39.275823 29705 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.355566 29846 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:39.347440 29661 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.805240 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2093) took 1691 ms. Trace:
I20260709 13:10:39.818231 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2100) took 1651 ms. Trace:
W20260709 13:10:39.813938 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.828320 26501 rpcz_store.cc:276] 0709 13:10:38.113480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.780787 (+667307us) service_pool.cc:224] Handling call
0709 13:10:38.781331 (+   544us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:39.357826 (+576495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.804978 (+447152us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54002fbf54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:39.805173 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320091008}
I20260709 13:10:39.381420 26502 rpcz_store.cc:276] 0709 13:10:37.693736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.087393 (+393657us) service_pool.cc:224] Handling call
0709 13:10:38.105069 (+ 17676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.108810 (+  3741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.108860 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.146770 (+ 37910us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.390191 (+243421us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:39.035192 (+645001us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.362156 (+326964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.362247 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.362294 (+    47us) raft_consensus.cc:1685] finished
0709 13:10:39.362305 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.362500 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28621,"prepare.queue_time_us":53942,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":59579,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":21807,"thread_start_us":1153922,"threads_started":3,"wal-append.queue_time_us":616428}
I20260709 13:10:39.549419 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2104) took 1327 ms. Trace:
I20260709 13:10:39.793318 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1835) took 1003 ms. Trace:
I20260709 13:10:39.844866 26652 rpcz_store.cc:276] 0709 13:10:38.789858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.790057 (+   199us) service_pool.cc:224] Handling call
0709 13:10:39.793070 (+1003013us) spinlock_profiling.cc:243] Waited 93.9 ms on lock 0x7b54001d51d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:39.793232 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215959808}
I20260709 13:10:39.846868 26652 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:39.554704 27243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.008s
W20260709 13:10:39.848820 27243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.015s	sys 0.011s
W20260709 13:10:39.849903 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 803046us
W20260709 13:10:39.439677 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.616739 26655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 696) took 1682 ms (client timeout 1995 ms). Trace:
I20260709 13:10:39.440850 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:39.851850 26501 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:39.688848 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 705) took 1709 ms. Trace:
I20260709 13:10:39.362233 29790 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:39.480463 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1917) took 1547 ms. Trace:
I20260709 13:10:39.873390 26657 rpcz_store.cc:276] 0709 13:10:37.933545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.184897 (+251352us) service_pool.cc:224] Handling call
0709 13:10:38.244044 (+ 59147us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:38.244542 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.244586 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:38.245291 (+   705us) log.cc:844] Serialized 52 byte log entry
0709 13:10:39.016276 (+770985us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:39.016312 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.016378 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.480218 (+463840us) raft_consensus.cc:1685] finished
0709 13:10:39.480235 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.480401 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1004,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":29197,"thread_start_us":720148,"threads_started":1,"wal-append.queue_time_us":1007843}
I20260709 13:10:39.828392 26508 rpcz_store.cc:276] 0709 13:10:38.166871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.563826 (+396955us) service_pool.cc:224] Handling call
0709 13:10:39.817975 (+1254149us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b5400193f54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:39.818151 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785916160}
I20260709 13:10:39.855365 26503 rpcz_store.cc:276] 0709 13:10:38.221870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.911510 (+689640us) service_pool.cc:224] Handling call
0709 13:10:38.911879 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.357233 (+445354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.549008 (+191775us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54000a8cd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:39.549326 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022069504}
W20260709 13:10:39.868562 26655 rpcz_store.cc:269] 0709 13:10:37.934261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.101246 (+166985us) service_pool.cc:224] Handling call
0709 13:10:39.616467 (+1515221us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400109354. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:39.616659 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919851904}
I20260709 13:10:39.740688 26650 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:39.362593 29758 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:39.870589 26651 rpcz_store.cc:276] 0709 13:10:37.979468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.562617 (+583149us) service_pool.cc:224] Handling call
0709 13:10:38.566597 (+  3980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.166132 (+599535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.688440 (+522308us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400107554. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:39.688753 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328612096}
I20260709 13:10:39.828357 26506 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:10:39.481012 29882 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:10:39.805903 29482 consensus_meta.cc:287] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.126s	user 0.003s	sys 0.008s
W20260709 13:10:39.822664 29674 consensus_meta.cc:287] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.595s	user 0.001s	sys 0.007s
I20260709 13:10:39.881633 27243 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:39.819144 29874 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.557s	user 0.000s	sys 0.002s
W20260709 13:10:39.807185 29419 consensus_meta.cc:287] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.000s
W20260709 13:10:39.805542 29166 consensus_meta.cc:287] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.001s	user 0.012s	sys 0.000s
W20260709 13:10:39.817394 29880 log.cc:927] Time spent T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.379s	user 0.000s	sys 0.002s
W20260709 13:10:39.735185 29883 log.cc:927] Time spent T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.296s	user 0.000s	sys 0.000s
W20260709 13:10:39.497325 29660 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.925s	user 0.009s	sys 0.005s
W20260709 13:10:39.486081 29840 consensus_meta.cc:287] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.325s	user 0.014s	sys 0.000s
W20260709 13:10:39.511274 29881 log.cc:927] Time spent T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:10:39.626819 29658 consensus_meta.cc:287] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
W20260709 13:10:39.717795 29712 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.001s
I20260709 13:10:39.605634 29754 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:39.460773 29672 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:10:39.919378 26653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.010s	sys 0.027s
W20260709 13:10:39.946990 26653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.010s	sys 0.027s
W20260709 13:10:39.470595 29876 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 13:10:39.881006 29526 consensus_meta.cc:287] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.001s
I20260709 13:10:39.611469 29683 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.619890 29864 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:39.532836 29666 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:39.574692 29888 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:39.880149 29797 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:39.893911 29736 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:39.737372 29856 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.917971 27243 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:10:39.998930 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 81084.6us
I20260709 13:10:39.885363 26506 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:10:39.919329 26551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.025s	sys 0.152s
W20260709 13:10:39.925868 26404 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.008s	sys 0.029s
W20260709 13:10:40.000141 26404 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.009s	sys 0.029s
W20260709 13:10:39.999787 26551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.025s	sys 0.152s
I20260709 13:10:40.002146 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:40.003077 26576 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:40.007038 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.003787 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:39.895872 26548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.005s	sys 0.028s
W20260709 13:10:40.010212 26548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.005s	sys 0.028s
I20260709 13:10:40.009914 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:40.010533 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 825775us
I20260709 13:10:40.011039 26576 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:39.377139 29844 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.515s
I20260709 13:10:39.485785 29667 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.430s
I20260709 13:10:40.017899 29667 consensus_queue.cc:1243] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:40.021944 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:40.022505 29869 consensus_meta.cc:287] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.001s
I20260709 13:10:40.022719 26579 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:40.022926 29869 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:40.023450 29618 consensus_meta.cc:287] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.748s	user 0.008s	sys 0.001s
I20260709 13:10:40.023787 26576 raft_consensus.cc:2410] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:10:39.884594 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.451619 29753 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.371145 29791 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.947623 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:40.030857 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2091) took 1917 ms. Trace:
W20260709 13:10:39.888638 26549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.010s	sys 0.018s
W20260709 13:10:39.891916 29760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.014s	sys 0.020s
I20260709 13:10:39.899098 29282 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:39.873533 29846 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:39.891918 29274 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.899410 29692 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.872696 29790 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.914719 29419 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.936652 29825 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:39.884037 27240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.012s	sys 0.016s
W20260709 13:10:40.096583 27240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.012s	sys 0.016s
I20260709 13:10:40.007591 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:40.034349 29760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.014s	sys 0.020s
W20260709 13:10:40.007688 27242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.019s	sys 0.035s
W20260709 13:10:40.097718 27242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.020s	sys 0.035s
I20260709 13:10:40.008388 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:39.993716 29888 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:40.012492 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.001271 29736 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.127048 26509 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:40.014685 26503 raft_consensus.cc:1275] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:40.009918 27275 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:40.016680 29705 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:39.440639 29827 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:40.026291 27241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.010s	sys 0.044s
W20260709 13:10:40.163935 27241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.011s	sys 0.044s
I20260709 13:10:39.953215 29826 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:40.027807 26581 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:10:40.028239 26658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.009s	sys 0.002s
I20260709 13:10:40.029480 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:40.171197 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 141819us
I20260709 13:10:40.171783 29888 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:40.172920 29821 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:40.173369 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.173650 29821 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:40.174041 27269 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:40.174197 29821 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:40.176286 29672 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5.
I20260709 13:10:40.176667 29821 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:40.032178 26549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.010s	sys 0.018s
I20260709 13:10:40.095953 29692 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:40.177779 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 1.08505e+06us
W20260709 13:10:40.178289 26658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.010s	sys 0.002s
I20260709 13:10:40.179651 29692 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:40.033437 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.180521 27273 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:40.032745 26510 rpcz_store.cc:276] 0709 13:10:38.113064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.760198 (+647134us) service_pool.cc:224] Handling call
0709 13:10:38.790950 (+ 30752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.799696 (+  8746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.799745 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.800334 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.166984 (+366650us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:39.167033 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.170631 (+  3598us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.030645 (+860014us) raft_consensus.cc:1685] finished
0709 13:10:40.030664 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.030791 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9820,"raft.queue_time_us":7039,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":24871,"thread_start_us":244783,"threads_started":1,"wal-append.queue_time_us":426148}
I20260709 13:10:40.023873 29618 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:40.034924 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:40.036382 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:40.190526 26655 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:40.021386 29822 consensus_meta.cc:287] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.723s	user 0.007s	sys 0.000s
I20260709 13:10:39.895211 29482 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:40.236253 27275 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:40.004184 29526 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:40.003813 29886 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.005055 29834 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:40.079210 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:39.952134 29754 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.936335 29840 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:39.943475 29658 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.088737 26659 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:40.092533 26651 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:40.266548 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1933) took 1244 ms. Trace:
I20260709 13:10:40.266995 26651 rpcz_store.cc:276] 0709 13:10:39.022072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.091942 (+1069870us) service_pool.cc:224] Handling call
0709 13:10:40.092304 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.266258 (+173954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.266480 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.030507 29660 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.098641 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.270301 27272 raft_consensus.cc:2410] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:10:39.898478 26584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.011s	sys 0.040s
W20260709 13:10:40.270988 26584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.012s	sys 0.044s
I20260709 13:10:40.271839 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2661) took 1196 ms. Trace:
I20260709 13:10:40.272410 29660 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.096917 29282 raft_consensus.cc:697] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:40.273839 29667 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.272300 26584 rpcz_store.cc:276] 0709 13:10:39.075359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.099492 (+ 24133us) service_pool.cc:224] Handling call
0709 13:10:39.130949 (+ 31457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.131157 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.131183 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.131708 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.271403 (+1139695us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:40.271473 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.271562 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.271619 (+    57us) raft_consensus.cc:1685] finished
0709 13:10:40.271636 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.271783 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1139310,"threads_started":1,"wal-append.queue_time_us":1039907}
I20260709 13:10:40.274413 29667 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:40.274842 29660 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:40.086261 29625 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:10:40.106200 29753 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:40.111145 26657 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:10:40.096926 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 1.04141e+06us
I20260709 13:10:40.281785 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.162344 27271 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:40.282258 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1839) took 1298 ms. Trace:
I20260709 13:10:40.093465 29790 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:40.198223 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.096369 29745 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:10:40.147312 29825 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:40.220870 29618 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:40.222030 29856 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:40.224480 26582 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
W20260709 13:10:40.226310 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 83051.6us
W20260709 13:10:40.300451 26548 leader_election.cc:336] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.599s (SENT)
I20260709 13:10:40.300980 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:40.227118 29901 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:40.227921 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 49537.8us
I20260709 13:10:40.182044 29903 consensus_queue.cc:1059] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:10:40.234562 29705 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:40.234813 29869 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:40.235929 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.237682 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1928) took 1266 ms. Trace:
I20260709 13:10:40.076889 29166 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:10:40.083630 29744 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:10:40.296600 29672 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:10:40.296680 29888 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:10:40.314260 26506 raft_consensus.cc:2410] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:40.316998 26456 placement_policy_util.cc:248] tablet 01228e22d88047b6bc2f5a6b74aa2b51: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:10:40.268796 27275 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:40.272764 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.099181 26580 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:40.275676 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2653) took 1301 ms. Trace:
I20260709 13:10:40.257378 29886 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.095359 29274 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:40.031433 29712 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:10:40.327082 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.327725 27276 raft_consensus.cc:2376] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6. Re-sending same reply.
I20260709 13:10:40.282703 27277 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:40.282641 26657 rpcz_store.cc:276] 0709 13:10:38.983754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.083300 (+1099546us) service_pool.cc:224] Handling call
0709 13:10:40.110914 (+ 27614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.281999 (+171085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.282201 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:40.254848 26497 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.000s	sys 0.011s
W20260709 13:10:40.290859 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.290887 27272 raft_consensus.cc:3055] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:40.331660 27272 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:40.291435 26656 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:40.299475 29419 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:40.309015 29846 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:40.263870 29526 raft_consensus.cc:697] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:40.302824 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:40.304243 26549 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:40.317203 29903 consensus_queue.cc:1243] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:40.239591 29822 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.238706 29899 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:10:40.296797 29896 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:10:40.263536 26655 raft_consensus.cc:2410] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:40.276651 26651 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:40.351138 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1934) took 1328 ms. Trace:
I20260709 13:10:40.351516 26651 rpcz_store.cc:276] 0709 13:10:39.022340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.276192 (+1253852us) service_pool.cc:224] Handling call
0709 13:10:40.276480 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.350907 (+ 74427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.351086 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.313687 26653 rpcz_store.cc:276] 0709 13:10:38.971537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.080055 (+108518us) service_pool.cc:224] Handling call
0709 13:10:39.113829 (+ 33774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.123580 (+  9751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.123613 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.136606 (+ 12993us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.293535 (+156929us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b4800240258. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8831852aa1 00007f8831849b37 00007f88318499ca 00007f883194126f 00007f8831940f37 00007f883195555c 00007f8831955508 00007f8831955488 00007f8831955443 00007f88319546ec 00007f883087ea96
0709 13:10:39.947497 (+653962us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:39.947539 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.947610 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.181326 (+233716us) raft_consensus.cc:1685] finished
0709 13:10:40.181344 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.237605 (+ 56261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9474,"raft.run_cpu_time_us":2993,"raft.run_wall_time_us":165362,"spinlock_wait_cycles":158736256,"thread_start_us":750434,"threads_started":1,"wal-append.queue_time_us":1017121}
I20260709 13:10:40.320559 26577 rpcz_store.cc:276] 0709 13:10:38.974545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.974685 (+   140us) service_pool.cc:224] Handling call
0709 13:10:39.001340 (+ 26655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.051590 (+ 50250us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:39.051619 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.065187 (+ 13568us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.569703 (+504516us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:39.569756 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.569835 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.275474 (+705639us) raft_consensus.cc:1685] finished
0709 13:10:40.275490 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.275619 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49143,"raft.queue_time_us":49633,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8721,"thread_start_us":409043,"threads_started":1,"wal-append.queue_time_us":1003417}
I20260709 13:10:40.329748 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.330773 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.294930 26505 raft_consensus.cc:1240] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:40.334240 29667 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:10:40.334385 27272 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:40.310528 29674 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:40.306571 26548 leader_election.cc:336] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.670s (SENT)
W20260709 13:10:40.358284 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 51749.6us
W20260709 13:10:40.358668 26473 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.000s	sys 0.016s
W20260709 13:10:40.359114 26473 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.000s	sys 0.016s
W20260709 13:10:40.359417 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 878353us
I20260709 13:10:40.357296 27272 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:40.339545 26503 raft_consensus.cc:2376] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9. Re-sending same reply.
W20260709 13:10:40.331502 26497 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.000s	sys 0.012s
I20260709 13:10:40.330632 29864 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:40.332718 27269 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:40.355894 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:40.363668 26654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.053s	sys 0.073s
W20260709 13:10:40.364084 26654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.053s	sys 0.073s
W20260709 13:10:40.359531 26548 leader_election.cc:336] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.930s (SENT)
I20260709 13:10:40.375289 26548 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:40.362030 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 476954us
I20260709 13:10:40.396142 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:40.389377 26578 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
W20260709 13:10:40.354136 29862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.020s	sys 0.036s
I20260709 13:10:40.343755 29901 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:40.330850 29824 ts_tablet_manager.cc:1929] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:40.321619 29705 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:40.401000 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.401757 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.402403 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:40.408598 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.435935 27277 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:40.437165 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:40.440029 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.015s	sys 0.000s
W20260709 13:10:40.440439 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.015s	sys 0.000s
W20260709 13:10:40.423018 29862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.021s	sys 0.036s
I20260709 13:10:40.317708 29282 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:40.397424 26625 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:40.462476 27277 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:10:40.456041 27272 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:10:40.467338 27272 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:40.400624 29036 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:40.456804 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.470463 27276 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:40.401324 29625 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.474550 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 77188.5us
I20260709 13:10:40.476274 26625 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:40.493319 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:40.496059 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:40.462365 29824 log.cc:1199] T 574d2707e806420dab53495563bd03aa P ef2886777a8f45e69e213b02a22ecec7: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/wals/574d2707e806420dab53495563bd03aa
I20260709 13:10:40.461447 29744 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.519083 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.521229 27277 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:40.522538 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.523350 27277 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:40.524689 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.440798 29745 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:10:40.448269 29660 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:40.526769 29660 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.530066 29660 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:40.462304 29901 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:40.463650 29736 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:40.374044 29526 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:40.440997 29746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.008s
I20260709 13:10:40.545261 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.472566 29834 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:40.487941 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.504256 29625 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.550771 29908 tablet_replica.cc:333] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
W20260709 13:10:40.560354 26652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.020s	sys 0.039s
W20260709 13:10:40.547261 29895 log.cc:927] Time spent T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 13:10:40.584981 26652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.020s	sys 0.039s
W20260709 13:10:40.549680 29746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.007s	sys 0.008s
W20260709 13:10:40.577142 26473 leader_election.cc:336] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.807s (SENT)
W20260709 13:10:40.552393 29893 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:10:40.542261 29754 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:40.575065 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1840) took 1591 ms. Trace:
I20260709 13:10:40.505378 29036 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:40.627755 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.552735 29736 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.559995 29844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.011s	sys 0.038s
W20260709 13:10:40.632444 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 55369.5us
I20260709 13:10:40.714404 26650 rpcz_store.cc:276] 0709 13:10:38.983979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.091312 (+1107333us) service_pool.cc:224] Handling call
0709 13:10:40.128736 (+ 37424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.128997 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:40.197693 (+ 68696us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.574656 (+376963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.574724 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:40.574775 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.574860 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.575000 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69031,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"thread_start_us":354247,"threads_started":1}
I20260709 13:10:40.551848 29840 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:40.560057 29759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.539s	user 0.015s	sys 0.042s
I20260709 13:10:40.551402 29482 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:40.637840 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 364104us
W20260709 13:10:40.679759 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.582845 29658 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:40.582105 29753 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:40.551728 29834 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.551275 29914 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:40.712446 26551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.006s	sys 0.024s
W20260709 13:10:40.773048 26551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.007s	sys 0.025s
W20260709 13:10:40.715811 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 219822us
W20260709 13:10:40.716315 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 356792us
W20260709 13:10:40.774677 26548 leader_election.cc:336] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 2.157s (SENT)
I20260709 13:10:40.775188 26548 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:40.721971 26585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.207s	user 0.015s	sys 0.016s
W20260709 13:10:40.776046 26585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.015s	sys 0.016s
W20260709 13:10:40.729079 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 235835us
I20260709 13:10:40.706080 29821 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.733011 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 387967us
I20260709 13:10:40.784475 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.735069 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2108) took 2511 ms. Trace:
W20260709 13:10:40.737901 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.785415 27274 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:40.753026 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:40.754402 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.786340 26655 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:40.717450 29274 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:40.732775 29844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.011s	sys 0.039s
W20260709 13:10:40.777377 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.775230 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:40.734582 29759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.713s	user 0.015s	sys 0.043s
I20260709 13:10:40.780874 27243 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:40.781872 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2662) took 1706 ms. Trace:
I20260709 13:10:40.783088 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:40.735284 26473 leader_election.cc:336] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 2.028s (SENT)
I20260709 13:10:40.803725 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:40.785252 26507 rpcz_store.cc:276] 0709 13:10:38.223268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.962920 (+739652us) service_pool.cc:224] Handling call
0709 13:10:38.994760 (+ 31840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.994998 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.995025 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.004321 (+  9296us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.555551 (+551230us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:39.555708 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.555806 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.734836 (+1179030us) raft_consensus.cc:1685] finished
0709 13:10:40.734861 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.735008 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":475988,"threads_started":1,"wal-append.queue_time_us":1046429}
I20260709 13:10:40.788399 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:40.789024 29746 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:40.789057 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:40.636878 29901 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.791926 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:40.827551 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 46794.6us
I20260709 13:10:40.734619 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.803218 26585 rpcz_store.cc:276] 0709 13:10:39.075699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.097704 (+ 22005us) service_pool.cc:224] Handling call
0709 13:10:39.129890 (+ 32186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.130099 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:39.514832 (+384733us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.781374 (+1266542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.781446 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:40.781516 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.781624 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.781795 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4809,"prepare.queue_time_us":1105084,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":19117,"thread_start_us":1645628,"threads_started":2}
I20260709 13:10:40.789448 29903 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.804168 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 68916.3us
W20260709 13:10:40.848239 26473 leader_election.cc:336] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 2.062s (SENT)
I20260709 13:10:40.751227 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:40.805243 26580 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:40.805902 26650 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:40.807107 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.818490 26655 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:40.820385 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:40.776194 29840 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:40.829320 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:40.778033 29822 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:40.840374 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:40.842989 27243 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:40.844189 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:40.846369 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 58773.8us
I20260709 13:10:40.732153 29736 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.861089 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:40.870263 26651 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:40.873150 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:40.771871 29753 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:40.878194 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:40.873814 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:40.890049 26507 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:40.890291 26579 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:40.877296 26577 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:40.882046 26625 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:40.900069 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:40.901718 26653 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:40.904316 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.905048 27272 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:40.903424 27278 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:40.837399 29899 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:40.907461 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:40.912461 27274 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:40.868232 29907 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:40.922950 27278 raft_consensus.cc:2368] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:40.799804 29821 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:40.940825 26507 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:40.956060 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1926) took 1985 ms. Trace:
I20260709 13:10:40.956513 26656 rpcz_store.cc:276] 0709 13:10:38.970962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.036010 (+ 65048us) service_pool.cc:224] Handling call
0709 13:10:39.036325 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.332562 (+1296237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.955824 (+623262us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400106654. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:40.956000 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2886087424}
I20260709 13:10:40.958181 26656 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:40.962560 26653 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:40.864136 29936 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:40.871613 29274 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:40.879302 29844 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:40.977141 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:40.879493 29827 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:40.884091 29672 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:41.005263 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 230218us
I20260709 13:10:40.869719 29903 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:40.985438 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 91958.3us
I20260709 13:10:41.024787 26625 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:40.975208 29840 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.986891 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:40.952246 29824 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36124 (request call id 78) took 3764 ms. Trace:
I20260709 13:10:40.994501 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:40.872895 29869 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:10:40.899988 29705 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:40.986263 29909 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.444s	user 0.001s	sys 0.001s
I20260709 13:10:40.841320 29916 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:10:40.984998 26577 raft_consensus.cc:2410] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:40.977872 29936 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.043282 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.055887 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:40.904006 29754 consensus_queue.cc:1059] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:10:41.056515 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.038419 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.033004 27277 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:41.008049 29404 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:41.027659 29914 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.005383 29672 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.044658 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2119) took 1032 ms. Trace:
I20260709 13:10:41.067173 26506 rpcz_store.cc:276] 0709 13:10:40.012132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.012309 (+   177us) service_pool.cc:224] Handling call
0709 13:10:41.044484 (+1032175us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54002fb7d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:41.044604 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283857792}
W20260709 13:10:40.989238 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 72811.6us
I20260709 13:10:40.980532 29899 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.032661 29908 raft_consensus.cc:2243] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:41.034209 29844 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:41.058023 29746 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.042824 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.033699 29840 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.062345 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.059553 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:41.055790 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 49413.7us
W20260709 13:10:41.061975 29913 log.cc:927] Time spent T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:10:41.055985 27272 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:41.100167 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.045657 29917 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:41.116046 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.043723 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.116750 27278 raft_consensus.cc:2376] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7. Re-sending same reply.
I20260709 13:10:41.089352 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:41.054944 29936 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.038241 29862 consensus_queue.cc:1059] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:10:41.093683 26653 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:41.093961 29938 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:41.094576 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.138597 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.138903 27274 raft_consensus.cc:2393] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:41.094811 29912 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:10:41.076877 29932 raft_consensus.cc:2764] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:10:41.095446 29925 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:41.096215 29908 raft_consensus.cc:2272] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:41.097002 29937 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:41.019161 29827 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.088227 26585 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.073462 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:41.074232 29672 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.135766 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.136888 29661 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:41.137360 29923 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.137441 29899 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.032202 29824 rpcz_store.cc:276] 0709 13:10:37.119619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.147857 (+ 28238us) service_pool.cc:224] Handling call
0709 13:10:37.347130 (+199273us) ts_tablet_manager.cc:1151] Deleting tablet 574d2707e806420dab53495563bd03aa
0709 13:10:37.347231 (+   101us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:10:38.550510 (+1203279us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400252e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c931ff9 00007f883193f482 00007f88319702d0 00007f883195683d 00007f88319567e9 00007f8831956779 00007f8831956741 00007f883195596d 000000000038f354 000000000038f199
0709 13:10:39.789263 (+1238753us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:40.321520 (+532257us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:40.879311 (+557791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2588522240,"tablet-delete.queue_time_us":198053,"thread_start_us":101746,"threads_started":1}
I20260709 13:10:41.053414 29705 consensus_queue.cc:1059] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:10:41.141826 27278 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:41.154053 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 97192.1us
W20260709 13:10:41.154508 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 65239.8us
I20260709 13:10:41.159066 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1930) took 2187 ms. Trace:
I20260709 13:10:41.163676 27272 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:41.169853 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.139441 29754 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.133227 29036 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:41.083580 29844 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.102017 29746 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:41.236653 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.147588 29900 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.239625 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.190184 26658 rpcz_store.cc:276] 0709 13:10:38.972110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.117201 (+145091us) service_pool.cc:224] Handling call
0709 13:10:39.119497 (+  2296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.144843 (+ 25346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.144889 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.166195 (+ 21306us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.815206 (+649011us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4800240258. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8831852aa1 00007f8831849b37 00007f88318499ca 00007f883194126f 00007f8831940f37 00007f883195555c 00007f8831955508 00007f8831955488 00007f8831955443 00007f88319546ec 00007f883087ea96
0709 13:10:40.179017 (+363811us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:40.179076 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.180239 (+  1163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.148450 (+968211us) raft_consensus.cc:1685] finished
0709 13:10:41.148472 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.158992 (+ 10520us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78955,"raft.queue_time_us":25813,"raft.run_cpu_time_us":1905,"raft.run_wall_time_us":651386,"spinlock_wait_cycles":4939136,"thread_start_us":973107,"threads_started":1,"wal-append.queue_time_us":1256148}
I20260709 13:10:41.241262 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:41.171541 29920 log.cc:927] Time spent T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.383s	user 0.002s	sys 0.000s
I20260709 13:10:41.167382 29921 raft_consensus.cc:2764] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:10:41.246268 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.247503 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.249588 26476 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.261528 26476 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.252810 27272 raft_consensus.cc:2376] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5. Re-sending same reply.
I20260709 13:10:41.236079 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.262864 27278 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:41.254344 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.233911 29660 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:41.259261 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:41.263819 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.264942 26658 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:41.265091 27278 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:41.248400 29937 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:41.241925 29834 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.288797 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:41.272523 26476 raft_consensus.cc:2686] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:41.255086 29274 raft_consensus.cc:697] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:41.311378 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:41.302732 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.254983 29705 raft_consensus.cc:3055] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:41.295568 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:41.318724 27278 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:41.277383 29736 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:41.268091 29036 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:41.294152 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.322407 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.325863 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:41.342074 26502 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.268065 29759 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:41.310580 29912 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:41.246516 29754 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.320147 29705 raft_consensus.cc:740] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:41.322505 29935 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 13:10:41.323752 29953 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:10:41.327457 29797 consensus_meta.cc:287] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.331s	user 0.013s	sys 0.000s
I20260709 13:10:41.366544 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:41.366842 29827 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:41.368218 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:41.369163 26501 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:41.311051 29899 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.323021 29274 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.369856 29899 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.354228 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:41.322319 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.372999 27278 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.373549 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:41.355746 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.358304 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.375147 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:41.356776 29903 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:41.360430 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.312674 29834 consensus_queue.cc:1059] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:10:41.361590 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.362493 29759 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:41.375716 26507 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:41.419301 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:41.420121 26507 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:41.421160 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:41.421901 26507 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4.
I20260709 13:10:41.378226 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:41.423772 26504 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:41.379186 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:41.424459 26501 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.277416 29660 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.334111 29821 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:41.340864 29736 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.259131 29900 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.272601 29934 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:10:41.411854 27278 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:41.422941 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:41.436923 26507 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:41.406019 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.438272 26577 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:41.439333 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.074756 29914 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:41.461843 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.441278 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.444815 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:41.372581 29658 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.368243 29827 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.326903 29921 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:10:41.365212 29797 consensus_queue.cc:1059] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:10:41.454478 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:41.464826 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.465286 26504 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:41.436836 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.466773 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1927) took 2482 ms. Trace:
I20260709 13:10:41.467023 26504 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:10:41.372440 29899 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.348893 29945 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:10:41.468272 26504 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:41.455768 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:41.471616 26507 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.465130 27278 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:41.468947 26502 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:41.469548 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:41.467238 26654 rpcz_store.cc:276] 0709 13:10:38.971259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.036045 (+ 64786us) service_pool.cc:224] Handling call
0709 13:10:39.059765 (+ 23720us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:39.060147 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.060181 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:39.069871 (+  9690us) log.cc:844] Serialized 52 byte log entry
0709 13:10:39.693874 (+624003us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b1800234340. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c90d1 00007f882c8e4a0f
0709 13:10:40.364541 (+670667us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:40.458735 (+ 94194us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.459004 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.459108 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.425009 (+965901us) raft_consensus.cc:1685] finished
0709 13:10:41.453717 (+ 28708us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.453903 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26248,"prepare.queue_time_us":83323,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":7206,"raft.queue_time_us":135847,"raft.run_cpu_time_us":990,"raft.run_wall_time_us":132906,"spinlock_wait_cycles":56666752,"thread_start_us":670423,"threads_started":1,"wal-append.queue_time_us":1608939}
I20260709 13:10:41.472654 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.477313 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.473517 26502 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.472883 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:41.478621 27240 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.479545 26656 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:41.480062 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:41.467157 27277 raft_consensus.cc:2376] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5. Re-sending same reply.
I20260709 13:10:41.481285 26651 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:41.434799 29834 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:41.486975 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.487636 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:41.487895 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.492236 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.527540 29746 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.528745 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.527606 27272 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:41.532249 26577 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:41.535708 26502 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:41.538177 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:41.538861 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.539232 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.539659 27277 raft_consensus.cc:2410] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:10:41.539837 26581 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:41.454079 29736 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.544730 27273 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:41.479923 29954 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:10:41.486214 29282 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:41.489990 29834 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:41.554924 29683 raft_consensus.cc:3055] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:41.571702 29790 consensus_meta.cc:287] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.266s	user 0.010s	sys 0.001s
I20260709 13:10:41.571908 29683 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:41.572316 29825 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:41.572206 29790 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.572870 29683 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:41.535338 29956 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:10:41.574252 29958 log.cc:927] Time spent T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:10:41.574803 26508 raft_consensus.cc:1217] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Deduplicated request from leader. Original: 2.5->[4.6-7.8]   Dedup: 6.7->[7.8-7.8]
I20260709 13:10:41.575362 26508 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: [4.6-7.8]
I20260709 13:10:41.472048 29827 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.486284 29419 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.475606 29658 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.563475 26585 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:41.570942 29834 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:41.574077 29963 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:10:41.561058 26507 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:41.576591 26501 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:41.581677 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.575258 29660 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.587457 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 704) took 3615 ms. Trace:
I20260709 13:10:41.555806 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.574117 29683 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.555897 29844 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:41.575853 29914 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:41.588629 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.590456 29827 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:41.563144 26581 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:41.593788 26651 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:41.598589 29282 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:41.612071 27272 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:41.587574 29736 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:41.612946 26659 rpcz_store.cc:276] 0709 13:10:37.971867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.554930 (+583063us) service_pool.cc:224] Handling call
0709 13:10:38.555217 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.265867 (+1710650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.587200 (+1321333us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400170cd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:41.587392 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3526191360}
I20260709 13:10:41.625595 27277 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:41.626595 29908 ts_tablet_manager.cc:1916] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:41.640403 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.644459 27272 raft_consensus.cc:2376] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7. Re-sending same reply.
I20260709 13:10:41.636554 29834 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.654438 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.655247 27275 raft_consensus.cc:2368] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:41.656055 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.656574 27275 raft_consensus.cc:2376] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9. Re-sending same reply.
I20260709 13:10:41.657377 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.658450 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:41.659147 27275 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:41.659967 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:41.660600 29928 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.634s	user 0.000s	sys 0.005s
I20260709 13:10:41.661613 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2122) took 1359 ms. Trace:
I20260709 13:10:41.663383 29753 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:41.662081 26510 rpcz_store.cc:276] 0709 13:10:40.302115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.302279 (+   164us) service_pool.cc:224] Handling call
0709 13:10:40.302655 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.303009 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:41.405620 (+1102611us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b180048c460. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f8829839455 00007f88303213c7 00007f882c9339a7 00007f882c9430bf 00007f882c943038
0709 13:10:41.484363 (+ 78743us) log.cc:844] Serialized 14 byte log entry
0709 13:10:41.638529 (+154166us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.639092 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.639221 (+   129us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:41.639251 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.639321 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.661210 (+ 21889us) raft_consensus.cc:1685] finished
0709 13:10:41.661330 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.661487 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6807,"prepare.queue_time_us":789655,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":9340,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":10960,"spinlock_wait_cycles":14036864,"thread_start_us":167856,"threads_started":2,"wal-append.queue_time_us":144554}
W20260709 13:10:41.664351 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.660506 27275 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:41.620337 29936 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.637457 29754 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.669653 29931 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:10:41.667184 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:41.673976 29900 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.674916 26622 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:41.675973 26622 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:41.668358 29753 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:10:41.676846 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.678121 29753 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:41.678171 29931 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:41.678762 29753 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:41.678810 29931 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:41.679363 29931 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:41.679541 29661 consensus_meta.cc:287] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.001s
I20260709 13:10:41.680613 29736 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:41.681383 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.632469 29282 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.671152 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.637245 29672 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.685622 29914 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:41.721894 29914 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:41.722431 29914 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.723177 26584 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:41.725003 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.685868 29790 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.686146 29886 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.678195 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2118) took 3112 ms. Trace:
I20260709 13:10:41.690341 29753 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.694291 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.727411 27275 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:41.726917 26509 rpcz_store.cc:276] 0709 13:10:38.565801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.318929 (+753128us) service_pool.cc:224] Handling call
0709 13:10:39.319348 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.127707 (+808359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.677930 (+1550223us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b540008edd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:41.678104 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856938752}
W20260709 13:10:41.695140 26578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2652) took 2748 ms (client timeout 1505 ms). Trace:
W20260709 13:10:41.728142 26578 rpcz_store.cc:269] 0709 13:10:38.947222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.947375 (+   153us) service_pool.cc:224] Handling call
0709 13:10:41.694898 (+2747523us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400253854. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:41.695050 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3148955008}
I20260709 13:10:41.695366 26583 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:41.698558 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1837) took 2721 ms. Trace:
W20260709 13:10:41.699924 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.681980 26622 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:10:41.729940 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.730012 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 48107.9us
I20260709 13:10:41.707402 27272 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
W20260709 13:10:41.708637 29839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.789s	user 0.013s	sys 0.000s
I20260709 13:10:41.711648 29959 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.735153 27275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:37164
I20260709 13:10:41.731719 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:41.735809 27275 raft_consensus.cc:606] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:41.735847 26580 raft_consensus.cc:2376] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 4. Re-sending same reply.
I20260709 13:10:41.733482 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:41.732666 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.720597 29931 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.729274 26652 rpcz_store.cc:276] 0709 13:10:38.983105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.851727 (+868622us) service_pool.cc:224] Handling call
0709 13:10:39.852136 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.585616 (+733480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.585646 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.712973 (+127327us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.912749 (+199776us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:40.912784 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.698141 (+785357us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b5400143054. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:41.698194 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.698242 (+    48us) raft_consensus.cc:1685] finished
0709 13:10:41.698256 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.698490 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":411023,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":3134,"spinlock_wait_cycles":97418496,"thread_start_us":801135,"threads_started":2,"wal-append.queue_time_us":365309}
I20260709 13:10:41.743189 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:41.738230 27274 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:41.739508 27243 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.744947 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.745467 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:41.746518 26580 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:41.704388 29736 raft_consensus.cc:697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:41.736116 29839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.821s	user 0.014s	sys 0.000s
I20260709 13:10:41.750459 27272 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:41.750892 26584 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:41.750732 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:41.752045 27272 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:10:41.752228 26659 raft_consensus.cc:2393] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:41.754983 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:41.755888 26659 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.753378 27272 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:41.762910 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:41.764357 26652 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:41.756582 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.766268 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.767580 26578 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:41.768801 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.769920 26578 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:41.759558 29888 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:41.772948 27243 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:41.773943 29906 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.462s	user 0.003s	sys 0.001s
I20260709 13:10:41.774711 29936 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:41.775931 29888 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:41.776414 29888 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.776790 29888 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.778862 26577 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.780732 26577 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:41.781440 29931 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:41.782311 27275 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:41.782953 29672 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:41.783053 27272 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:41.737736 29932 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:41.794231 29932 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.783646 29791 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:41.795092 27272 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:41.797123 29166 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:41.797508 29166 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:41.748150 29959 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.784950 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 831) took 1778 ms. Trace:
I20260709 13:10:41.798341 29166 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.799376 29166 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.798769 27271 rpcz_store.cc:276] 0709 13:10:40.006644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.025599 (+ 18955us) service_pool.cc:224] Handling call
0709 13:10:40.078291 (+ 52692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.285389 (+207098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.784718 (+1499329us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b5400681ad4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:41.784891 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164011776}
I20260709 13:10:41.787922 29888 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.800820 29736 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.802274 29888 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.802505 29949 raft_consensus.cc:3055] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:41.802969 29949 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:41.803714 29949 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.804965 29282 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.783687 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.808637 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.809422 26578 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:41.804899 29949 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:41.814464 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.818898 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.820161 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.820281 29117 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.820443 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.820739 27271 raft_consensus.cc:2376] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7. Re-sending same reply.
I20260709 13:10:41.821259 27272 raft_consensus.cc:2393] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:41.820914 29117 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.821588 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.791076 26659 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:41.794729 29932 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.786962 29705 consensus_queue.cc:260] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.849761 27272 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:41.835942 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:41.850387 26578 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.839597 27243 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.841439 27276 raft_consensus.cc:3055] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:41.849378 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:41.799544 29959 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:41.859201 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:41.851758 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 95264.2us
I20260709 13:10:41.864056 26474 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.869733 26578 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:41.875707 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.865214 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:41.879566 27243 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:41.850926 27276 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:41.768193 29974 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:41.876502 26577 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:41.884850 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:41.856345 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:41.889523 26659 raft_consensus.cc:2368] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10.
I20260709 13:10:41.890733 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:41.890841 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:41.894974 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1829) took 1041 ms. Trace:
I20260709 13:10:41.886346 27276 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.875288 29917 consensus_queue.cc:1059] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:10:41.896944 27276 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.897233 29917 raft_consensus.cc:3055] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:41.897629 29917 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:41.897761 29745 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.898839 26395 catalog_manager.cc:5028] TS ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): tablet 574d2707e806420dab53495563bd03aa (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:10:41.898468 29917 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.895586 26576 rpcz_store.cc:276] 0709 13:10:40.853648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.589795 (+736147us) service_pool.cc:224] Handling call
0709 13:10:41.590148 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.590502 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.590528 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.590993 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.830648 (+239655us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:41.830692 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.830787 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.894756 (+ 63969us) raft_consensus.cc:1685] finished
0709 13:10:41.894777 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.894915 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1090,"raft.queue_time_us":1325,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5089,"thread_start_us":239256,"threads_started":1,"wal-append.queue_time_us":301229}
I20260709 13:10:41.861070 29282 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:41.884558 29887 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:41.877579 29705 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.884195 29790 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:41.895402 29419 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:41.856969 29915 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:10:41.901029 29745 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.889219 29672 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:10:41.904305 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:41.887802 29888 consensus_queue.cc:1059] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:10:41.877079 29931 consensus_queue.cc:1059] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:10:41.914095 26548 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:41.888960 29936 consensus_queue.cc:1059] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:10:41.922765 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:41.924590 29949 raft_consensus.cc:2764] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:41.925465 29936 raft_consensus.cc:3055] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:41.925647 29949 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:41.926067 29936 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:41.927143 29846 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:41.927556 29846 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:41.928386 29846 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.929111 27276 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:41.930397 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 714) took 1157 ms. Trace:
I20260709 13:10:41.930830 26650 rpcz_store.cc:276] 0709 13:10:40.791457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.791598 (+   141us) service_pool.cc:224] Handling call
0709 13:10:40.791906 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.852111 (+ 60205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.930168 (+1078057us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54002d9e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:41.930341 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31798016}
I20260709 13:10:41.927028 29936 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.917850 29166 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:41.936476 29166 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:41.937515 29166 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.940929 29846 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.946578 29117 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.933813 29458 consensus_queue.cc:1059] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:10:41.916111 29419 raft_consensus.cc:697] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:41.951332 29419 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.915369 29917 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:41.935261 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 941b69cce0d24bb9a4f60558447429c4: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:41.942730 26474 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.964107 29790 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:41.964998 26582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2654) took 2961 ms (client timeout 1934 ms). Trace:
W20260709 13:10:41.965372 26582 rpcz_store.cc:269] 0709 13:10:39.003447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.003797 (+   350us) service_pool.cc:224] Handling call
0709 13:10:41.964821 (+2961024us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54000d9654. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:41.964930 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2003027200}
I20260709 13:10:41.966740 29914 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.969182 29914 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:41.969815 29887 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.970372 29887 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.972332 29887 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.974133 29936 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:41.974570 29886 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.974802 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.975150 29886 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.976025 26476 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.977198 26476 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.977720 29791 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:41.978246 29791 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.979468 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.979941 26578 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:41.980698 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.980862 29822 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.981458 26579 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:41.981364 29822 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.980396 29791 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.982398 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.982530 29797 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:41.983287 29888 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:41.983575 27240 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:41.984122 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2112) took 3759 ms. Trace:
I20260709 13:10:41.980880 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.984526 26505 rpcz_store.cc:276] 0709 13:10:38.224347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.066975 (+842628us) service_pool.cc:224] Handling call
0709 13:10:39.111110 (+ 44135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.355967 (+1244857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.983922 (+1627955us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540008f2d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:41.984068 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2713471744}
I20260709 13:10:41.985101 29672 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:41.985507 29672 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:41.985541 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:41.986040 29672 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.987176 29404 raft_consensus.cc:3055] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:41.987543 29404 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:41.986840 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.988328 29404 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:41.981730 29117 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:41.990607 29822 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.991766 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:41.988241 29888 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:41.992393 29918 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.310s	user 0.000s	sys 0.006s
I20260709 13:10:41.993043 29712 raft_consensus.cc:3055] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:41.993434 29712 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:41.994236 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2668) took 1216 ms. Trace:
I20260709 13:10:41.929488 27276 pending_rounds.cc:85] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 7
I20260709 13:10:41.994686 26583 rpcz_store.cc:276] 0709 13:10:40.777607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.787809 (+ 10202us) service_pool.cc:224] Handling call
0709 13:10:41.695037 (+907228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.729124 (+ 34087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.994028 (+264904us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b5400253850. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:41.994159 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085720960}
I20260709 13:10:41.994508 29712 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:41.995491 27276 pending_rounds.cc:107] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:41.995887 27276 raft_consensus.cc:2889] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.996030 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:41.996475 26578 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:41.996563 29891 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:10:41.997153 26583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:10:41.977484 29886 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:41.992255 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:42.060338 26583 raft_consensus.cc:606] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:42.061017 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 68844.2us
I20260709 13:10:42.062390 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.016809 26502 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:42.000941 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.064420 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.017700 26503 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:10:42.065146 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:42.065482 26503 pending_rounds.cc:85] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 3
I20260709 13:10:42.066028 26503 pending_rounds.cc:107] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:10:42.066285 26503 raft_consensus.cc:2889] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:42.066552 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:42.045677 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:42.067266 29951 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:42.024382 26510 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:42.017457 26506 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:42.018401 26505 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:42.034107 29900 raft_consensus.cc:3055] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.069304 29900 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:41.982399 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:42.020766 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.070467 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:42.070508 26509 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:42.071825 26652 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:42.072024 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:42.073238 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:42.073894 26658 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:42.074141 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:42.075119 26652 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:42.056020 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:42.040613 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 55525.1us
I20260709 13:10:41.983289 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:42.010627 29404 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.997963 29796 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:42.007714 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:42.017340 29840 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:41.997210 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 791) took 1573 ms. Trace:
I20260709 13:10:42.107287 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:42.000936 26581 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:42.030844 29915 raft_consensus.cc:3055] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:42.016609 29625 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:42.115360 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:42.116047 26583 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:42.026664 29282 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.024464 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 838) took 1841 ms. Trace:
I20260709 13:10:42.119606 27273 rpcz_store.cc:276] 0709 13:10:40.182967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.183208 (+   241us) service_pool.cc:224] Handling call
0709 13:10:40.255500 (+ 72292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.545295 (+1289795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.024183 (+478888us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400817754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:42.024389 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2964096384}
W20260709 13:10:42.048134 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.029125 29821 raft_consensus.cc:3055] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:41.982725 29791 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:42.048990 26476 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 2.082s (SENT) [suppressed 44 similar messages]
I20260709 13:10:41.962605 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:42.083071 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.090049 26652 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:10:42.134222 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 85296.6us
W20260709 13:10:42.134254 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 171708us
I20260709 13:10:42.136247 26474 leader_election.cc:400] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10.
I20260709 13:10:42.094206 26578 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:42.095178 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:42.098217 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:42.136669 26474 leader_election.cc:403] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:42.137181 27278 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:42.098416 26659 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:42.098814 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:42.136078 26476 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:42.142022 27272 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:42.099946 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:42.143414 26656 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:42.143803 26476 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:42.144723 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:42.100402 26658 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:42.098860 27275 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:42.101703 26582 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:42.104769 26651 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:10:42.111002 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.150188 26651 pending_rounds.cc:85] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 5
I20260709 13:10:42.150421 26510 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:42.150583 26651 pending_rounds.cc:107] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:10:42.112466 26504 raft_consensus.cc:1217] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-8.5]   Dedup: 3.3->[6.4-8.5]
I20260709 13:10:42.150974 26651 raft_consensus.cc:2889] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:42.151289 26504 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: [3.3-8.5]
I20260709 13:10:42.113059 26502 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:42.113768 26503 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:42.106634 27276 rpcz_store.cc:276] 0709 13:10:40.423547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.471341 (+ 47794us) service_pool.cc:224] Handling call
0709 13:10:41.819872 (+1348531us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5800161a98. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f8831902fc0 00007f88318ed929 00007f88318ed3d2 00007f882ae64bd4
0709 13:10:41.820055 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.996372 (+176317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.996982 (+   610us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b540069b4d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:41.997150 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82822912}
I20260709 13:10:42.120858 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.154918 26506 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:42.051622 26473 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.119884 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.121951 26505 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:10:42.118112 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:42.159628 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.160897 26548 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.161038 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:42.162216 26578 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:42.162555 26653 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:42.149106 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:42.149463 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.103157 29796 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:42.173190 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:42.173545 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:42.172670 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:42.121155 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 56755.5us
W20260709 13:10:42.165891 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 114355us
I20260709 13:10:42.177843 26473 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.178365 27272 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:42.163157 26652 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:42.116171 29826 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:42.184497 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:42.115543 29915 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:42.174820 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:42.193333 26653 raft_consensus.cc:2393] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:42.091235 29919 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:10:42.199244 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:42.181890 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.200285 26507 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:42.186082 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:42.160643 29791 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:42.187232 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:42.180332 26622 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:42.179220 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.202147 26652 raft_consensus.cc:2410] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:10:42.203864 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.205228 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:42.205508 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.201499 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.206925 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:42.207083 26507 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:42.108096 29846 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:10:42.185885 26656 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:42.143262 29910 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:42.119740 29951 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:10:42.207752 26582 raft_consensus.cc:2410] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:10:42.208463 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.200067 26657 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:42.233008 26501 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:42.206009 26577 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:42.174197 29790 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10.
I20260709 13:10:42.172654 29886 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:42.119202 29949 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:10:42.125447 29821 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:42.179207 29887 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:42.212131 29916 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:42.175019 29625 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:42.184725 29754 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:42.224743 29910 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:42.211428 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:42.257787 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.308249 26510 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:10:42.143998 29900 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:42.312237 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.313215 26506 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:42.231684 26583 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:42.191100 29901 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:42.192875 29826 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:42.258523 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 53014us
I20260709 13:10:42.316220 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:42.274312 29886 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:42.261525 26579 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:42.197664 29952 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:42.275529 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:42.285940 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.256249 29117 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:10:42.135320 29282 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:42.231969 29458 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:42.190762 29864 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:10:42.190708 29759 consensus_queue.cc:1059] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:10:42.304044 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:42.178737 29822 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:42.212363 29917 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:42.322240 29705 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:42.317286 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.327999 29900 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.211486 29929 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
W20260709 13:10:42.322985 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.351712 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:42.352180 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.352403 26510 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
W20260709 13:10:42.352959 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.353933 27241 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:42.291123 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:42.328235 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.302387 29916 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:42.314834 29910 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:42.359947 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:42.323103 29886 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:42.323489 29790 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:42.350244 26622 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:42.370302 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:42.171309 27278 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:42.301509 29858 raft_consensus.cc:3055] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:42.361253 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:42.334856 29458 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:42.373129 26510 raft_consensus.cc:2410] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:42.373162 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:42.326505 29745 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:10:42.373399 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 293454us
I20260709 13:10:42.380149 26622 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:42.363168 29846 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:42.363668 29917 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.334812 29949 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:10:42.351532 29705 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:42.363238 29916 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:42.385782 26622 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:42.394793 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 217020us
I20260709 13:10:42.355126 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:42.335994 29932 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:42.408792 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.409186 26650 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:42.372167 29790 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.410039 26473 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.410144 29790 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.411306 26473 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:42.413340 26473 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:42.351284 29166 consensus_queue.cc:1059] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:10:42.414644 26473 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:42.416086 26473 leader_election.cc:400] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:42.416486 26473 leader_election.cc:403] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:42.380563 29914 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:42.385260 29736 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:42.384171 29959 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:42.381871 29458 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:42.407356 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 219124us
I20260709 13:10:42.380780 29658 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:42.375412 29858 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:42.371846 29625 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:10:42.396298 29753 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:42.396847 29917 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:42.432775 26510 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:42.455384 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 100321us
W20260709 13:10:42.455384 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 268214us
I20260709 13:10:42.418426 29705 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:42.423897 29736 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.420986 29914 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:42.431097 29959 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.458513 29753 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.459659 29419 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:42.466508 29931 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:42.474164 29929 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:42.430238 29672 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:42.472162 29736 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:42.475387 29914 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:42.478953 29959 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:42.484723 29753 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.514183 29993 consensus_queue.cc:1059] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:10:42.515810 29796 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:42.499039 29991 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:10:42.488222 29658 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:42.492352 29931 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:42.485345 29999 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:42.483201 29858 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:42.495126 29929 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:42.540278 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 186405us
I20260709 13:10:42.512679 29282 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:42.537331 29931 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:42.539660 29896 raft_consensus.cc:3055] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:42.544100 29929 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:42.581190 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:42.547361 29796 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:42.540961 29791 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:42.547297 29658 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:42.555317 29999 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:42.587183 26656 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:10:42.570575 29309 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:42.577067 29858 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:42.591038 26656 pending_rounds.cc:85] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 5
I20260709 13:10:42.593981 26656 pending_rounds.cc:107] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:10:42.594272 26656 raft_consensus.cc:2889] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:42.579187 29932 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:42.576350 29896 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:42.601076 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 219040us
I20260709 13:10:42.589057 29658 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.606580 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:10:42.602612 29936 consensus_meta.cc:287] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.004s
I20260709 13:10:42.601270 29309 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:42.614537 29658 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:42.628451 29404 consensus_meta.cc:287] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.004s
W20260709 13:10:42.640414 29996 log.cc:927] Time spent T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:10:42.618574 29932 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:42.623422 30002 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:42.644200 29936 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:10:42.664927 29989 log.cc:927] Time spent T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:10:42.663446 29908 ts_tablet_manager.cc:1929] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
W20260709 13:10:42.675961 29992 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:10:42.668767 29672 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:42.662716 29791 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:42.670017 29932 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:42.694104 29908 log.cc:1199] T 01228e22d88047b6bc2f5a6b74aa2b51 P b9c3761688a64982ae1c4aeb758e09ef: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/wals/01228e22d88047b6bc2f5a6b74aa2b51
W20260709 13:10:42.698910 29997 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:10:42.676577 29936 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:42.720292 29917 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:42.722754 29917 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:42.723843 29914 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:42.724807 29826 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:42.725384 29988 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:10:42.678565 30002 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:42.610778 29846 raft_consensus.cc:697] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:42.746618 29846 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:42.753788 29936 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:42.723938 29910 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:42.743002 29908 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59074 (request call id 80) took 3804 ms. Trace:
I20260709 13:10:42.764344 29821 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:42.766276 29990 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.382s	user 0.000s	sys 0.002s
I20260709 13:10:42.765717 30002 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:42.768627 29790 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:42.842785 29910 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:42.844707 29942 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:42.845187 29942 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:42.857405 29942 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:42.859194 29942 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:42.850154 29915 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:42.861848 29915 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:42.854852 30015 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:10:42.855981 29914 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:42.820093 30004 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:10:42.818260 30021 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:42.764379 29932 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:42.767087 29908 rpcz_store.cc:276] 0709 13:10:38.937497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.003759 (+ 66262us) service_pool.cc:224] Handling call
0709 13:10:40.474392 (+1470633us) ts_tablet_manager.cc:1151] Deleting tablet 01228e22d88047b6bc2f5a6b74aa2b51
0709 13:10:40.487920 (+ 13528us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:10:41.967285 (+1479365us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:42.657434 (+690149us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:42.736562 (+ 79128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29750,"tablet-delete.queue_time_us":1181909,"thread_start_us":1013907,"threads_started":1}
I20260709 13:10:42.790035 29929 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:42.874439 29929 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:42.877161 29959 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:42.880062 29959 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:42.882987 29999 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:42.889943 29916 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:42.892987 29916 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:42.894241 29931 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:42.896988 29931 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:42.937745 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:42.470782 26474 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:42.944882 26473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.012s
W20260709 13:10:42.945523 26473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.001s	sys 0.013s
W20260709 13:10:42.945848 26501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.012s
W20260709 13:10:42.946440 26501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.000s	sys 0.012s
W20260709 13:10:42.946106 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 475273us
W20260709 13:10:42.948024 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 532062us
I20260709 13:10:42.948190 26474 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:42.949754 26473 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:42.952625 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.953177 26392 catalog_manager.cc:5028] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): tablet 01228e22d88047b6bc2f5a6b74aa2b51 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
W20260709 13:10:42.955456 26508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.013s	sys 0.011s
W20260709 13:10:42.955957 26508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.013s	sys 0.011s
I20260709 13:10:42.955648 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.960131 26473 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:42.965090 26473 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:42.973029 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 616) took 1231 ms. Trace:
W20260709 13:10:42.973721 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.974941 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.009s	sys 0.008s
W20260709 13:10:42.977923 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.010s	sys 0.008s
W20260709 13:10:42.982183 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.982340 29166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.006s
W20260709 13:10:42.982836 29166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.000s	sys 0.006s
I20260709 13:10:42.591346 29282 consensus_queue.cc:1059] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:10:42.987040 29282 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:42.975602 26625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.010s
W20260709 13:10:42.989990 26625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.000s	sys 0.010s
I20260709 13:10:42.991190 29309 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:42.994026 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 608306us
W20260709 13:10:42.974630 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:43.014565 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.014910 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:43.018798 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.988381 29282 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:42.995608 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.973685 26585 rpcz_store.cc:276] 0709 13:10:41.740999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.741165 (+   166us) service_pool.cc:224] Handling call
0709 13:10:41.741668 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.742230 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:41.902513 (+160283us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.212665 (+310152us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.261993 (+ 49328us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.262174 (+   181us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:42.262220 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.262309 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.724665 (+462356us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:42.972228 (+247563us) raft_consensus.cc:1685] finished
0709 13:10:42.972406 (+   178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.972760 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43061,"prepare.queue_time_us":179532,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":14993,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":48635,"spinlock_wait_cycles":8545536,"thread_start_us":328543,"threads_started":2,"wal-append.queue_time_us":488738}
I20260709 13:10:42.773983 29753 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.024883 29712 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:43.026124 29759 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:43.026716 29759 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.027248 29759 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.027472 29753 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.028751 29753 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:43.029225 29753 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.998505 26576 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:43.030951 29790 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.031908 29753 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:43.006343 29117 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:43.032637 29797 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:43.003646 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 396991us
I20260709 13:10:43.017091 29672 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:42.824396 29826 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.073128 30001 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.067836 29797 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.072952 29117 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.027568 29743 raft_consensus.cc:3055] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:43.073238 30003 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:43.090066 29919 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:43.091588 29900 consensus_meta.cc:287] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.724s	user 0.013s	sys 0.000s
I20260709 13:10:43.092116 30002 raft_consensus.cc:2764] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:42.783394 29821 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:43.094713 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.098861 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:43.078265 29797 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:43.102785 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 274eefdb88c143849b4b07f0d6ffcdc0: Illegal state: Replica af1b5d6d444447b7a580afb4aff33320 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:43.104171 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:43.105919 29826 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.106061 29625 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.106725 29931 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:43.091616 29887 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:43.112195 29916 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:43.114854 29959 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:43.115558 29999 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:43.116360 29672 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:43.116935 29745 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.117794 27240 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:43.117808 29932 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.085793 29743 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:43.146909 26652 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:43.146207 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:43.148262 27269 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.009s
W20260709 13:10:43.148829 27269 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.000s	sys 0.009s
W20260709 13:10:43.150141 26548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.005s	sys 0.005s
W20260709 13:10:43.150544 26548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.005s	sys 0.005s
W20260709 13:10:43.151269 26507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.000s	sys 0.009s
W20260709 13:10:43.152674 26549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.004s	sys 0.006s
I20260709 13:10:43.152475 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:43.153064 26549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.004s	sys 0.006s
W20260709 13:10:43.153671 26507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.000s	sys 0.010s
I20260709 13:10:43.148272 26650 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
W20260709 13:10:43.153472 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 693448us
I20260709 13:10:43.155665 26625 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:43.152334 29625 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.171222 26576 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:43.171366 29896 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.172871 29625 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:43.172989 29896 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.174434 29931 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:43.175781 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 71894.9us
I20260709 13:10:43.152366 29932 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.177812 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:43.186036 29745 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.189742 29916 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.162231 30003 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:43.171563 29743 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:43.163249 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 734035us
I20260709 13:10:43.192343 26582 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:43.209141 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 78011.8us
W20260709 13:10:43.216575 29822 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.047s	sys 0.040s
I20260709 13:10:43.203802 29887 raft_consensus.cc:697] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:43.219298 26658 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:43.226024 26625 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:43.227921 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:43.212111 29900 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:43.237769 29914 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:43.241698 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.220291 29959 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:43.240921 26585 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:43.244942 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:43.230252 29796 consensus_meta.cc:287] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.641s	user 0.003s	sys 0.015s
I20260709 13:10:43.222463 29117 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.248373 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:43.230580 29282 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:43.252171 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:43.244216 29822 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.048s	sys 0.040s
I20260709 13:10:43.252775 26582 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 8: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:43.205818 29826 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:43.254825 26510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.006s	sys 0.007s
W20260709 13:10:43.255304 26510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.007s	sys 0.007s
I20260709 13:10:43.255605 29887 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.256629 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2146) took 1025 ms. Trace:
I20260709 13:10:43.238662 30000 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:43.270934 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:43.280558 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 163048us
I20260709 13:10:43.283046 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:43.283756 29458 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.817s	user 0.010s	sys 0.010s
I20260709 13:10:43.284332 29458 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.284746 29959 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:43.286173 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 60350.2us
I20260709 13:10:43.285743 29915 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:10:43.257997 29900 raft_consensus.cc:697] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:43.287259 26625 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:43.288480 29915 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:43.288103 29900 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.289309 26474 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:43.290143 26581 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:43.292243 29886 consensus_meta.cc:287] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.917s	user 0.008s	sys 0.009s
I20260709 13:10:43.257812 29834 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:43.289712 30017 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.292141 26585 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.261096 26510 rpcz_store.cc:276] 0709 13:10:42.230997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.475486 (+244489us) service_pool.cc:224] Handling call
0709 13:10:42.492366 (+ 16880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.492557 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:42.499534 (+  6977us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.255860 (+756326us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.256202 (+   342us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:43.256306 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.256413 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.256570 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6802,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":7549,"raft.queue_time_us":3283,"thread_start_us":755848,"threads_started":1}
I20260709 13:10:43.306131 30005 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.286113 29959 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.307159 30005 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.309820 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:43.310853 29932 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.317747 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:43.318292 29745 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.247504 30003 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.323280 30011 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:43.377054 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 51999.2us
I20260709 13:10:43.384255 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.390213 29862 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:43.391383 29826 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.275481 29672 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:43.384056 26404 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34738 (request call id 297) took 13098 ms (client timeout 15000 ms). Trace:
I20260709 13:10:43.395521 29743 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:43.403215 29117 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:43.405920 29994 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:43.410115 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 116788us
I20260709 13:10:43.406580 29282 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.409405 26405 catalog_manager.cc:5697] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.410971 29282 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.406620 29458 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:43.414002 30017 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.414798 29458 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.415467 29458 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.414120 27274 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:43.411952 26405 catalog_manager.cc:5697] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: leader changed from <none> to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 5 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:43.301645 29834 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:43.406767 27270 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:43.422966 26585 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:10:43.418426 29117 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:43.429893 29117 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.431493 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:43.417768 29796 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 13:10:43.393889 26404 rpcz_store.cc:269] 0709 13:10:30.198704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.242335 (+ 43631us) service_pool.cc:224] Handling call
0709 13:10:43.275757 (+13033422us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:40.294250 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:40.442184 (+147934us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:40.447783 (+  5599us) write_op.cc:435] Acquired schema lock
0709 13:10:40.459289 (+ 11506us) tablet.cc:662] Decoding operations
0709 13:10:41.018490 (+559201us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:41.027213 (+  8723us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:41.031482 (+  4269us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:10:41.322644 (+291162us) tablet.cc:701] Row locks acquired
0709 13:10:41.322665 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:10:41.322850 (+   185us) write_op.cc:270] Start()
0709 13:10:41.322968 (+   118us) write_op.cc:276] Timestamp: P: 1783602641322795 usec, L: 0
0709 13:10:41.322991 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:41.323760 (+   769us) log.cc:844] Serialized 5603 byte log entry
0709 13:10:41.758246 (+434486us) op_driver.cc:464] REPLICATION: finished
0709 13:10:42.034551 (+276305us) spinlock_profiling.cc:243] Waited 897 us on lock 0x7b180028d020. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:42.034707 (+   156us) write_op.cc:301] APPLY: starting
0709 13:10:42.034788 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:42.035096 (+   308us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:42.035119 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:42.384982 (+349863us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:42.466713 (+ 81731us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:10:42.472624 (+  5911us) write_op.cc:312] APPLY: finished
0709 13:10:42.531386 (+ 58762us) log.cc:844] Serialized 101 byte log entry
0709 13:10:42.542457 (+ 11071us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:42.557609 (+ 15152us) write_op.cc:454] Released schema lock
0709 13:10:42.574286 (+ 16677us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:42.595981 (+ 21695us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:42.598136 (+  2155us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17330,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":147422,"apply.run_cpu_time_us":6729,"apply.run_wall_time_us":553302,"num_ops":14,"prepare.queue_time_us":1060110,"prepare.run_cpu_time_us":24915,"prepare.run_wall_time_us":1236830,"raft.queue_time_us":147676,"raft.run_cpu_time_us":50135,"raft.run_wall_time_us":166902,"replication_time_us":435073,"spinlock_wait_cycles":2062592,"thread_start_us":1167624,"threads_started":4,"wal-append.queue_time_us":251881}]]}
I20260709 13:10:43.438935 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 854) took 1386 ms. Trace:
I20260709 13:10:43.439849 26652 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:43.441663 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2606) took 1242 ms. Trace:
I20260709 13:10:43.442154 26507 rpcz_store.cc:276] 0709 13:10:42.182190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.207714 (+ 25524us) service_pool.cc:224] Handling call
0709 13:10:42.208033 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.396894 (+188861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.396928 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.424389 (+ 27461us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.230703 (+806314us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:43.238189 (+  7486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.238300 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.418220 (+179920us) raft_consensus.cc:1685] finished
0709 13:10:43.418238 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.424776 (+  6538us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1328,"raft.queue_time_us":120572,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10331,"thread_start_us":861666,"threads_started":2,"wal-append.queue_time_us":852889}
I20260709 13:10:43.443468 29282 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.444538 29458 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:43.440774 26405 catalog_manager.cc:5697] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 5, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 5 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.447610 26405 catalog_manager.cc:5697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.439407 27274 rpcz_store.cc:276] 0709 13:10:42.052167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.052349 (+   182us) service_pool.cc:224] Handling call
0709 13:10:42.104738 (+ 52389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.416291 (+1311553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.438611 (+ 22320us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54007c01d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:43.438856 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3010023808}
I20260709 13:10:43.437175 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:43.453776 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 69307.7us
I20260709 13:10:43.455724 27240 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:43.456168 26474 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:43.449733 26405 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 5, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 5 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.471045 29117 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.458642 29993 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:43.473425 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:43.474149 26659 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:43.476086 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:43.476603 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99984.2us
I20260709 13:10:43.474900 30006 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:43.480751 29458 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.482116 29834 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.483772 26659 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:43.483788 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:43.484757 27275 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:10:43.486094 29309 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.486414 27278 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:43.486683 27271 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:10:43.488916 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.421813 30005 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.321496 29886 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.498807 29117 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.493525 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:43.499361 26652 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
W20260709 13:10:43.501519 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.501662 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:43.494033 29736 consensus_meta.cc:287] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.882s	user 0.003s	sys 0.012s
I20260709 13:10:43.503486 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:43.488720 30006 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.507472 30006 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.508271 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:43.509326 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.510373 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.511106 26576 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:43.501966 29309 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.514442 29309 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:43.515103 30000 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:43.517215 29942 consensus_meta.cc:287] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.008s
I20260709 13:10:43.517994 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:43.518586 26657 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.518918 30003 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:43.520715 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:43.522040 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:43.522768 26506 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:43.523931 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:43.524704 26508 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.526260 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:43.526913 26504 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:43.528316 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:43.531235 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:43.502511 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:43.505163 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:43.414837 30017 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.505831 26405 catalog_manager.cc:5697] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.506901 29886 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.516793 29797 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.503731 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:43.530062 26583 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:43.552616 30017 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.552615 26405 catalog_manager.cc:5697] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.554221 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:43.555362 26650 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:43.556123 26405 catalog_manager.cc:5697] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 5, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 5 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.557474 26474 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:43.529510 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:43.558641 26502 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:43.559091 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.559140 26405 catalog_manager.cc:5697] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:43.561173 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.560421 29916 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.561882 26510 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:43.559127 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.562649 26405 catalog_manager.cc:5697] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:43.564554 26405 catalog_manager.cc:5697] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.554302 29753 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.566464 26509 raft_consensus.cc:2393] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:43.546288 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 53802.1us
I20260709 13:10:43.569285 26508 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
W20260709 13:10:43.565421 29705 consensus_meta.cc:287] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.959s	user 0.010s	sys 0.014s
I20260709 13:10:43.578703 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:43.579733 27270 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:43.585954 29117 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:43.586527 29117 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:43.586992 29117 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.586802 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:43.495648 29458 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.581801 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:43.584921 26405 catalog_manager.cc:5697] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.594883 26505 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:43.598657 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:43.593432 26549 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:43.596477 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.601234 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:43.603935 26507 raft_consensus.cc:2393] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:43.605949 29901 consensus_queue.cc:1059] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:43.607465 29901 raft_consensus.cc:3055] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:43.606956 26405 catalog_manager.cc:5697] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.607973 29901 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:43.609010 26405 catalog_manager.cc:5697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 4, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 4 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:43.615123 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.569698 29931 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:43.616756 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:43.621014 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:43.622356 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.623807 26581 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:43.625239 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 83432.3us
I20260709 13:10:43.594442 29886 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:43.635929 29886 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.636328 29994 consensus_queue.cc:1059] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:43.637415 29994 raft_consensus.cc:3055] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:43.637789 29994 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:43.638600 29886 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.639364 26503 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:43.590101 29705 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.616055 30005 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:43.642107 26508 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:43.642048 30005 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:43.642856 30031 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.212s	user 0.001s	sys 0.001s
W20260709 13:10:43.632974 29658 consensus_meta.cc:287] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.886s	user 0.014s	sys 0.005s
I20260709 13:10:43.645049 29658 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.647192 29658 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:43.644701 30005 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.567014 29736 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.651360 29753 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.652005 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:43.653834 26579 raft_consensus.cc:2410] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:10:43.653353 29993 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:43.654891 29942 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:43.657733 29759 consensus_meta.cc:287] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.011s
I20260709 13:10:43.658394 29759 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.660820 29759 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:43.661374 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:43.649375 30033 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:10:43.662019 26549 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:43.663425 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 856) took 1610 ms. Trace:
I20260709 13:10:43.664906 29862 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:43.641362 29705 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.663844 27269 rpcz_store.cc:276] 0709 13:10:42.053162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.061376 (+  8214us) service_pool.cc:224] Handling call
0709 13:10:42.127359 (+ 65983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.551011 (+423652us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:43.149390 (+598379us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.281872 (+132482us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.402273 (+120401us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.402553 (+   280us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:43.402609 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.402753 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.648302 (+245549us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:43.663108 (+ 14806us) raft_consensus.cc:1685] finished
0709 13:10:43.663218 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.663369 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":249,"prepare.queue_time_us":873731,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":43,"raft.queue_time_us":180330,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":11357,"spinlock_wait_cycles":43124992,"thread_start_us":911813,"threads_started":3,"wal-append.queue_time_us":146281}
I20260709 13:10:43.590534 29282 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:43.657873 29951 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:43.667351 26583 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:43.609360 29901 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.614166 26405 catalog_manager.cc:5697] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 2 to 3, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.671521 29117 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.639165 29994 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.674126 26510 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
W20260709 13:10:43.676859 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 53350.5us
I20260709 13:10:43.681754 26657 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:43.665443 29862 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.697119 26502 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:43.703102 29117 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.666556 30016 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:10:43.704487 26509 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:43.653373 29736 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.675485 29951 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.679491 29915 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:43.711762 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:43.712092 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:43.720675 26508 raft_consensus.cc:2410] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:10:43.702865 29862 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:43.726025 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.704216 30011 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:10:43.720474 29896 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:43.730319 29896 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.718505 29951 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:43.720719 30016 consensus_queue.cc:1243] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:43.746982 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.748432 26582 raft_consensus.cc:2393] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:43.748834 29993 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.749063 29910 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.678593 29166 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:10:43.749687 29672 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.749650 29910 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.750526 29672 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.751372 29166 raft_consensus.cc:3055] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:43.751959 29166 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:43.749286 30005 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:43.733343 29896 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:43.754556 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.737181 29712 raft_consensus.cc:993] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:10:43.703936 29821 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.240s
I20260709 13:10:43.706635 29796 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:43.741642 29994 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:43.774442 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 51569.2us
W20260709 13:10:43.761407 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 51550.5us
W20260709 13:10:43.771837 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 58904.9us
I20260709 13:10:43.753223 29672 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.710140 30006 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.765393 26504 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:43.718526 29282 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.801908 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.803289 29117 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.753460 29910 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.810428 29915 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.811420 27241 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:43.812575 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 176489us
I20260709 13:10:43.814877 29672 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:43.814734 29942 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:43.816756 30040 log.cc:927] Time spent T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.111s	user 0.000s	sys 0.002s
I20260709 13:10:43.820869 27243 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:43.822521 29672 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:43.823014 29672 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.823382 29672 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:43.830119 29458 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.778831 30011 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.832057 30011 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:43.834769 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.837119 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:43.760432 30005 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.839790 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:43.840772 26650 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:43.843030 26625 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:43.843890 26650 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:43.845331 29117 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.846684 29901 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.847595 29117 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:43.848445 29797 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.852231 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:43.853574 26650 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:43.853739 29900 raft_consensus.cc:1081] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
W20260709 13:10:43.862696 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.863747 27241 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:43.869904 27274 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3.
I20260709 13:10:43.870893 26506 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:43.804631 29896 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.884428 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.753691 29993 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.870216 29910 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.901014 26650 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:10:43.905987 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 63044.3us
W20260709 13:10:43.907044 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 61911.4us
I20260709 13:10:43.877360 30016 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.894227 26580 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:10:43.878568 30008 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:10:43.773684 29166 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:43.915362 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 176430us
I20260709 13:10:43.876995 29900 consensus_queue.cc:1059] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:10:43.921200 29932 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:43.925698 26622 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:43.927011 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:43.924011 29458 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:10:43.935286 30038 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.936208 29834 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.936020 30038 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.937211 26658 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:43.938402 26625 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:43.941831 29916 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:43.942695 29916 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.943183 29916 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.943485 29754 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:10:43.945829 29931 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:43.946390 29931 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.946856 29931 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.948202 26650 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:43.949851 29821 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.950402 29821 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.952764 29821 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.955310 29932 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:43.955925 27243 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:43.958315 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.960748 26582 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:43.961035 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:43.962003 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.941892 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.938457 26656 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:43.963078 26580 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:43.967417 26582 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:43.968401 27241 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:43.969882 26474 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:43.908725 29896 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.982218 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:43.971052 29797 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.956871 29932 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:43.968787 30005 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:43.962580 30011 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:43.978261 29821 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:43.994029 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:43.916706 30016 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:43.978250 29458 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.993954 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:43.998202 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.984920 29900 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:43.992224 29166 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.076954 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:43.996958 29959 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.068276 29900 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.978873 29754 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 13:10:44.086864 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.090914 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 176059us
I20260709 13:10:44.061703 30005 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:44.059113 30017 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.095427 26577 raft_consensus.cc:2410] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:10:44.096321 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.096554 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:44.098489 26652 raft_consensus.cc:2393] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:44.101935 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:44.103889 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:44.105904 26654 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:10:44.106051 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:44.106947 26656 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.117475 26548 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:44.088284 29900 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.084291 29821 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:44.153192 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:44.153417 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.097368 30005 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:44.060269 29796 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:10:44.161595 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:44.105660 30006 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:44.171854 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:44.189467 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.180346 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:44.110733 29282 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:44.197727 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.197968 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:44.189067 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:44.198110 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:44.207693 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:44.212730 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:44.214072 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:44.170722 29743 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:44.090652 29959 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.204214 26578 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:44.111052 29951 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:44.219452 26654 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:10:44.225636 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 123478us
I20260709 13:10:44.183197 30005 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.226737 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:44.110951 29797 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:44.178699 29942 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.229247 26625 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:44.172865 30038 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:44.264638 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 162089us
I20260709 13:10:44.268316 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:44.252837 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.198278 29887 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:44.117794 26504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:55308
I20260709 13:10:44.203943 30050 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:44.278057 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 195208us
I20260709 13:10:44.279723 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:44.154222 30017 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.287233 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:44.277315 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 51904.7us
I20260709 13:10:44.226567 29743 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:44.299304 27240 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:44.236037 29993 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:44.284664 26577 raft_consensus.cc:2376] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 3. Re-sending same reply.
W20260709 13:10:44.285060 29862 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
W20260709 13:10:44.303325 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 105103us
W20260709 13:10:44.303536 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 190320us
I20260709 13:10:44.305150 29117 consensus_queue.cc:1059] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:44.310957 26579 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:44.311805 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:44.298789 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:44.314270 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:44.322531 26652 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
W20260709 13:10:44.331449 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.335263 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:44.302624 29743 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.347656 26578 raft_consensus.cc:2368] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9.
I20260709 13:10:44.348681 26625 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:44.353952 30058 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:10:44.356278 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:44.356691 30052 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 13:10:44.357824 30063 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:10:44.359550 30065 log.cc:927] Time spent T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:44.360579 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:44.361271 26654 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:44.362633 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:44.363379 29840 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:44.363806 29840 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.364183 29840 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.364481 29910 raft_consensus.cc:3055] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:44.364924 29910 raft_consensus.cc:740] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:44.366111 30056 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
W20260709 13:10:44.369843 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 66820.9us
I20260709 13:10:44.370513 29910 consensus_queue.cc:260] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.371275 26622 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:44.372053 29910 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.372880 30046 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:44.375473 29705 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:44.376227 29915 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:44.377862 26584 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:44.378947 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:44.379143 29959 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:44.379812 26584 raft_consensus.cc:2410] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:44.322168 29993 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.381958 29993 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.384667 29993 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:44.390404 30055 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:10:44.298832 30006 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.350069 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:44.400182 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 76340us
I20260709 13:10:44.299794 30050 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:44.310137 29896 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:44.375336 30017 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:44.348872 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:44.412698 26653 raft_consensus.cc:2393] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:44.276897 30048 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:10:44.404619 29754 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.299048 29887 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.430161 26509 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:10:44.431499 29887 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:44.432229 29887 raft_consensus.cc:3055] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:44.432600 29887 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:44.292681 29942 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.331329 30008 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.398375 26579 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:44.373391 30046 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.305660 29753 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:10:44.417418 27241 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:44.421064 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:44.420755 29754 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.421531 30006 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:44.425741 30054 log.cc:927] Time spent T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.338s	user 0.001s	sys 0.001s
I20260709 13:10:44.329809 29821 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:44.428344 26658 raft_consensus.cc:2393] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:44.442317 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:44.448758 26580 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:44.449770 26656 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:44.316145 29862 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:44.465451 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 54002.5us
I20260709 13:10:44.500519 26584 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:10:44.465081 26655 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:44.505081 26585 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:44.506837 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:44.508062 26656 raft_consensus.cc:2410] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:44.509615 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:44.434182 29712 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:44.451915 30016 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:44.504487 26584 pending_rounds.cc:85] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 7
I20260709 13:10:44.465080 30074 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.496475 30046 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.515596 26584 pending_rounds.cc:107] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:10:44.527307 26584 raft_consensus.cc:2889] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:44.528194 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:44.525614 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:44.530659 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 235309us
I20260709 13:10:44.526598 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:10:44.523914 29994 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.716s	user 0.007s	sys 0.004s
W20260709 13:10:44.526158 29931 consensus_meta.cc:287] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.001s
I20260709 13:10:44.534094 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:44.532670 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 115339us
I20260709 13:10:44.534094 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:44.544443 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:44.546957 26656 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:44.501296 30008 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:44.548779 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.433537 29887 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.552301 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:44.560288 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:44.540997 29901 consensus_meta.cc:287] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.003s
I20260709 13:10:44.561741 26655 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:44.563469 26473 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:44.539389 30072 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:44.562915 26579 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
W20260709 13:10:44.567350 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.554993 29834 consensus_meta.cc:287] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.001s
I20260709 13:10:44.577054 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:44.582751 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:44.583726 26507 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:44.588171 26656 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:44.588632 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:44.569067 29994 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.576503 30072 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.607285 26504 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.615088 26504 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.569489 29797 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:44.616115 27278 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:44.623085 29672 consensus_meta.cc:287] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.003s
I20260709 13:10:44.623587 29672 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.534281 30074 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:44.611024 27274 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:44.595997 29117 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.614179 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:44.539044 29900 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.547257 29931 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:44.602973 29916 consensus_meta.cc:287] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.659s	user 0.013s	sys 0.001s
I20260709 13:10:44.566771 29951 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:44.628065 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 67003.4us
I20260709 13:10:44.616246 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:44.618077 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 319128us
I20260709 13:10:44.636610 27240 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:44.638157 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:44.638882 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.639000 26579 raft_consensus.cc:2410] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:44.638691 26625 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:44.632773 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 80320.7us
I20260709 13:10:44.642599 26585 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:44.642915 27270 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:44.615316 30077 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.640275 26625 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:44.649209 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 46190us
I20260709 13:10:44.649885 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:44.630081 30071 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.651566 30071 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.653146 29942 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:44.654150 26650 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:44.628448 29887 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.654961 27240 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:44.655376 26474 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:44.658607 26578 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:44.663182 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:44.659955 29117 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:44.642117 29753 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:44.668196 27240 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:44.618566 30072 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.648170 29959 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:44.645714 29797 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:44.677026 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:10:44.678411 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 166889us
I20260709 13:10:44.680389 26474 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:44.557494 30050 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.683094 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:44.625712 29994 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.683836 30076 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:44.688330 27269 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:44.657119 29404 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:44.689714 30081 consensus_queue.cc:1059] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:10:44.689880 29404 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.690685 26651 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:10:44.691097 26651 pending_rounds.cc:85] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 5
I20260709 13:10:44.691421 26651 pending_rounds.cc:107] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:10:44.691671 26651 raft_consensus.cc:2889] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:44.684208 29959 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.692250 29959 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.692329 27243 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:44.692636 30083 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:44.667713 29672 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:44.693138 30083 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.693639 30083 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.693158 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:44.693931 30060 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 13:10:44.690974 29896 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:44.694859 29896 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:44.695161 29117 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:44.695283 29896 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.695713 29117 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:44.696168 29117 raft_consensus.cc:697] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:44.696875 30080 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:10:44.684386 29797 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:44.697805 30059 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.310s	user 0.002s	sys 0.000s
I20260709 13:10:44.698004 29797 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:44.699030 29951 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:44.699574 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:44.700826 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:44.702076 27271 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:44.702230 29993 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:44.666734 29712 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:44.702876 29942 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:44.703267 26476 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:44.704422 29942 consensus_queue.cc:1059] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:44.701378 27278 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:44.660092 29915 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:44.666828 29910 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:44.711210 27273 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:44.658473 30075 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:44.705976 29166 raft_consensus.cc:3055] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:44.696990 29117 consensus_queue.cc:237] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:44.733176 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:44.735837 29166 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:44.637681 29916 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:44.719600 27270 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:44.648409 29901 consensus_queue.cc:1059] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:10:44.731151 26504 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.711932 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:44.710004 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:44.742974 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:44.660456 30016 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:10:44.677754 29753 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:44.706871 30084 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.752799 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:44.759063 27278 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.757318 29166 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:44.707257 29900 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:44.705847 29796 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:44.777742 29796 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:44.777783 29743 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:44.779465 26583 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:44.780094 30008 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:44.756785 29910 raft_consensus.cc:697] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:44.781812 29743 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:44.782594 29910 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.709537 30074 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:44.718369 29862 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:44.756757 30071 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:44.788486 29994 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:44.774168 30057 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:44.774621 27273 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:44.766716 29672 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:44.775760 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:44.775995 27276 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:44.776868 30075 raft_consensus.cc:697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:44.723169 29915 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.790771 26654 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:44.792096 29166 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:44.796898 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.745075 30006 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:44.818769 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 85767.1us
I20260709 13:10:44.705551 29942 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:10:44.758298 29914 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.661598 30077 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:44.766855 29753 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:44.790433 30081 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:44.757318 29754 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:44.998500 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.820449 30057 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:44.779477 29796 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.007825 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:45.005328 29942 raft_consensus.cc:3055] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:45.000058 30006 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:45.010567 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 361397us
W20260709 13:10:45.010820 30064 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.624s	user 0.001s	sys 0.001s
I20260709 13:10:45.012529 29916 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:45.013254 29840 consensus_meta.cc:287] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.006s
I20260709 13:10:45.016258 30075 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.022796 30077 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.023736 29834 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.024744 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 374889us
I20260709 13:10:45.046613 26622 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:45.027513 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 347173us
I20260709 13:10:44.961546 29915 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:45.029332 26582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.017s	sys 0.023s
W20260709 13:10:45.049011 26582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.018s	sys 0.023s
I20260709 13:10:45.000671 30081 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:44.819965 29901 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.209s
I20260709 13:10:45.005307 29931 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:45.043540 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:44.997179 29994 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.035631 30038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.011s	sys 0.009s
I20260709 13:10:45.027871 30057 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:45.029085 29942 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:45.035892 30006 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:45.065418 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 362372us
I20260709 13:10:45.070533 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:45.090006 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 338685us
I20260709 13:10:45.050112 30077 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.071480 30038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.011s	sys 0.009s
I20260709 13:10:45.097433 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.056026 29916 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.042793 29736 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:10:45.106105 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 59673.9us
I20260709 13:10:45.170261 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:45.172849 29887 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:45.174714 29959 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.177425 29887 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.181594 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.184082 29887 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.110348 27278 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:45.089979 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.185240 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1965) took 1088 ms. Trace:
I20260709 13:10:45.185942 26658 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:45.068113 29834 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.186586 26650 rpcz_store.cc:276] 0709 13:10:44.096940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.101448 (+  4508us) service_pool.cc:224] Handling call
0709 13:10:45.184973 (+1083525us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b5400108954. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:45.185141 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263441152}
I20260709 13:10:45.091348 29796 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:45.090577 30006 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.189529 29834 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.200635 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.079550 30011 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:45.048329 29840 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.105120 26476 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:45.168716 27276 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:45.093358 29712 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.284085 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.185237 29887 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:45.297209 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 733) took 1427 ms. Trace:
I20260709 13:10:45.297263 29887 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.297890 26657 rpcz_store.cc:276] 0709 13:10:43.837455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.837638 (+   183us) service_pool.cc:224] Handling call
0709 13:10:43.838025 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.893921 (+ 55896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.893950 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.911869 (+ 17919us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.173822 (+261953us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:44.173865 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.173945 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.994788 (+820843us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:45.240286 (+245498us) raft_consensus.cc:1685] finished
0709 13:10:45.240310 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.264968 (+ 24658us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55435,"raft.queue_time_us":77907,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":42333,"spinlock_wait_cycles":50478464,"thread_start_us":206710,"threads_started":1,"wal-append.queue_time_us":463780}
I20260709 13:10:45.300077 29887 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.194864 30017 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:45.091625 29994 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:45.263763 30072 consensus_meta.cc:287] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.576s	user 0.017s	sys 0.004s
I20260709 13:10:45.317744 26548 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:45.240280 29834 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:45.113445 30077 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.241323 29901 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:45.348791 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:45.351926 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 246899us
I20260709 13:10:45.167865 29916 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.208523 30097 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:45.360474 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 258544us
W20260709 13:10:45.323398 29896 consensus_meta.cc:287] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.001s
I20260709 13:10:45.308519 30093 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:45.264887 29712 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:45.374168 26473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.003s	sys 0.007s
W20260709 13:10:45.377458 26473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.003s	sys 0.007s
I20260709 13:10:45.378916 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:45.266451 30011 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:45.383265 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.381778 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:45.386298 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 216115us
I20260709 13:10:45.422533 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:45.425341 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:45.425933 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45218.5us
I20260709 13:10:45.428251 27276 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:45.310349 29942 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.362336 29901 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.436359 27278 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:45.347115 30072 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.436853 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:45.431129 30056 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:45.359927 29834 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.398445 30097 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:45.369803 29896 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.443991 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:45.431706 30008 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.430474 29887 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:45.450141 30094 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.450635 30095 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:45.450759 30097 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.464468 27275 raft_consensus.cc:2393] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:45.443007 30093 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:45.468984 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 44724.1us
I20260709 13:10:45.469440 30011 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.466738 29887 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.475198 29896 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.478757 29712 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.487296 30072 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.489980 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:45.491873 29797 consensus_meta.cc:287] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.793s	user 0.010s	sys 0.000s
I20260709 13:10:45.477433 30006 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.457616 29942 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.515875 27270 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:10:45.492189 30083 consensus_meta.cc:287] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.798s	user 0.010s	sys 0.003s
I20260709 13:10:45.521795 29821 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:45.522213 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:45.523561 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:45.523802 26501 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:45.524166 27273 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:45.525918 26503 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:45.526051 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:45.525352 26508 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:45.526201 26505 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:45.527103 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:45.527868 26510 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:45.528316 26501 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:45.522365 29821 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:45.525197 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:45.526229 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:45.535919 27270 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:45.531957 26509 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:45.533360 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:45.450807 30094 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.463873 30008 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.559329 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:45.560148 27273 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 3.
I20260709 13:10:45.538196 29821 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:45.558437 26509 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:10:45.565512 30067 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.059s	user 0.002s	sys 0.019s
I20260709 13:10:45.565762 30106 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.545288 29840 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:45.539039 30083 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:45.562353 30005 consensus_meta.cc:287] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.269s	user 0.006s	sys 0.013s
W20260709 13:10:45.566089 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.517376 29797 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.568173 26622 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:45.569677 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:45.592178 26509 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.567085 30098 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.593951 30098 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.596351 30098 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.598453 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:45.630440 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 62390.5us
W20260709 13:10:45.566890 30068 log.cc:927] Time spent T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 1.084s	user 0.013s	sys 0.024s
I20260709 13:10:45.633538 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:45.582091 30094 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:45.567072 30102 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:10:45.635442 26622 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:45.566596 29458 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.000s	sys 0.024s
I20260709 13:10:45.565536 30066 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:45.533722 30093 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.582626 29951 raft_consensus.cc:3055] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:45.571753 30079 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.909s	user 0.004s	sys 0.015s
I20260709 13:10:45.574581 29887 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:45.576509 29915 consensus_meta.cc:287] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.002s
I20260709 13:10:45.629944 29862 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:45.635907 30098 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:45.629460 29910 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.640355 30016 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:45.653720 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:45.636153 30084 consensus_meta.cc:287] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.847s	user 0.009s	sys 0.002s
I20260709 13:10:45.646361 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:45.654774 26510 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.579818 29994 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:45.649827 29914 consensus_meta.cc:287] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.004s
W20260709 13:10:45.640744 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 116709us
I20260709 13:10:45.631971 29840 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:45.640864 29458 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.000s	sys 0.025s
I20260709 13:10:45.567165 30089 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:45.571525 30083 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.579730 30005 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:45.645656 30057 consensus_meta.cc:287] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:10:45.678570 30057 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.679864 29404 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.680388 30005 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.680747 30057 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.681434 27272 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:45.681722 30108 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:45.682365 30108 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.682314 30081 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.683053 30108 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:45.683540 30081 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.579375 30008 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:45.574046 29916 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:45.645879 29951 raft_consensus.cc:740] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:45.675915 26650 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:45.676462 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.677769 30092 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.685398 27273 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:45.685117 29951 consensus_queue.cc:260] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.685731 26657 raft_consensus.cc:2393] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 5: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:45.686482 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:45.686787 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:45.687085 26503 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:45.687516 26508 raft_consensus.cc:2368] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7.
I20260709 13:10:45.687996 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:45.688535 26508 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 7. Ops: []
I20260709 13:10:45.688625 26503 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:45.691013 26504 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.691973 26503 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:45.681162 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.695418 26509 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:45.653795 30016 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.653467 30097 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:45.651791 29796 consensus_queue.cc:1059] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:10:45.658577 29901 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.700379 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.660607 30084 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:45.702534 29840 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.706138 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.706811 26657 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:45.702778 30017 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:45.707413 29916 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.707736 30017 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.707878 29916 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.709748 29931 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:45.710772 29736 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:45.711649 30122 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:45.712781 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 878) took 1023 ms. Trace:
I20260709 13:10:45.706557 29840 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.670681 29914 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:45.715408 29840 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.710723 29821 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:45.716670 30046 consensus_meta.cc:287] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.174s	user 0.010s	sys 0.009s
I20260709 13:10:45.701026 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:45.718441 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:55308 (request call id 450) took 1574 ms. Trace:
I20260709 13:10:45.718793 26651 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.720326 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:45.721235 26509 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:45.718794 26504 rpcz_store.cc:276] 0709 13:10:44.117434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.117672 (+   238us) service_pool.cc:224] Handling call
0709 13:10:45.666486 (+1548814us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54000b36d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c920a3d 00007f88318f0cd0 00007f882ae75254 00007f882ae751e2 00007f882ae75111 00007f882ae7508c 00007f882ae74342 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:45.691478 (+ 24992us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738858240}
I20260709 13:10:45.649636 29915 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.726164 26548 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:45.738271 30117 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:10:45.713208 29797 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.658313 29862 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.702179 29951 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:45.713195 27269 rpcz_store.cc:276] 0709 13:10:44.689357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.712940 (+ 23583us) service_pool.cc:224] Handling call
0709 13:10:44.713324 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.752021 (+ 38697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.759220 (+  7199us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.789070 (+ 29850us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.306999 (+517929us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:45.314087 (+  7088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.320033 (+  5946us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.705771 (+385738us) raft_consensus.cc:1685] finished
0709 13:10:45.712553 (+  6782us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.712715 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26601,"raft.queue_time_us":31405,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":468885,"threads_started":1,"wal-append.queue_time_us":567884}
I20260709 13:10:45.704133 30016 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:45.685616 30092 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.659129 29910 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.757229 30092 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.758186 29821 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.762562 29901 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:45.765468 30016 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.767820 29862 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.753993 30097 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:45.774501 30093 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.775110 26510 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:45.748970 30006 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:45.774420 30097 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.786926 26651 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
W20260709 13:10:45.789377 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 355559us
W20260709 13:10:45.789238 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 82166.3us
I20260709 13:10:45.717268 30046 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.792060 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:10:45.795745 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 69641us
I20260709 13:10:45.800974 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:45.806869 26476 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:45.808691 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.811683 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:45.817246 26548 leader_election.cc:400] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7.
I20260709 13:10:45.817689 26548 leader_election.cc:403] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:10:45.808435 29826 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:45.805513 30089 raft_consensus.cc:697] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:45.813205 29753 consensus_meta.cc:287] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.782s	user 0.006s	sys 0.006s
I20260709 13:10:45.798092 30048 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:10:45.810086 30081 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:45.832538 29915 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.832850 30081 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.833288 30081 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:45.795748 30050 consensus_queue.cc:1059] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:10:45.830119 30006 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:45.821084 29826 raft_consensus.cc:697] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:45.806936 29901 consensus_queue.cc:1059] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:10:45.806743 29862 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:10:45.805490 29796 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:10:45.815647 30098 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:45.843991 30098 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.844448 30098 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.809002 30092 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:10:45.847410 30016 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.818903 29959 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.827951 30095 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.853873 29915 raft_consensus.cc:3055] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:45.859247 29915 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:45.859882 29796 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:45.811964 29840 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:10:45.862026 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:45.866189 27269 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:45.870064 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.874450 30106 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:45.874464 26476 leader_election.cc:400] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9.
I20260709 13:10:45.875717 26476 leader_election.cc:403] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:10:45.875171 30094 consensus_queue.cc:1059] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:10:45.877918 30006 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:10:45.884461 30077 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:45.886272 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.887492 30094 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9.
I20260709 13:10:45.888203 30094 raft_consensus.cc:3055] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:45.888260 30017 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:45.890185 26476 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:45.891018 30077 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:45.891391 30077 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.891731 30077 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.893735 29826 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:45.896852 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.897935 30046 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:45.900915 26476 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:45.836460 29753 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.903620 29753 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:45.903821 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 874) took 1215 ms. Trace:
I20260709 13:10:45.888609 30094 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:45.907074 30125 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:45.908030 26476 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:45.905109 30006 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.925966 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:45.922747 26476 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:45.929138 26585 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.930408 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:45.860183 29915 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.931757 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:45.932718 27276 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:45.937605 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 102341us
I20260709 13:10:45.939755 26651 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:45.942997 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.943698 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:45.945194 26579 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:45.950435 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:45.954478 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:45.955420 26582 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.901126 30108 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:45.959648 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:45.960825 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:45.961688 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.967036 26655 raft_consensus.cc:2368] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7.
I20260709 13:10:45.906913 30089 consensus_queue.cc:237] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.978585 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:45.970393 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:45.929982 30093 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:45.926265 30092 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.959869 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:45.981186 26653 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:45.975317 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 154975us
I20260709 13:10:45.981104 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.946981 30046 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.976753 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:45.987784 26579 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:45.975800 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:45.984754 26548 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:45.989579 26505 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:45.991685 26585 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:45.993340 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:45.994778 26585 raft_consensus.cc:2410] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:45.999483 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:45.933277 30057 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:10:46.006450 30135 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:46.006989 30139 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:46.007511 30139 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.993095 30092 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.007912 30139 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.007115 30135 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.949754 30081 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:45.982053 26476 connection.cc:256] RPC call timeout handler was delayed by -1.8302367589999449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 13:10:45.983916 30084 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.987063 29915 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:45.951148 30077 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:45.996703 30083 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.028825 30083 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.017123 26506 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:46.029861 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.030503 26508 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:46.021193 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.023553 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.031298 26504 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.023954 26659 pending_rounds.cc:85] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 4
I20260709 13:10:46.031798 26659 pending_rounds.cc:107] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:46.032099 26659 raft_consensus.cc:2889] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.032500 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 829) took 1258 ms. Trace:
I20260709 13:10:46.032723 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.031617 26509 raft_consensus.cc:2410] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:46.026966 26578 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:46.031571 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.034469 26510 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:46.030597 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:46.022579 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 101971us
I20260709 13:10:46.032853 27274 rpcz_store.cc:276] 0709 13:10:44.774388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.774650 (+   262us) service_pool.cc:224] Handling call
0709 13:10:44.775035 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.819216 (+ 44181us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:45.311203 (+491987us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.904686 (+593483us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.905412 (+   726us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.906091 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.906287 (+   196us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:45.906501 (+   214us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.906697 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.906789 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.032316 (+125527us) raft_consensus.cc:1685] finished
0709 13:10:46.032335 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.032447 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1036014,"prepare.queue_time_us":911735,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":118,"raft.queue_time_us":87590,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":93586,"spinlock_wait_cycles":54351616,"thread_start_us":355411,"threads_started":2,"wal-append.queue_time_us":129976}
I20260709 13:10:45.996081 30046 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:46.038280 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.027066 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.040001 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.047573 26509 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:46.040339 26652 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:10:46.022048 30082 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.050905 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:46.051985 26501 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:46.095714 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.097055 26503 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:10:46.098242 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 113591us
I20260709 13:10:46.100895 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.101791 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.102216 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:46.102487 26580 raft_consensus.cc:2410] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:10:46.102866 26651 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:46.102936 26504 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:45.989452 30094 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.105326 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.106303 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.111434 26655 raft_consensus.cc:2393] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:46.116844 27269 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:46.123309 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:46.123790 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.124583 26652 raft_consensus.cc:2393] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:46.123950 26580 raft_consensus.cc:2376] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9. Re-sending same reply.
I20260709 13:10:46.126976 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.096366 30017 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:46.111050 29862 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:46.145507 26651 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:46.145864 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.148717 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:46.148804 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.149519 26580 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.149932 26576 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:46.148762 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:46.114190 29942 consensus_queue.cc:1059] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:10:46.055101 30084 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.152583 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:46.154887 30108 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.155448 29901 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:46.163350 26653 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:10:46.164374 26652 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:46.162149 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.141299 30017 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.166154 30046 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.167749 30017 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.168892 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.170228 29942 raft_consensus.cc:3055] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:46.178712 29166 raft_consensus.cc:3055] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:46.179117 29166 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:46.179863 29166 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:46.181417 26583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1851) took 1975 ms (client timeout 2009 ms). Trace:
I20260709 13:10:46.182304 26582 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
W20260709 13:10:46.181891 26583 rpcz_store.cc:269] 0709 13:10:44.206399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.210768 (+  4369us) service_pool.cc:224] Handling call
0709 13:10:46.181220 (+1970452us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b540032dcd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:46.181333 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140595456}
W20260709 13:10:46.185521 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.189713 30135 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:46.192229 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:46.187701 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.197549 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.170645 29942 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:46.200232 26583 raft_consensus.cc:2410] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:46.204248 26580 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:46.205637 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:46.207985 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.177712 29901 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:46.210134 26503 raft_consensus.cc:2393] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:46.210718 30083 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.213227 26657 raft_consensus.cc:2410] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:46.209815 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:46.221892 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:46.255280 26585 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.255808 26653 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:46.256614 26576 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:46.240379 29862 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:46.243886 29942 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.243865 26579 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:10:46.194159 30143 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:46.250279 30084 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.251044 29743 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:46.251331 26580 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:46.200809 30095 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7.
I20260709 13:10:46.263139 27276 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:46.264251 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:46.265071 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.272838 26585 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:46.245251 30006 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:46.274605 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.274608 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.275359 26579 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:46.282111 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:46.282984 26579 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:46.285960 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.275359 26503 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:46.296984 29942 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:46.301194 26654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1878) took 2084 ms (client timeout 2043 ms). Trace:
W20260709 13:10:46.301777 26654 rpcz_store.cc:269] 0709 13:10:44.216482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.362378 (+145896us) service_pool.cc:224] Handling call
0709 13:10:46.300882 (+1938504us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54001f6154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:46.301088 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982161280}
I20260709 13:10:46.303570 30098 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:46.307505 30144 log.cc:927] Time spent T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:46.308692 30092 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.310961 29736 raft_consensus.cc:3055] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:46.311208 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.311406 29736 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:46.311777 26510 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.312443 29736 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.313045 26501 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:46.313992 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.314077 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.314200 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:46.314775 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.315444 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.315495 29915 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:46.315873 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.316169 26501 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:46.316576 26508 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:46.316672 29915 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:46.252822 30081 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.317090 29915 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:46.317546 29915 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:46.317687 30087 raft_consensus.cc:3055] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:46.318099 30087 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:46.318866 30087 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.319993 30087 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.323290 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.323419 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.324647 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.325116 26658 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:46.326074 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.325147 29915 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.315495 26509 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:46.328449 30078 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.674s	user 0.005s	sys 0.038s
I20260709 13:10:46.328543 29915 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.329989 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.331106 26582 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:46.330255 29404 raft_consensus.cc:3055] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:46.341984 26655 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:10:46.326239 26653 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:46.333454 26504 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.333915 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:46.336470 26652 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:46.345326 26576 raft_consensus.cc:2368] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7.
I20260709 13:10:46.350982 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:46.356290 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 209268us
I20260709 13:10:46.276484 30143 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:46.359325 26654 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:46.274406 29743 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:46.364114 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:46.338673 30077 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.365154 26510 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:46.365876 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.366533 26503 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:46.348592 29404 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:46.374909 26505 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:46.367926 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 229489us
I20260709 13:10:46.373999 26504 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:10:46.368525 30092 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:46.366560 30143 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.380585 29743 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.371627 29932 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:46.368888 29910 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.380585 29404 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.381678 30097 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:46.378258 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:46.384305 26583 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:46.371991 30098 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.363610 30046 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:46.376194 30106 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:46.403363 29743 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.390308 29901 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.423055 30139 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.424491 30157 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:10:46.381743 30147 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:46.419575 26622 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:46.417518 30097 consensus_queue.cc:1243] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:46.439927 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:46.440794 26654 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:46.413072 29862 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.445190 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:46.434473 29404 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.448037 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.448230 26578 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:46.394146 30092 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.436838 30106 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:46.451776 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.451923 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:46.458604 26580 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:46.452569 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:46.452832 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.454174 26659 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:46.430158 30098 consensus_queue.cc:1059] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:10:46.459044 26576 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.460094 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:46.435428 30147 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.437413 29826 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:46.468746 30130 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:46.469153 30155 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:10:46.483367 30130 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.459589 30139 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.444661 30135 consensus_queue.cc:1059] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:10:46.490819 30135 raft_consensus.cc:3055] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:46.491392 29834 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.491484 30135 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:46.493149 30135 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.485337 30130 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.502496 30135 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.506270 30016 raft_consensus.cc:3055] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:46.506768 30016 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:46.507773 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.507652 30016 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:46.508461 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.509132 30016 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.512151 30143 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:46.514539 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.496232 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 868) took 1971 ms. Trace:
I20260709 13:10:46.515178 27275 rpcz_store.cc:276] 0709 13:10:44.524854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.524973 (+   119us) service_pool.cc:224] Handling call
0709 13:10:46.495981 (+1971008us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54003fe8d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:46.496141 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105889664}
I20260709 13:10:46.518623 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.519279 26505 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:46.519483 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:46.522344 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.523229 30082 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.523908 30082 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:46.524657 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.528239 29166 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.531031 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.525310 26656 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:46.531668 26510 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:46.533491 26501 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:46.536326 26576 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:46.483280 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.462414 30106 raft_consensus.cc:697] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:46.538440 26509 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:46.538524 26508 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:46.539510 26548 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.542155 26502 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:46.551561 26585 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.552788 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.553901 26503 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:46.556231 30147 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.558089 26509 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:46.558344 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.561087 29743 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:46.561661 30150 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:46.561939 29166 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.562208 30150 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.562427 29166 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.563532 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2154) took 1039 ms. Trace:
I20260709 13:10:46.563886 26502 rpcz_store.cc:276] 0709 13:10:45.524058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.541035 (+ 16977us) service_pool.cc:224] Handling call
0709 13:10:45.541340 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.548135 (+1006795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.563317 (+ 15182us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000023d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:46.563477 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301246208}
I20260709 13:10:46.564321 29166 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.564442 30150 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.564847 29166 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.565310 29166 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:46.565773 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 82605.7us
I20260709 13:10:46.566354 29834 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:46.567143 29404 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:46.573873 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.574465 26501 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.571719 26476 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.570791 26585 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:46.579933 29166 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.580962 30125 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.573640 29834 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.570744 29743 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.582839 30125 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.586609 30125 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.582887 30108 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:46.587376 29916 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:46.587673 30108 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:46.588652 30108 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.582904 29834 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.582278 26510 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:46.593472 27243 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.596988 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:46.600071 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:46.600711 26576 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:46.603155 26580 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:46.604419 26622 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:46.605746 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:46.606278 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:46.607609 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 86548.9us
I20260709 13:10:46.529990 30082 consensus_queue.cc:1059] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:10:46.610095 30050 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:46.610610 30106 consensus_queue.cc:237] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:46.615653 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.612856 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.613526 27241 leader_election.cc:400] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7.
I20260709 13:10:46.618489 27241 leader_election.cc:403] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:10:46.594308 30005 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.615711 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.595537 29796 raft_consensus.cc:3055] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:46.620518 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:46.621656 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.623694 29117 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:46.624191 29117 raft_consensus.cc:697] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:46.624119 26476 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:46.616492 26473 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:46.623721 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.530508 30130 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.625962 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.583330 29743 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.626288 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:46.613713 29282 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:46.633615 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:46.629197 26476 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:46.613837 29914 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:46.635891 29166 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:46.636619 27276 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:46.638273 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:46.614457 29404 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.639011 27269 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.638331 29166 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:46.637140 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:46.637378 27274 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:46.614822 29826 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:46.639793 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:46.640076 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:46.640384 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 46990.5us
I20260709 13:10:46.640700 26502 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:46.641317 27243 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.643440 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:46.644207 27275 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:46.630623 29117 consensus_queue.cc:237] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.623078 29796 raft_consensus.cc:740] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:46.624332 29993 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:46.651293 27243 leader_election.cc:400] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7.
I20260709 13:10:46.646530 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:46.652027 27274 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:46.624665 30125 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:46.647178 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:46.647228 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:46.646421 26650 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:10:46.643313 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:46.649991 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:46.659052 27275 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:46.631618 30050 raft_consensus.cc:697] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:46.613986 30111 consensus_queue.cc:1059] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:10:46.661814 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 48425us
I20260709 13:10:46.641522 30082 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:46.688436 30082 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.688863 30082 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.690986 29743 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.665835 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.660251 29166 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.676913 27269 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:46.651521 29826 raft_consensus.cc:697] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:46.694628 29826 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.696362 30070 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:46.696836 30070 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:46.697033 30162 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:10:46.697196 30070 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.665477 30076 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.698503 30163 consensus_queue.cc:1059] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:10:46.698864 30076 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.699638 30163 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.700346 30163 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:46.702252 29910 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:46.702911 29910 consensus_queue.cc:1243] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:46.703359 30076 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.679534 29404 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:46.704317 29404 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:46.705229 29404 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.641706 29282 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.626771 30005 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.649214 30057 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:46.683954 29796 consensus_queue.cc:260] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:46.685418 29834 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.685731 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:10:46.743595 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 57947.8us
I20260709 13:10:46.744130 29166 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:46.686265 30147 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:46.686477 30143 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.687855 30130 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.702054 30050 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.674818 30071 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7.
I20260709 13:10:46.660598 29942 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:10:46.676365 27241 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:46.647622 29901 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:46.744961 29166 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:46.745437 26548 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.664490 29712 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:46.783432 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 836) took 1400 ms. Trace:
I20260709 13:10:46.784420 27278 rpcz_store.cc:276] 0709 13:10:45.382898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.383023 (+   125us) service_pool.cc:224] Handling call
0709 13:10:46.782840 (+1399817us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5400668d54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:46.783060 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28146560}
I20260709 13:10:46.786592 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39926 (request call id 9) took 1127 ms. Trace:
W20260709 13:10:46.754150 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 137711us
I20260709 13:10:46.701197 30163 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:10:46.716322 29743 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:46.773092 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 96791.4us
I20260709 13:10:46.787441 26584 rpcz_store.cc:276] 0709 13:10:45.666846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.672370 (+  5524us) service_pool.cc:224] Handling call
0709 13:10:46.786252 (+1113882us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54000d8754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92f735 00007f88318efd29 00007f882ae6e1d4 00007f882ae6e162 00007f882ae6e091 00007f882ae6e00c 00007f882ae6d2c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:46.786473 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085397760}
I20260709 13:10:46.775341 29166 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:46.781422 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 144113us
I20260709 13:10:46.781330 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.796895 26507 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:46.797242 26473 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:46.797376 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2148) took 1286 ms. Trace:
I20260709 13:10:46.797883 26507 rpcz_store.cc:276] 0709 13:10:45.522057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.525669 (+  3612us) service_pool.cc:224] Handling call
0709 13:10:46.781220 (+1255551us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b5800010598. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804f8c 00007f8829804ef6 0000000000375939 00007f88318781e0 00007f88319410c4 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:10:46.797283 (+ 16063us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14974336}
I20260709 13:10:46.798731 26473 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:46.778851 29994 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:46.788968 26548 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:46.750972 30147 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.802337 26548 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:46.803629 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:46.792662 27241 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:46.799584 26476 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.806556 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:46.808509 27241 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:46.664517 29993 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.812345 26652 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:46.761775 30057 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:46.824574 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.827386 26584 pending_rounds.cc:85] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 6
I20260709 13:10:46.827845 26584 pending_rounds.cc:107] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:10:46.828249 26584 raft_consensus.cc:2889] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.824730 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:46.820430 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.845254 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:46.849849 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 30ffd86793fb4eab863861f1047dec1e: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:46.790975 30163 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:46.850584 29282 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.850714 30163 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:46.851687 30163 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.852880 30163 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.853358 26510 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:46.789649 30143 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:46.854224 30143 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:46.854758 30143 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.855150 30005 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.817121 30153 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:46.858932 30168 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:45.911823 27277 rpcz_store.cc:276] 0709 13:10:44.687934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.707066 (+ 19132us) service_pool.cc:224] Handling call
0709 13:10:44.709059 (+  1993us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:44.743517 (+ 34458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.743547 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:44.751592 (+  8045us) log.cc:844] Serialized 78 byte log entry
0709 13:10:45.043089 (+291497us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:45.316442 (+273353us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.902529 (+586087us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b18003b56c0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f88303213c7 00007f882c9339a7 00007f882c9430bf 00007f882c943038
0709 13:10:45.902820 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.903130 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.903229 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.903387 (+   158us) raft_consensus.cc:1685] finished
0709 13:10:45.903407 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.903609 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":491856,"prepare.queue_time_us":866147,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":183622,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":45785,"spinlock_wait_cycles":7170432,"thread_start_us":644070,"threads_started":3,"wal-append.queue_time_us":419214}
I20260709 13:10:46.849669 30111 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:46.870832 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 50477.5us
I20260709 13:10:46.879957 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:46.880740 26501 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:46.789956 29712 raft_consensus.cc:697] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:46.824280 30071 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:46.834745 30081 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:46.806258 30147 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.882989 26507 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:46.884291 27276 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:46.898959 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.906075 29117 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:46.791667 29834 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.824347 30098 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:46.894044 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:46.791987 29743 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.896589 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.837692 29672 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:46.845705 29166 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.909619 29117 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:46.890270 29901 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:46.892859 29712 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.921545 29117 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:46.925944 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 119423us
I20260709 13:10:46.929239 26473 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:46.936535 29166 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.919361 29797 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:46.947463 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 67618.7us
I20260709 13:10:46.948470 26548 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.949390 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:46.922427 29901 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.913746 30125 raft_consensus.cc:697] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:46.921998 29672 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:46.958778 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:46.940325 29834 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:46.953684 30057 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.006538 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.006827 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:47.007396 26505 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:47.008153 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:47.010049 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:46.962172 29901 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.009389 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:47.011788 26510 raft_consensus.cc:2368] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9.
I20260709 13:10:46.919701 29743 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.016229 29743 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:46.964969 30153 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:47.017679 30153 raft_consensus.cc:697] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:47.018920 30153 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.962962 30098 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:47.022646 30098 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:47.023205 27272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 880) took 1360 ms. Trace:
I20260709 13:10:47.023825 30098 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.031350 30070 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:46.976348 30092 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:46.947192 29797 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.034955 29797 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.036113 30094 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:46.987027 29993 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:46.992856 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.038847 30082 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.040066 26502 raft_consensus.cc:2393] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:47.043988 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:47.048415 26510 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:47.050554 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 91905.4us
I20260709 13:10:47.071918 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:47.073751 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.075357 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.075961 26501 raft_consensus.cc:2376] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10. Re-sending same reply.
I20260709 13:10:47.059309 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 745) took 1127 ms. Trace:
I20260709 13:10:47.078125 26657 rpcz_store.cc:276] 0709 13:10:45.931857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.952638 (+ 20781us) service_pool.cc:224] Handling call
0709 13:10:47.059105 (+1106467us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54001027d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:47.059252 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537037696}
I20260709 13:10:47.057318 29117 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:47.097656 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.100189 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:47.100868 26583 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:47.100932 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:47.101488 26501 raft_consensus.cc:2376] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5. Re-sending same reply.
W20260709 13:10:47.103183 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.104187 29117 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:47.111383 26504 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:47.112666 27276 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:47.120169 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.121133 26509 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:47.062215 29797 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.124234 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:47.125063 26577 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.126935 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.127766 26501 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:47.104115 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:47.131834 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:47.132925 26507 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:47.135205 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.129810 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:47.136507 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:47.137241 26503 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:47.138266 26501 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:47.058068 30076 raft_consensus.cc:3055] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:47.140414 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:47.141698 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 342693us
I20260709 13:10:47.050848 30083 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:47.041728 30070 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.143709 26502 raft_consensus.cc:1217] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-10.6]   Dedup: 3.3->[6.4-10.6]
I20260709 13:10:47.145238 26502 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: [3.3-10.6]
W20260709 13:10:47.145260 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet e29f1967e75645cbb7842e14e0404518: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:47.143546 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:47.057444 30082 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.049942 30164 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:47.147500 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:47.023845 27272 rpcz_store.cc:276] 0709 13:10:45.662363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.683562 (+ 21199us) service_pool.cc:224] Handling call
0709 13:10:46.783098 (+1099536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.783326 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:46.784055 (+   729us) log.cc:844] Serialized 14 byte log entry
0709 13:10:46.906074 (+122019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.906139 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:46.906187 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.906252 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.022012 (+115760us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b18000dfae0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882980a2a6 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4
0709 13:10:47.022943 (+   931us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400668d50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:47.023118 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1427,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":7407,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6661,"spinlock_wait_cycles":2646465920,"thread_start_us":114048,"threads_started":1,"wal-append.queue_time_us":183834}
I20260709 13:10:47.148793 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:47.150290 26654 raft_consensus.cc:2368] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9.
I20260709 13:10:47.147117 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:47.045892 30175 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:47.156018 30175 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.157927 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:47.158908 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:47.159538 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:47.160210 26650 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:47.121778 29743 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.154086 29117 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:47.171758 29117 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.174224 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:47.135736 30050 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:47.177615 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:47.178391 27276 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:47.179955 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:47.052438 30143 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.180294 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:47.181171 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:47.156502 30175 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.153162 26504 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.144892 30083 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:47.191170 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.184966 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:47.186057 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:47.194010 27274 raft_consensus.cc:2368] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8.
I20260709 13:10:47.142799 30076 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:47.126027 30111 consensus_queue.cc:1059] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:10:47.195098 27276 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:47.197693 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:47.165016 30071 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.161742 30017 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:47.203927 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:47.208447 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 61412.4us
I20260709 13:10:47.170043 30092 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:47.045574 30125 consensus_queue.cc:237] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.267491 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:47.268183 26583 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:47.268893 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:47.205902 29117 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.105157 29672 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.211871 26548 leader_election.cc:400] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8.
I20260709 13:10:47.271636 26548 leader_election.cc:403] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:47.213954 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.215188 26622 leader_election.cc:400] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9.
I20260709 13:10:47.272835 26622 leader_election.cc:403] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:10:47.218978 26582 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:47.216542 26507 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:47.220198 26504 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:47.218986 27274 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 8. Ops: []
I20260709 13:10:47.178857 30164 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.225371 30092 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:47.226084 29404 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.227174 29736 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:47.235495 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:47.289139 26653 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:47.236562 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:47.239162 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.243322 26474 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:47.244823 30048 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:47.246853 29797 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:47.253756 29910 raft_consensus.cc:3055] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:47.299172 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 55937.8us
I20260709 13:10:47.299685 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:47.207799 30050 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:47.264060 26506 raft_consensus.cc:2410] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:47.272650 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:47.220124 27243 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:47.292253 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 80517.2us
I20260709 13:10:47.300351 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:47.303805 26579 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:47.304313 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.213433 30106 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:47.307016 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 87020.6us
I20260709 13:10:47.307163 26582 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:47.305845 26654 raft_consensus.cc:2393] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 6: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:47.296150 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.300726 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:47.309144 26583 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:47.302132 26580 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:47.197489 30083 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:47.183100 29743 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:47.306454 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 91891us
I20260709 13:10:47.318078 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:47.315886 26474 leader_election.cc:400] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9.
I20260709 13:10:47.315968 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:47.321848 26658 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.324528 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:47.224357 26651 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:47.332365 26579 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:47.316939 26507 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:47.289325 30092 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:47.305224 30017 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9.
I20260709 13:10:47.321017 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:47.335419 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:47.337791 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:47.339177 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:47.340052 26580 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:47.299330 29910 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:47.314751 30082 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:47.213773 30071 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.316476 26577 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
W20260709 13:10:47.371119 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50182.6us
I20260709 13:10:47.305456 30179 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:47.317591 30110 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:47.379310 26581 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:47.336217 29993 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:47.399884 29993 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.400827 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.401139 29951 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8.
I20260709 13:10:47.363384 30168 raft_consensus.cc:697] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:47.402055 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.385419 29840 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:10:47.402484 30168 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.403167 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:47.361029 29797 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:47.380479 30111 consensus_queue.cc:1059] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:10:47.406287 30111 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:47.406633 30111 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:47.407523 30111 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.408795 30111 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.398617 30179 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.410034 30179 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:47.410111 26650 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:47.410989 30071 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:47.412783 29743 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.399230 30110 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:47.413674 30082 raft_consensus.cc:697] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:47.413851 30110 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:47.414127 26476 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:47.415032 26476 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:47.409739 30050 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.416567 26582 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 8. Ops: []
I20260709 13:10:47.417599 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:47.421931 26579 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:47.423028 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:47.299140 30048 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.418592 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:47.419051 27271 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:47.417814 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:47.421025 26583 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:47.441213 26578 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:10:47.333640 29932 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:10:47.359391 30087 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:10:47.452178 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:47.387843 30106 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:47.395102 30130 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:47.578884 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.567607 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:47.547055 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:47.583243 26580 raft_consensus.cc:2376] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7. Re-sending same reply.
I20260709 13:10:47.490295 26656 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:47.487927 29117 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.584102 26658 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:47.587037 29117 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.586134 26578 raft_consensus.cc:2393] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:47.509181 27241 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 2.845s (SENT) [suppressed 17 similar messages]
W20260709 13:10:47.607885 29712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.017s
I20260709 13:10:47.565026 30084 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.451956 30071 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:47.614209 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:47.618101 26476 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:47.618135 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 108999us
W20260709 13:10:47.570539 30185 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 13:10:47.563206 29753 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:47.435701 30163 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:47.535224 30081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.014s	sys 0.040s
W20260709 13:10:47.635057 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.450906 30181 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:47.610594 26548 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:47.609694 30139 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.564675 30005 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:47.462215 29951 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.610453 29901 consensus_meta.cc:287] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.000s
I20260709 13:10:47.613735 30154 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.458949 29993 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:47.618232 29712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.009s	sys 0.017s
I20260709 13:10:47.637862 29117 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.613206 30098 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:47.414682 30082 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:47.648804 30081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.017s	sys 0.040s
I20260709 13:10:47.639164 30157 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.485901 30092 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.650681 30071 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:47.685403 29117 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:47.713495 29117 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.714386 29117 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:47.461620 29910 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.616243 29862 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:10:47.694296 30098 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.695763 30076 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.659313 29743 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:47.662490 30139 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.655902 30180 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.656334 30005 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:47.474301 30150 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:47.685642 30164 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.711755 30157 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.644311 30084 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.707849 30048 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:47.702646 30177 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.720s	user 0.003s	sys 0.000s
I20260709 13:10:47.703821 30081 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:47.678858 29951 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.683086 29901 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:47.784225 30190 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:10:47.757802 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 420091us
I20260709 13:10:47.658622 29753 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:47.756906 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 386556us
I20260709 13:10:47.179479 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:47.782289 30192 log.cc:927] Time spent T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:10:47.783501 30186 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:47.784317 30157 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.784400 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.808525 26503 raft_consensus.cc:2410] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 13:10:47.785162 30189 log.cc:927] Time spent T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:47.729612 29743 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.755786 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1880) took 1683 ms. Trace:
I20260709 13:10:47.813351 26585 rpcz_store.cc:276] 0709 13:10:46.071890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.281759 (+209869us) service_pool.cc:224] Handling call
0709 13:10:47.754700 (+1472941us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54001c3ed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:47.755723 (+  1023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617505152}
I20260709 13:10:47.793913 30108 raft_consensus.cc:3055] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:47.828713 29117 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.751132 30076 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:47.803072 30048 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:47.803267 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.774883 29910 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.866806 29117 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.799610 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:47.867969 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.863584 26505 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:47.810542 30191 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.879949 30191 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:47.881805 29862 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.882397 30191 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.882589 29862 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:47.887135 30198 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:47.888147 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:47.888713 30193 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:10:47.892573 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.893319 29901 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.823379 30108 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:47.894685 30108 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.895761 30108 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.755350 30150 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:47.877305 30185 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:10:47.878723 30094 consensus_meta.cc:287] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.842s	user 0.014s	sys 0.001s
I20260709 13:10:47.878913 29753 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:47.819016 29743 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.879276 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:47.898437 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 98959us
W20260709 13:10:47.899291 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 67153.7us
I20260709 13:10:47.901553 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:47.790072 30180 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.922739 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:47.922101 26501 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.885293 29862 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:47.817476 30071 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.921584 30188 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.923058 30201 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:47.940956 30154 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:47.941119 30083 consensus_meta.cc:287] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.003s
I20260709 13:10:47.941596 30083 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:47.942210 30139 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.942667 30150 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:47.943589 30083 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:47.943876 30084 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:47.944442 26577 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:47.923593 26505 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:47.951783 26625 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:47.906477 30087 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:47.939378 30175 consensus_meta.cc:287] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.000s
I20260709 13:10:47.967751 26510 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:47.947219 29901 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.920926 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 302900us
W20260709 13:10:47.986294 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 342207us
I20260709 13:10:47.982476 26625 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:47.982370 29404 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.688s	user 0.012s	sys 0.000s
I20260709 13:10:48.007022 26501 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:10:47.875932 30005 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.010484 26503 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:47.932761 30188 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:47.981493 30110 consensus_meta.cc:287] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.000s
W20260709 13:10:47.996376 30197 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.210s	user 0.001s	sys 0.001s
W20260709 13:10:48.017372 30179 consensus_meta.cc:287] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.001s
I20260709 13:10:47.946596 30081 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.022437 30098 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:48.022962 29951 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:48.026860 30147 consensus_meta.cc:287] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.104s	user 0.014s	sys 0.000s
I20260709 13:10:47.996220 29901 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.033665 30092 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:48.040177 30005 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:48.075541 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 73217.8us
I20260709 13:10:48.073782 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:47.995772 30201 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:47.982244 30163 raft_consensus.cc:697] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:47.981124 30175 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.092784 26548 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:48.055863 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:48.094298 26501 raft_consensus.cc:2393] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:48.082278 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.060845 29736 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:48.076411 26625 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:48.060811 30181 raft_consensus.cc:697] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:48.099874 26625 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:48.104266 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:48.106014 26501 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:48.107750 26625 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:48.112612 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2668) took 1011 ms. Trace:
I20260709 13:10:48.112679 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 757) took 1500 ms. Trace:
I20260709 13:10:48.113060 26507 rpcz_store.cc:276] 0709 13:10:47.101452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.356464 (+255012us) service_pool.cc:224] Handling call
0709 13:10:47.385827 (+ 29363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.386105 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:47.874201 (+488096us) log.cc:844] Serialized 14 byte log entry
0709 13:10:48.112230 (+238029us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.112281 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:48.112342 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.112412 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.112546 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18157,"prepare.queue_time_us":611768,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":6842,"thread_start_us":704333,"threads_started":2}
I20260709 13:10:48.090799 29914 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:10:48.115955 26507 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:48.083590 30201 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:48.116580 26509 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:10:48.117199 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.114374 26656 rpcz_store.cc:276] 0709 13:10:46.611944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.612501 (+   557us) service_pool.cc:224] Handling call
0709 13:10:48.112526 (+1500025us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b540039b7d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:48.112624 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005730560}
I20260709 13:10:48.113519 26474 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:48.125357 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:48.127125 26507 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:48.062494 30110 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.089396 30212 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:48.095696 30092 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:48.101147 29862 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:48.077137 30147 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.110219 30046 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:48.072984 30179 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.116999 29826 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:48.150329 26658 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:48.119297 29932 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:48.131366 30167 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:48.154073 26507 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:48.130630 30201 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.153085 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.133846 30213 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.165104 26579 raft_consensus.cc:2393] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:48.165887 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:48.169529 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.139392 30084 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:48.136297 29796 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.166486 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.167760 26655 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:48.173051 26653 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:48.150854 29826 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.140954 29862 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.170166 26656 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:10:48.172086 26508 raft_consensus.cc:2393] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:48.168479 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:48.178635 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.179483 26650 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:48.179268 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.178632 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:48.179560 26651 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:48.175935 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.181669 26501 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:48.180406 26654 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:48.182868 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:48.145021 30092 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:48.183867 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.184417 26654 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:48.185206 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:48.186080 26654 raft_consensus.cc:2393] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:48.187363 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.188740 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:48.189271 26651 raft_consensus.cc:2376] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5. Re-sending same reply.
I20260709 13:10:48.189630 26507 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:48.173538 30212 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:48.177266 29932 raft_consensus.cc:697] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:48.190944 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.139907 30163 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.203547 30143 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:48.178200 29862 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:48.206133 29901 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:48.208344 30148 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 1.184s	user 0.004s	sys 0.000s
I20260709 13:10:48.179931 29826 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:48.194325 30208 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:10:48.195035 30110 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:48.195608 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.217665 26652 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:48.184671 30046 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.195179 29932 consensus_queue.cc:237] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:48.196267 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.219089 26654 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:48.196552 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.220232 26650 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:48.196807 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:48.193317 30125 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:48.188459 30084 raft_consensus.cc:697] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:48.210271 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.237607 27276 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:48.230283 30092 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:48.231892 30179 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:48.258348 26654 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:48.264882 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.172786 30213 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:48.253355 26576 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:48.265748 26654 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:48.266875 26651 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:48.270181 26651 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:48.272353 26652 raft_consensus.cc:3055] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:48.272876 26652 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:48.268268 26650 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:48.228186 29743 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:48.222486 30125 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.274680 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:48.279825 26507 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:48.280572 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:48.281594 26650 raft_consensus.cc:2393] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:48.282565 30207 log.cc:927] Time spent T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:10:48.283536 30216 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:10:48.283885 29826 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.175835 30181 consensus_queue.cc:237] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:48.273890 26652 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:48.289072 26507 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:48.289340 26652 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:48.271191 26651 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:48.288466 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 75422.9us
I20260709 13:10:48.290231 26651 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:48.294579 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.296700 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:48.299631 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:48.300266 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:48.300770 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:48.301362 26504 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:48.302706 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:48.303213 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:48.303696 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:48.303767 26507 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:48.306155 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:48.306311 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:48.306704 26585 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.237534 30046 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.309103 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:48.308198 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:48.308471 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:48.287451 30125 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.310873 26578 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:48.318039 26651 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:48.318379 26651 pending_rounds.cc:85] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 5
I20260709 13:10:48.311512 26580 raft_consensus.cc:2410] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:48.311240 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:48.319021 26650 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:48.311371 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:48.320286 26502 raft_consensus.cc:2410] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:48.310868 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:48.318678 26651 pending_rounds.cc:107] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:48.314456 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:48.322520 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:48.322901 27276 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:48.323252 27270 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:48.323361 26504 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:48.321614 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:48.324040 26651 raft_consensus.cc:2889] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:48.325151 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.326406 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:48.327037 26507 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:48.327527 26652 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:10:48.328639 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:48.330235 26652 pending_rounds.cc:85] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 5
I20260709 13:10:48.328648 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:48.331393 26584 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:48.330583 26652 pending_rounds.cc:107] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:10:48.331936 26652 raft_consensus.cc:2889] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:48.332177 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:48.332700 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.333616 26585 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:48.334671 26581 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:48.336412 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:48.336890 26580 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:10:48.338203 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.338718 26582 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:48.339934 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:48.302029 30147 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:48.341812 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:48.306360 30175 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:48.345256 27240 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:48.352802 26650 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:48.358229 26502 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:48.358385 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.359694 26507 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:10:48.363746 27240 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:48.367233 27240 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:48.331737 30092 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:48.337862 29826 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:48.343030 29672 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.371529 29282 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:48.365890 30070 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:48.402159 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.403908 26650 raft_consensus.cc:2410] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:48.376926 30011 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:48.411079 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.395147 30214 log.cc:927] Time spent T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:10:48.423584 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 453) took 1351 ms. Trace:
I20260709 13:10:48.322036 30084 consensus_queue.cc:237] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:48.392387 30076 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.374235 30215 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:10:48.397357 30092 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:48.336006 30212 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:48.469584 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:48.488521 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.644408 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 181630us
W20260709 13:10:48.468057 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.656985 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 187524us
W20260709 13:10:48.487218 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.490089 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2669) took 1388 ms. Trace:
I20260709 13:10:48.425211 26506 rpcz_store.cc:276] 0709 13:10:47.072535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.073486 (+   951us) service_pool.cc:224] Handling call
0709 13:10:48.412649 (+1339163us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540008cd54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:48.423503 (+ 10854us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435514240}
I20260709 13:10:48.476955 26580 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:10:48.396823 30110 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:48.658682 26476 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:48.479847 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2741) took 1173 ms. Trace:
I20260709 13:10:48.479336 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:48.488677 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.658478 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.599059 26578 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:48.655596 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.654048 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:48.659283 26580 pending_rounds.cc:85] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 6
I20260709 13:10:48.658777 26503 rpcz_store.cc:276] 0709 13:10:47.101779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.938215 (+836436us) service_pool.cc:224] Handling call
0709 13:10:48.010303 (+ 72088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.014922 (+  4619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.485406 (+470484us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b540027e7d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:48.490010 (+  4604us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164946176}
W20260709 13:10:48.719089 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.620288 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.720127 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:48.720973 26578 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:48.808137 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 890) took 1709 ms. Trace:
I20260709 13:10:48.783887 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 457) took 1660 ms. Trace:
I20260709 13:10:48.774258 26658 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:48.813987 26474 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:48.787457 26653 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:48.785264 26655 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:48.782378 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:48.724876 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 66284.3us
I20260709 13:10:48.863332 26580 pending_rounds.cc:107] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:10:48.863905 26580 raft_consensus.cc:2889] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:48.458696 30219 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 13:10:48.457253 30224 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:48.779938 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:48.858456 26651 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:48.855347 26576 rpcz_store.cc:276] 0709 13:10:47.306219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.306373 (+   154us) service_pool.cc:224] Handling call
0709 13:10:48.479648 (+1173275us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54003732d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:48.479781 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057752320}
I20260709 13:10:48.855006 26501 rpcz_store.cc:276] 0709 13:10:47.123708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.114373 (+990665us) service_pool.cc:224] Handling call
0709 13:10:48.114657 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.182045 (+ 67388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.783553 (+601508us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b5400359154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:48.783804 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153641216}
I20260709 13:10:48.722033 26578 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:48.459510 30111 consensus_meta.cc:287] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.050s	user 0.014s	sys 0.000s
I20260709 13:10:48.857882 26585 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:10:48.817457 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.441423 30147 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.887497 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:48.916956 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:48.456729 30222 log.cc:927] Time spent T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:10:48.427779 30081 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:48.908221 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 541047us
I20260709 13:10:48.720242 30143 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.909391 26578 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:48.911412 26585 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:48.951190 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:48.952214 26585 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:48.877779 29862 consensus_meta.cc:287] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.000s
I20260709 13:10:48.666051 29796 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.912650 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:48.913323 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:48.800572 30206 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.778s	user 0.000s	sys 0.003s
W20260709 13:10:48.932060 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 118200us
I20260709 13:10:48.969539 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:48.579669 29901 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:48.470059 30180 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:48.427040 29743 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:48.775851 30154 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.726490 30210 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:48.802981 30125 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:49.015261 26585 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:48.952759 30111 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:48.719847 30171 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:48.774488 30011 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:48.948760 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:48.882561 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:49.018831 26650 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.458416 30213 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:48.724118 30164 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.804773 30046 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:48.802443 29951 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.855856 30110 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.799602 30188 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:48.793800 29910 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:48.861809 30215 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.861935 30070 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:48.951001 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:48.971616 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.972735 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:48.620321 30201 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:48.955837 29932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.016s
W20260709 13:10:48.990167 26610 heartbeater.cc:646] Failed to heartbeat to 127.24.204.254:32835 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.24.204.254:32835 timed out after 15.000s (SENT)
I20260709 13:10:48.719540 30076 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:48.994773 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.000003 26576 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:49.006266 26474 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:49.056737 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50565.3us
I20260709 13:10:49.007913 30180 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:48.855034 27275 rpcz_store.cc:276] 0709 13:10:47.099175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.099391 (+   216us) service_pool.cc:224] Handling call
0709 13:10:47.129831 (+ 30440us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:47.157142 (+ 27311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.157176 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:47.722583 (+565407us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b2c00012928. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882b222a11 00007f882b232372 00007f882c964a01 00007f882c92943a 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2
0709 13:10:47.723243 (+   660us) log.cc:844] Serialized 78 byte log entry
0709 13:10:48.077789 (+354546us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:48.094655 (+ 16866us) log.cc:844] Serialized 14 byte log entry
0709 13:10:48.796761 (+702106us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b1800361420. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f88303213c7 00007f882c9339a7 00007f882c9430bf 00007f882c943038
0709 13:10:48.797002 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 13:10:48.797247 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.797359 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:48.797416 (+    57us) raft_consensus.cc:1685] finished
0709 13:10:48.797435 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.808052 (+ 10617us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":680235,"prepare.queue_time_us":728457,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":3668,"raft.queue_time_us":26561,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5604,"spinlock_wait_cycles":34192768,"thread_start_us":354063,"threads_started":1,"wal-append.queue_time_us":423266}
I20260709 13:10:48.940588 29914 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:48.996830 29901 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.009209 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:48.965090 30094 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.940923 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:48.942926 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:48.974649 29796 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.019750 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:49.032289 26502 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:49.005235 30168 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:48.941143 30147 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:49.017643 29672 consensus_meta.cc:287] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.003s
I20260709 13:10:48.963488 30081 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:48.970768 30143 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:48.996090 30167 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:10:48.971099 29862 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:49.021903 30171 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:49.052789 27270 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
W20260709 13:10:49.057337 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.159324 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 224858us
I20260709 13:10:48.949323 30202 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:49.079219 30098 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:49.024153 30111 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.079909 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:49.174842 26659 raft_consensus.cc:2410] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:49.132110 29672 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:49.055128 29932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.008s	sys 0.017s
I20260709 13:10:49.082805 29117 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.182123 29117 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:49.182770 26510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 471) took 1782 ms (client timeout 2211 ms). Trace:
I20260709 13:10:48.942078 29282 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.014878 30154 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:49.106645 26656 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:49.108879 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 89205.1us
I20260709 13:10:49.203573 26548 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:49.098912 26650 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
W20260709 13:10:49.110273 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 169460us
W20260709 13:10:49.206233 26579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 665) took 1788 ms (client timeout 1817 ms). Trace:
I20260709 13:10:49.038378 30110 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:49.097533 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 154690us
I20260709 13:10:49.221194 26578 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:10:49.125550 26576 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:49.127393 27276 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:49.129181 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:49.223133 26580 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.169422 30171 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.224782 26548 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:49.136447 26549 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:49.033509 30164 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.027586 30011 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.083550 30092 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:49.091502 30188 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:49.038996 29951 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:49.126271 30168 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.114223 29914 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:49.129767 30234 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:49.051055 29910 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.055299 30179 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.056830 30215 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:49.084645 30070 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.177356 30213 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:49.178342 30111 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:49.183197 26510 rpcz_store.cc:269] 0709 13:10:47.400435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.892262 (+491827us) service_pool.cc:224] Handling call
0709 13:10:49.182608 (+1290346us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b54002fba54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:49.182715 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170981632}
I20260709 13:10:49.147693 30046 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:49.197953 26508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 466) took 1799 ms (client timeout 1602 ms). Trace:
I20260709 13:10:49.200475 26505 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:49.206337 26583 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:49.086082 26651 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:49.216292 26577 raft_consensus.cc:2368] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7.
W20260709 13:10:49.206724 26579 rpcz_store.cc:269] 0709 13:10:47.418246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.422730 (+  4484us) service_pool.cc:224] Handling call
0709 13:10:49.206019 (+1783289us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b5400076cd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:49.206178 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704454016}
I20260709 13:10:49.218681 26581 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:49.227775 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1990) took 1049 ms. Trace:
I20260709 13:10:49.227888 27240 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:49.175755 29743 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.175014 30241 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:49.201817 30202 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:49.236214 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2663) took 2155 ms. Trace:
I20260709 13:10:49.237205 29117 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.230976 30243 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:49.257620 26576 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:49.260332 30154 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.236325 30098 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:49.275710 30125 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.280893 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:49.277504 26508 rpcz_store.cc:269] 0709 13:10:47.398779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.402917 (+  4138us) service_pool.cc:224] Handling call
0709 13:10:49.197711 (+1794794us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54001748d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:49.197867 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765567232}
I20260709 13:10:49.221948 30005 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:10:49.238328 30188 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.287196 26580 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:49.279979 26657 rpcz_store.cc:276] 0709 13:10:48.177996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.178124 (+   128us) service_pool.cc:224] Handling call
0709 13:10:48.186856 (+  8732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.187005 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:48.309697 (+122692us) log.cc:844] Serialized 14 byte log entry
0709 13:10:48.556279 (+246582us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b18000a7740. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:48.971589 (+415310us) spinlock_profiling.cc:243] Waited 920 us on lock 0x7b18000a7740. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f88303213c7 00007f882c9339a7 00007f882c9430bf 00007f882c943038
0709 13:10:49.014334 (+ 42745us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.227220 (+212886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.227286 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.227333 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.227405 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.227722 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":434276,"prepare.queue_time_us":812635,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":9311,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":21368,"spinlock_wait_cycles":4935424,"thread_start_us":389936,"threads_started":3,"wal-append.queue_time_us":708021}
W20260709 13:10:49.273033 30237 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:10:49.289238 30017 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:49.216500 29282 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:49.281414 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 307146us
I20260709 13:10:49.396908 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:49.397384 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.283085 30234 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:49.294523 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 66710.5us
I20260709 13:10:49.231673 29932 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:10:49.295428 26506 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:49.299701 26581 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:49.262569 30168 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:49.276193 30232 log.cc:927] Time spent T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:10:49.365150 26509 rpcz_store.cc:276] 0709 13:10:47.079811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.140589 (+ 60778us) service_pool.cc:224] Handling call
0709 13:10:47.163891 (+ 23302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.131422 (+967531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.234967 (+1103545us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b540027e2d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:49.235153 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190253952}
I20260709 13:10:49.226389 30210 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:49.385175 26650 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:49.288872 29404 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:49.400928 27240 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:49.403343 26581 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:49.275933 30179 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.422235 27241 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:49.379900 30098 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:49.443683 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:49.389847 30188 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:49.450884 26506 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:49.364431 30243 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.421972 27272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 895) took 2229 ms. Trace:
I20260709 13:10:49.285876 30092 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:10:49.369185 30246 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:49.367755 30241 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:49.447129 30111 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:49.447337 26508 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:49.448246 26510 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:49.449008 30084 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.455386 29796 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:49.460399 30201 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:49.453795 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:49.454130 30098 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.443720 30211 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.456072 27272 rpcz_store.cc:276] 0709 13:10:47.164794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.165022 (+   228us) service_pool.cc:224] Handling call
0709 13:10:47.190554 (+ 25532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.190872 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:47.291620 (+100748us) log.cc:844] Serialized 14 byte log entry
0709 13:10:48.489214 (+1197594us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b180038a100. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c923a 00007f882c933a2a
0709 13:10:49.393339 (+904125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.393398 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:49.393447 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.393512 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.393634 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":96848,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":148137,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":15441,"spinlock_wait_cycles":4383488,"thread_start_us":903835,"threads_started":2,"wal-append.queue_time_us":1861990}
I20260709 13:10:49.298115 29743 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.282420 30213 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.484925 29862 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.463974 29910 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:10:49.466495 30011 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.467669 26509 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:49.468660 26650 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:49.471805 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1909) took 1149 ms. Trace:
I20260709 13:10:49.491950 30143 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.475471 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1899) took 1169 ms. Trace:
I20260709 13:10:49.479336 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:49.479687 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:49.480731 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 260377us
I20260709 13:10:49.478091 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:49.559109 26581 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:49.554812 26577 rpcz_store.cc:276] 0709 13:10:48.305500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.305644 (+   144us) service_pool.cc:224] Handling call
0709 13:10:49.475187 (+1169543us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54000d8754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:49.475385 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051878272}
I20260709 13:10:49.453822 30238 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:49.448720 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47900.5us
I20260709 13:10:49.450248 30076 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:49.451118 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 314741us
I20260709 13:10:49.425763 30005 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:49.459782 30243 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:49.444775 30125 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:10:49.469288 29901 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:49.498600 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 272661us
I20260709 13:10:49.462471 29951 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.443431 29914 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.487429 30111 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:49.520684 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 239825us
I20260709 13:10:49.497552 30084 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:49.523926 26584 rpcz_store.cc:276] 0709 13:10:48.322490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.378956 (+ 56466us) service_pool.cc:224] Handling call
0709 13:10:48.379348 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.379568 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.379596 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:48.390774 (+ 11178us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.085875 (+695101us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:49.085930 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.086016 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.469596 (+383580us) raft_consensus.cc:1685] finished
0709 13:10:49.469615 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.471739 (+  2124us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":452370,"threads_started":1,"wal-append.queue_time_us":1052700}
I20260709 13:10:49.294930 30046 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.539222 30215 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.594277 30046 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:49.594911 30046 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:49.596616 30046 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:49.598004 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:49.588138 30238 raft_consensus.cc:3055] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:49.598627 26650 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:49.598737 30238 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:49.599476 30147 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.599624 30238 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.600960 30238 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.494457 30202 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.602897 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1894) took 2163 ms. Trace:
I20260709 13:10:49.603257 26583 rpcz_store.cc:276] 0709 13:10:47.439929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.440098 (+   169us) service_pool.cc:224] Handling call
0709 13:10:49.206162 (+1766064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.277754 (+ 71592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.602690 (+324936us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400076cd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:49.602816 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4060682624}
I20260709 13:10:49.524890 30234 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.604651 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 456) took 2491 ms. Trace:
I20260709 13:10:49.541406 29743 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:49.549774 30241 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:49.606114 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2196) took 1400 ms. Trace:
I20260709 13:10:49.606508 26502 rpcz_store.cc:276] 0709 13:10:48.205760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.373042 (+167282us) service_pool.cc:224] Handling call
0709 13:10:48.376502 (+  3460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.109692 (+733190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.605877 (+496185us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54000a82d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:49.606046 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507507456}
I20260709 13:10:49.550882 30213 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:49.533720 30210 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.490163 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1919) took 1158 ms. Trace:
I20260709 13:10:49.562717 26549 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:49.624104 26577 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:49.624307 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 61739.8us
I20260709 13:10:49.564934 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:10:49.625128 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 60317us
I20260709 13:10:49.625492 26549 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:49.567296 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:49.573266 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:49.523706 30081 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.630494 26502 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:49.623723 26652 rpcz_store.cc:276] 0709 13:10:48.331950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.332866 (+   916us) service_pool.cc:224] Handling call
0709 13:10:48.333165 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.333510 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.333535 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:48.333981 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:10:48.382930 (+ 48949us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:48.382985 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.383081 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.489921 (+1106840us) raft_consensus.cc:1685] finished
0709 13:10:49.489950 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.490101 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4266,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":29394,"thread_start_us":48608,"threads_started":1,"wal-append.queue_time_us":641289}
I20260709 13:10:49.576473 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:49.578152 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:49.585657 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:49.631933 26584 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:49.632158 27272 raft_consensus.cc:2410] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:49.578794 30212 raft_consensus.cc:3055] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:49.591117 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.561229 29736 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:10:49.591539 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:49.587533 30111 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.506544 30211 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.605012 26505 rpcz_store.cc:276] 0709 13:10:47.112889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.979966 (+867077us) service_pool.cc:224] Handling call
0709 13:10:49.183817 (+1203851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.281950 (+ 98133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.604443 (+322493us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002fba50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:49.604597 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2733747584}
W20260709 13:10:49.617825 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.523269 29672 raft_consensus.cc:3055] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:49.634416 26549 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:49.606441 30267 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:49.635241 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:49.636333 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 63162.2us
W20260709 13:10:49.637022 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 162714us
I20260709 13:10:49.644903 26509 raft_consensus.cc:3055] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:49.654055 26509 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:49.654452 27243 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:49.651944 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:49.648294 26650 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:49.654793 26509 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:49.663954 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:49.636075 30130 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:49.668125 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 77920.2us
I20260709 13:10:49.635857 29743 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:49.666472 27269 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:49.664610 27275 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:49.642370 30147 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:49.671881 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:49.672925 27243 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:49.638837 30212 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:49.676381 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:49.646577 30081 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:49.653030 29672 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:49.652973 30267 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:49.658599 30092 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:49.688953 26505 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:10:49.690382 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:49.691339 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:49.701661 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:49.692194 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:49.702694 26501 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.703363 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:49.662365 30245 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:49.699018 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:49.707154 30233 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 1.083s	user 0.005s	sys 0.000s
I20260709 13:10:49.707077 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:49.708539 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:49.708931 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 903) took 1473 ms. Trace:
I20260709 13:10:49.701350 26510 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:49.709544 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:49.709280 27278 rpcz_store.cc:276] 0709 13:10:48.235115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.237680 (+  2565us) service_pool.cc:224] Handling call
0709 13:10:48.272264 (+ 34584us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:48.277585 (+  5321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.277634 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:48.293597 (+ 15963us) log.cc:844] Serialized 52 byte log entry
0709 13:10:48.624062 (+330465us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:48.624119 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.624210 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.706498 (+1082288us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:49.708644 (+  2146us) raft_consensus.cc:1685] finished
0709 13:10:49.708667 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.708877 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":6822,"spinlock_wait_cycles":59054976,"thread_start_us":288002,"threads_started":1,"wal-append.queue_time_us":310294}
I20260709 13:10:49.674233 30130 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.704164 26505 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:49.718580 26510 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:49.719700 26510 pending_rounds.cc:85] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 7
I20260709 13:10:49.720067 26510 pending_rounds.cc:107] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:49.720356 26510 raft_consensus.cc:2889] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:49.724174 26549 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:49.724946 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.726643 26549 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:49.724207 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 43708.9us
I20260709 13:10:49.731742 26476 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:49.667637 29932 consensus_queue.cc:1059] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:10:49.732689 26502 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:49.664875 29901 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:49.679714 30071 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:49.680760 30081 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.663203 29951 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:10:49.733757 26501 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
W20260709 13:10:49.734450 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 96985.7us
I20260709 13:10:49.663848 30005 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:10:49.681448 30179 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:49.732884 29117 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:49.796020 29117 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:49.735975 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:49.797190 27269 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.743813 26476 leader_election.cc:400] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7.
I20260709 13:10:49.803123 26476 leader_election.cc:403] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:49.803948 30215 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7.
W20260709 13:10:49.804119 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 60539.3us
I20260709 13:10:49.770821 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:49.671303 30202 consensus_queue.cc:1059] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:10:49.679473 29910 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 13:10:49.777464 30271 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:49.815654 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:49.816852 26577 raft_consensus.cc:2393] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 4: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:49.772490 29796 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:49.778055 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:49.778602 30094 consensus_meta.cc:287] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.003s
I20260709 13:10:49.779979 30084 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.780357 30164 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:49.781680 29743 consensus_queue.cc:1059] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:49.783133 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:49.776099 30071 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.786747 30211 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.728827 30130 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.729957 30147 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:49.791802 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 61202.5us
I20260709 13:10:49.793121 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:49.733430 30259 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.794162 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:49.794221 26579 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:49.701136 30223 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:10:49.809664 27278 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:49.700980 30143 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:10:49.813838 27269 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:49.735280 30261 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:49.777643 30256 log.cc:927] Time spent T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:10:49.814006 29117 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:49.823367 27272 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:49.719185 29862 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:10:49.789273 30081 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:49.735433 30272 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:10:49.734141 29736 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:10:49.851617 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 59086us
I20260709 13:10:49.772873 30092 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:10:49.855497 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:49.772594 30083 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:10:49.864400 27243 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:49.829102 30275 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:10:49.823566 30267 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.869340 26625 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:49.856626 30171 consensus_meta.cc:287] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.006s
I20260709 13:10:49.854563 30094 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:49.874595 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:49.830031 30254 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:10:49.854949 30125 consensus_queue.cc:1059] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:49.790859 30212 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:49.875455 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:49.960515 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:50.049363 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:49.888670 26583 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:49.889582 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:49.881817 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:49.864902 30071 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:49.881420 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:50.069869 27269 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:50.054172 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 189840us
W20260709 13:10:50.055061 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 185958us
W20260709 13:10:50.080263 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.029655 30271 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:50.042286 29951 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.121206 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:50.129667 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.930182 29932 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:50.077227 30211 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:50.035329 30231 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.994s	user 0.000s	sys 0.019s
I20260709 13:10:49.930120 30282 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.090934 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:50.130401 27269 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:49.963940 30147 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.959474 30153 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:49.869896 29901 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.959247 30274 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:50.082798 26584 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
W20260709 13:10:49.960968 30110 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.000s
I20260709 13:10:49.871649 30202 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.258s
I20260709 13:10:50.006994 29404 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:50.228226 30111 consensus_meta.cc:287] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.000s
I20260709 13:10:50.284873 30110 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:50.229285 30188 consensus_meta.cc:287] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.002s
I20260709 13:10:50.290124 30188 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.291194 30110 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.292465 29404 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:50.292855 27271 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:50.292932 30188 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:49.909531 29796 raft_consensus.cc:697] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:50.294296 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.294253 29796 consensus_queue.cc:237] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.296773 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 910) took 1362 ms. Trace:
I20260709 13:10:50.297180 27274 rpcz_store.cc:276] 0709 13:10:48.934629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.934789 (+   160us) service_pool.cc:224] Handling call
0709 13:10:48.969516 (+ 34727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.178916 (+209400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.178953 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.179000 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:49.179044 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.296564 (+1117520us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400720e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:50.296610 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.296709 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481033600}
I20260709 13:10:50.297828 26507 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:50.299147 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.257871 30247 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.258700 30283 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.077507 30084 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:50.121670 30077 raft_consensus.cc:3055] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.103216 30267 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:49.953595 30284 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:50.077517 30050 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:50.222815 30168 consensus_meta.cc:287] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.003s
I20260709 13:10:50.266763 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 908) took 1355 ms. Trace:
I20260709 13:10:50.077725 29826 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:50.229943 30098 consensus_meta.cc:287] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.724s	user 0.009s	sys 0.003s
I20260709 13:10:50.270669 26577 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:10:50.083387 30180 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.046339 30215 consensus_queue.cc:1059] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.212s
I20260709 13:10:50.278657 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:50.275112 30282 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:50.279505 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 508731us
I20260709 13:10:50.279928 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:50.364964 27278 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:50.366261 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:50.367571 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:50.282315 26584 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:49.871465 30259 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.044382 30243 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:49.961975 30262 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.315s
I20260709 13:10:50.229876 30245 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.381222 30071 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.279305 30153 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:50.242115 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.039801 29672 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.131529 29736 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.148s
I20260709 13:10:50.120790 30276 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.205s
W20260709 13:10:50.308995 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.067873 30171 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.175060 29951 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.402601 30081 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.341078 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:50.328822 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.341118 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.423949 26656 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:50.424209 26652 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:50.425288 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:50.300758 29910 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.426347 29910 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.428457 29910 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:50.234403 29932 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.362963 30098 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.266713 30147 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.346725 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.348582 30017 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:50.348855 30230 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 1.270s	user 0.000s	sys 0.013s
I20260709 13:10:50.349880 26659 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:50.350535 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.311830 30077 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:50.354494 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.354081 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:50.328305 30284 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.303288 30111 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.356794 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 904) took 2121 ms. Trace:
I20260709 13:10:50.337837 27241 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:50.334404 30272 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.310120 30110 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:10:50.357960 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 281686us
I20260709 13:10:50.339977 30260 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.358516 27276 rpcz_store.cc:276] 0709 13:10:48.911308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.911436 (+   128us) service_pool.cc:224] Handling call
0709 13:10:48.911765 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.222733 (+310968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.266474 (+1043741us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54005abc54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:50.266691 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494987648}
I20260709 13:10:50.451803 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:50.370752 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:50.220933 30154 raft_consensus.cc:3055] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:50.374895 27278 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:50.447655 27277 rpcz_store.cc:276] 0709 13:10:48.235450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.237753 (+  2303us) service_pool.cc:224] Handling call
0709 13:10:48.275117 (+ 37364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.275540 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.275586 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:48.288855 (+ 13269us) log.cc:844] Serialized 26 byte log entry
0709 13:10:48.417500 (+128645us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:48.417597 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.417697 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.034480 (+1616783us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:50.354513 (+320033us) raft_consensus.cc:1685] finished
0709 13:10:50.354541 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.356719 (+  2178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5377,"raft.queue_time_us":564,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9567,"spinlock_wait_cycles":5433088,"thread_start_us":84025,"threads_started":1,"wal-append.queue_time_us":661221}
I20260709 13:10:50.315578 30084 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.379063 29404 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.381119 30259 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.382676 30202 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:50.383028 30243 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.383599 30262 consensus_queue.cc:1243] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:50.384402 30245 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.278316 29901 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:50.386088 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.448778 30284 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:50.398303 30285 log.cc:927] Time spent T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:50.369763 30050 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.403235 29951 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:50.404147 29736 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:50.315994 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.313144 30283 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.492331 30283 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.493935 30171 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.312794 30247 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.362819 30180 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.495690 30282 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:50.496317 30180 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.416452 26576 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:50.418078 30242 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:50.496779 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 905) took 2261 ms. Trace:
I20260709 13:10:50.497136 30242 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:50.497325 30147 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:50.429868 26650 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:50.361315 30168 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.501768 30084 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:50.502439 30071 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.503072 30211 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:50.503196 30168 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.430804 27269 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:50.432811 26656 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:50.333773 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.436772 26658 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:50.447540 26580 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:50.446306 27272 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
W20260709 13:10:50.451845 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 114118us
I20260709 13:10:50.437748 30017 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:50.452713 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 82059.9us
I20260709 13:10:50.374266 26584 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:50.453763 30292 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:50.454486 29910 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:50.454552 30098 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:50.455610 30288 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:10:50.511967 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:50.450872 26625 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:50.512971 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 62156us
I20260709 13:10:50.513507 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:50.461097 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:50.453254 30290 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:50.467471 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:50.517683 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:50.468519 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:50.387662 26503 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:50.470108 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:50.456784 30154 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:50.444291 29826 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:50.466385 30238 consensus_meta.cc:287] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.865s	user 0.004s	sys 0.009s
I20260709 13:10:50.459739 30234 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:50.479791 26651 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
W20260709 13:10:50.480540 30130 consensus_meta.cc:287] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.006s
I20260709 13:10:50.471302 30077 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.479404 29736 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:50.481957 29404 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.483315 30245 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.484468 30111 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.551398 30111 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.474236 29932 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:50.498131 30242 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.501768 30050 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:50.432407 30070 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.507570 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.508111 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.455154 30260 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.516357 26548 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:50.519646 27274 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:50.517298 27277 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:50.562263 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:50.562938 26505 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:50.521044 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:50.459583 30272 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.566530 27277 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:50.566814 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:50.470521 30202 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.497226 27273 rpcz_store.cc:276] 0709 13:10:48.235799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.237820 (+  2021us) service_pool.cc:224] Handling call
0709 13:10:48.270679 (+ 32859us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:48.271129 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.271170 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:48.286681 (+ 15511us) log.cc:844] Serialized 52 byte log entry
0709 13:10:48.419727 (+133046us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:48.870518 (+450791us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.112943 (+242425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.113043 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.308245 (+1195202us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:50.496379 (+188134us) raft_consensus.cc:1685] finished
0709 13:10:50.496495 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.496713 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":392440,"prepare.queue_time_us":457095,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":164460,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":11712,"spinlock_wait_cycles":10168576,"thread_start_us":342142,"threads_started":2,"wal-append.queue_time_us":693582}
I20260709 13:10:50.516608 30262 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:10:50.542047 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:50.572988 26581 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:50.574018 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:50.554579 27276 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 4.
I20260709 13:10:50.520166 30290 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.520814 30282 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:50.563706 26652 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:10:50.496310 30247 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.577601 27275 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:50.568729 26658 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:50.529175 27272 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:10:50.570844 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:50.574717 27277 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:10:50.579304 27277 pending_rounds.cc:85] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 7
I20260709 13:10:50.576642 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:50.579573 27277 pending_rounds.cc:107] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:10:50.579911 27277 raft_consensus.cc:2889] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:50.576378 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:50.581463 26510 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:50.582609 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:50.583377 26510 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:50.581512 26502 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:50.579875 26581 raft_consensus.cc:2376] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8. Re-sending same reply.
I20260709 13:10:50.585165 26510 raft_consensus.cc:1217] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-11.6]   Dedup: 3.3->[6.4-11.6]
I20260709 13:10:50.568238 29404 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:50.588836 26510 pending_rounds.cc:85] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 3
I20260709 13:10:50.592082 26510 pending_rounds.cc:107] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:10:50.592509 26510 raft_consensus.cc:2889] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:50.518911 30283 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:10:50.573210 30077 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.552115 30111 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.554893 30234 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:50.601478 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 85726.5us
I20260709 13:10:50.594099 30282 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:50.607298 30282 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.608489 30260 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:50.598181 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:50.577382 30242 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:50.555711 30130 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.581334 30290 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.611303 29914 raft_consensus.cc:3055] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:50.618029 27275 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:10:50.669535 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 106003us
I20260709 13:10:50.620731 27274 raft_consensus.cc:2410] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:10:50.689663 27274 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:50.636670 26625 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:50.691021 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 54486.9us
I20260709 13:10:50.692335 26625 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:50.698725 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.623243 26658 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:50.685926 27273 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:50.600126 29404 raft_consensus.cc:697] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:50.703385 26502 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:50.578328 29736 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.671270 30276 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:50.605742 30081 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:50.687641 29914 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:50.717073 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:50.721378 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:50.718743 29951 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.725620 29951 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.728578 29951 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:50.729596 30243 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:50.731331 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:50.732502 26576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:10:50.733117 26576 raft_consensus.cc:606] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:50.735008 30272 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:50.703756 30267 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:50.733487 26576 raft_consensus.cc:614] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:50.746701 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:50.703612 30050 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:50.709904 30283 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.750468 27275 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:50.844936 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 98309.6us
I20260709 13:10:50.846050 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:50.847575 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:50.714789 30147 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.616936 29826 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.864799 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:50.843899 29743 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:50.868872 26505 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:50.745982 30267 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:50.851733 29736 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:50.870391 26548 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:50.854450 30092 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:50.851635 30202 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:50.852594 29404 consensus_queue.cc:237] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.856923 30050 raft_consensus.cc:697] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:50.867103 30081 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:50.881899 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:50.724014 30276 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.853993 30283 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:50.876211 26548 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:50.862618 30147 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:50.873247 29951 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:50.873695 30267 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:50.893605 26576 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:50.886647 29796 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:50.910027 30130 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:50.888247 30287 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:50.891212 30081 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:50.936329 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:50.917954 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:50.939083 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.954150 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.904824 30092 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:50.941431 29951 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.913499 30111 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:51.018940 26473 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:50.954241 30081 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:50.873451 29914 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.023509 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:51.023870 26473 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:51.027444 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:50.956707 29796 raft_consensus.cc:697] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:51.015784 29951 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:51.028137 30167 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:51.035075 30017 consensus_meta.cc:287] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.001s
I20260709 13:10:51.036015 30201 raft_consensus.cc:3055] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:51.039413 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:51.051810 30201 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:51.051786 30017 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:51.041072 26501 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:51.052858 30201 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.053913 30201 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:51.054448 30287 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:51.054929 30287 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.055296 30287 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:51.041679 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.062712 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:51.064015 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:51.050745 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.025962 30234 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:51.022692 30092 raft_consensus.cc:697] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:51.030411 30284 consensus_meta.cc:287] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 13:10:51.032063 30050 consensus_queue.cc:237] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:51.043601 29914 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.065217 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.075925 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1919) took 1278 ms. Trace:
I20260709 13:10:51.104260 26577 rpcz_store.cc:276] 0709 13:10:49.798009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.178638 (+380629us) service_pool.cc:224] Handling call
0709 13:10:50.270437 (+ 91799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.359948 (+ 89511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.075686 (+715738us) spinlock_profiling.cc:243] Waited 91.3 ms on lock 0x7b540032ebd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:51.075858 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209999232}
I20260709 13:10:51.105962 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:51.107436 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:51.078346 26509 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:51.098662 26578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2750) took 2149 ms (client timeout 1556 ms). Trace:
I20260709 13:10:51.100526 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:51.112201 26578 rpcz_store.cc:269] 0709 13:10:48.949060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.950721 (+  1661us) service_pool.cc:224] Handling call
0709 13:10:51.098455 (+2147734us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003dfed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:51.098573 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384829184}
I20260709 13:10:51.116734 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:51.118587 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:51.119923 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:51.120694 26578 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:51.123152 26576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ecc61d0190444bea318620b6a278926"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:10:51.123847 26576 raft_consensus.cc:606] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:51.124294 26576 raft_consensus.cc:614] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:51.127597 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.128671 27275 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:10:51.089131 30244 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 1.911s	user 0.000s	sys 0.013s
I20260709 13:10:51.065060 30077 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:51.137264 26577 raft_consensus.cc:2393] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:51.072978 30276 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:51.075150 30147 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:51.072101 30283 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:51.158128 26577 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:51.141544 27272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 916) took 1060 ms. Trace:
I20260709 13:10:51.149899 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:51.167259 27275 raft_consensus.cc:2376] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7. Re-sending same reply.
I20260709 13:10:51.165167 27272 rpcz_store.cc:276] 0709 13:10:50.081067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.589585 (+508518us) service_pool.cc:224] Handling call
0709 13:10:50.610079 (+ 20494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.610336 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:50.847749 (+237413us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.141128 (+293379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.141191 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:51.141253 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.141333 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.141464 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":295993,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":545,"thread_start_us":429633,"threads_started":2}
I20260709 13:10:51.130429 30201 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:51.175530 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.087951 30284 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:51.186030 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2678) took 1559 ms. Trace:
I20260709 13:10:51.187062 26509 rpcz_store.cc:276] 0709 13:10:49.627026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.628455 (+  1429us) service_pool.cc:224] Handling call
0709 13:10:49.644788 (+ 16333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.046067 (+401279us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b58008567d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8850aa 00007f882c907447 00007f882c91ffe7 00007f882c9217de 00007f882c92bb49 00007f882c92c416 00007f882c928d8f 00007f882c92883e 00007f88318ed419 00007f882ae64bd4
0709 13:10:51.077918 (+1031851us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54001c3020. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c89ea1d 00007f882c8851a4 00007f882c907447 00007f882c91ffe7 00007f882c9217de 00007f882c92bb49 00007f882c92c416 00007f882c928d8f 00007f882c92883e 00007f88318ed419
0709 13:10:51.177513 (+ 99595us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:51.177543 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.185152 (+  7609us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:51.185204 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.185291 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.185959 (+   668us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_wall_time_us":4933,"spinlock_wait_cycles":1029499136}
I20260709 13:10:51.072046 30287 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.087013 29796 consensus_queue.cc:237] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:51.074100 30092 consensus_queue.cc:237] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:51.137435 30087 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:51.204032 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:51.205188 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2671) took 3214 ms. Trace:
I20260709 13:10:51.205617 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2752) took 2178 ms. Trace:
I20260709 13:10:51.207091 26578 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:10:51.176504 30076 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.218962 26585 rpcz_store.cc:276] 0709 13:10:49.027118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.029679 (+  2561us) service_pool.cc:224] Handling call
0709 13:10:49.030074 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.221835 (+191761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.221867 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.222327 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.456788 (+234461us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.457185 (+   397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.205216 (+1748031us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540015c554. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:51.205268 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.205312 (+    44us) raft_consensus.cc:1685] finished
0709 13:10:51.205324 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.205538 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45654,"raft.queue_time_us":48301,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":76,"spinlock_wait_cycles":334937984,"thread_start_us":214627,"threads_started":1,"wal-append.queue_time_us":322222,"wal-append.run_cpu_time_us":1486,"wal-append.run_wall_time_us":1002335}
W20260709 13:10:51.226790 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 173589us
I20260709 13:10:51.227180 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:51.155189 29736 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:10:51.200793 26501 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:10:51.231791 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.091701 30154 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.238838 27272 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:51.219496 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 192133us
I20260709 13:10:51.218815 26504 rpcz_store.cc:276] 0709 13:10:47.991361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.337278 (+345917us) service_pool.cc:224] Handling call
0709 13:10:48.337550 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.722782 (+385232us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:48.723312 (+   530us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.034697 (+311385us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.085158 (+ 50461us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.085282 (+   124us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.085317 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.709850 (+624533us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400183dd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:49.709894 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.088462 (+1378568us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:51.204960 (+116498us) raft_consensus.cc:1685] finished
0709 13:10:51.204982 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.205129 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157487,"prepare.queue_time_us":147,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":32,"raft.queue_time_us":166806,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":13789,"spinlock_wait_cycles":530360960,"thread_start_us":310601,"threads_started":1,"wal-append.queue_time_us":454468}
W20260709 13:10:51.210609 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.240999 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.218508 27275 raft_consensus.cc:2376] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10. Re-sending same reply.
I20260709 13:10:51.178822 30017 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:51.241356 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:51.247741 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.248402 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:51.248816 26501 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:51.241813 26504 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:51.251397 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:51.252681 26504 raft_consensus.cc:2393] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:51.255648 26548 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:51.257308 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.239442 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.306767 26504 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:10:51.262677 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.270434 30284 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:51.274541 30154 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:51.274983 30242 consensus_queue.cc:1175] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:51.277133 30202 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.246852 30076 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.279981 30287 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:51.177054 30147 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:51.280292 30247 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:51.280735 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.247382 30077 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.293941 29753 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:51.296058 29901 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:51.298005 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 859) took 1269 ms. Trace:
I20260709 13:10:51.328440 30071 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:51.298537 30303 log.cc:927] Time spent T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:10:51.305984 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 50414.9us
I20260709 13:10:51.307947 27272 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:51.344890 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.347361 26508 raft_consensus.cc:2393] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:51.306499 30251 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:51.306331 29743 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:51.387095 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 138800us
I20260709 13:10:51.365924 27240 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:51.346851 30290 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.001s
W20260709 13:10:51.346977 30098 consensus_queue.cc:1175] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b9c3761688a64982ae1c4aeb758e09ef" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:10:51.370226 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.374238 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 907) took 2463 ms. Trace:
I20260709 13:10:51.374547 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 1922) took 1573 ms. Trace:
I20260709 13:10:51.345652 30168 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:51.384050 26504 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:51.380050 27273 rpcz_store.cc:276] 0709 13:10:50.028746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.572300 (+543554us) service_pool.cc:224] Handling call
0709 13:10:50.572606 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.701287 (+128681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.297745 (+596458us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400780fd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:51.297944 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259454848}
I20260709 13:10:51.385354 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:51.363464 26501 raft_consensus.cc:2393] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:51.393538 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:51.306738 30081 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.411041 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:51.417380 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:51.415227 26582 rpcz_store.cc:276] 0709 13:10:49.800929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.875173 (+ 74244us) service_pool.cc:224] Handling call
0709 13:10:51.374378 (+1499205us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540015c054. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:51.374494 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957289728}
I20260709 13:10:51.414746 27271 rpcz_store.cc:276] 0709 13:10:48.910947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.911079 (+   132us) service_pool.cc:224] Handling call
0709 13:10:48.963329 (+ 52250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.293290 (+1329961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.373975 (+1080685us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54005f1c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:51.374172 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3057221504}
I20260709 13:10:51.410645 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:51.429531 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.436511 26657 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:51.438462 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.446831 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:51.448339 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:51.430526 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.425410 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.459458 26504 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:51.462689 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:51.382768 30251 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:51.378172 29753 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:51.478828 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.457410 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.469635 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:51.411906 30234 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.362316 30202 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:51.475189 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.486146 27271 raft_consensus.cc:2368] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:51.467157 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:51.486737 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:51.476619 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.477764 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.482437 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:51.488981 26508 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:51.489228 26652 raft_consensus.cc:2368] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7.
I20260709 13:10:51.431792 30320 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:51.450053 30287 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:51.450179 30316 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.381453 30077 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.378502 30247 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.425043 30290 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:51.455401 30321 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:51.464344 30005 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:51.409515 30071 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.536109 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:51.538079 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:51.501260 26506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2206) took 2713 ms (client timeout 1938 ms). Trace:
W20260709 13:10:51.539014 26506 rpcz_store.cc:269] 0709 13:10:48.780015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.882190 (+102175us) service_pool.cc:224] Handling call
0709 13:10:51.493090 (+2610900us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54000b3bd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:51.493201 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635763584}
I20260709 13:10:51.540741 26655 raft_consensus.cc:2410] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:51.527292 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.494475 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:51.540743 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:51.542302 26506 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:51.542552 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.541774 27271 raft_consensus.cc:2376] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8. Re-sending same reply.
I20260709 13:10:51.543926 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.502435 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:51.468101 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:51.546564 26584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:10:51.481149 26548 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:51.548362 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 67310.8us
I20260709 13:10:51.549216 26657 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:51.501256 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:51.498739 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.550870 26654 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.495721 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:51.555495 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:51.560832 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:51.552673 26549 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:51.511560 30317 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:10:51.564045 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:51.573827 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:51.574646 26501 raft_consensus.cc:2410] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:10:51.565768 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.567042 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:51.568022 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:51.571375 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.541203 30320 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.539292 30005 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.581502 26506 raft_consensus.cc:2410] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:10:51.601087 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.583454 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:51.605037 26501 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:51.563328 30081 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:51.586704 26549 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:51.592183 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.594324 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:51.565071 30147 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:51.582615 27271 raft_consensus.cc:2376] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10. Re-sending same reply.
I20260709 13:10:51.624622 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:51.583767 26652 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:10:51.606429 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 194762us
I20260709 13:10:51.620445 26505 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:51.629828 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.595211 29796 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:51.598616 29743 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.573681 30324 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:51.632985 26505 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:51.603192 30005 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:51.623844 30147 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.557089 30321 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.511310 30251 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.647056 30092 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:51.659315 30077 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:51.660894 26505 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:51.663053 26505 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:51.633309 26506 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:51.621640 26501 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:51.633605 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:51.601176 30320 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:51.623330 26508 pending_rounds.cc:85] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 9
I20260709 13:10:51.554977 30316 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:51.625330 30267 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.005s
I20260709 13:10:51.632566 27271 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:51.687954 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.689479 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:51.539985 29753 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.661496 30147 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:51.627553 30337 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:51.732424 30337 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:51.732875 30337 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:51.733124 29951 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.003s
I20260709 13:10:51.733896 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2224) took 1168 ms. Trace:
I20260709 13:10:51.733712 29951 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.734297 26510 rpcz_store.cc:276] 0709 13:10:50.565956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.584268 (+ 18312us) service_pool.cc:224] Handling call
0709 13:10:50.584881 (+   613us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:10:50.593681 (+  8800us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:50.854435 (+260754us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.548184 (+693749us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:51.548836 (+   652us) log.cc:844] Serialized 78 byte log entry
0709 13:10:51.549014 (+   178us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:51.549047 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.549115 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.733651 (+184536us) raft_consensus.cc:1685] finished
0709 13:10:51.733673 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.733833 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":321655,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":354541,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":26989,"thread_start_us":833215,"threads_started":3,"wal-append.queue_time_us":863443}
I20260709 13:10:51.735991 29951 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:51.736560 26584 raft_consensus.cc:606] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:51.736886 26510 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:51.644891 29796 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.646152 30046 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.737818 29796 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:51.738006 30046 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:51.739550 30327 log.cc:927] Time spent T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:10:51.654563 29743 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.740479 30046 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:51.646001 30076 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:51.741869 29743 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:51.742695 30328 log.cc:927] Time spent T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:10:51.690143 27271 raft_consensus.cc:2376] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10. Re-sending same reply.
I20260709 13:10:51.646281 30324 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.694468 30267 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:51.710983 30318 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:10:51.711663 30325 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:10:51.714460 30071 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:51.718516 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2766) took 1202 ms. Trace:
I20260709 13:10:51.789877 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2763) took 1274 ms. Trace:
I20260709 13:10:51.790488 30251 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:51.790340 26583 rpcz_store.cc:276] 0709 13:10:50.515018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.732366 (+217348us) service_pool.cc:224] Handling call
0709 13:10:50.732767 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.733241 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:50.924180 (+190939us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b1800031300. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:10:51.100929 (+176749us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b1800031300. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882c4d14bc 00007f882981f48b 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f8829839455 00007f88303213c7 00007f882c9339a7 00007f882c9430bf
0709 13:10:51.101064 (+   135us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.362444 (+261380us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.363127 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.363248 (+   121us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.363277 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.363350 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.789640 (+426290us) raft_consensus.cc:1685] finished
0709 13:10:51.789662 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.789816 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15711,"prepare.queue_time_us":109566,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":12519,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":18233,"spinlock_wait_cycles":27145728,"thread_start_us":369664,"threads_started":2,"wal-append.queue_time_us":545106}
I20260709 13:10:51.721436 30168 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:51.793206 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2772) took 1164 ms. Trace:
I20260709 13:10:51.752396 30046 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.727033 30321 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:51.727787 30202 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:51.727866 30238 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.729351 30247 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:51.672767 29914 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:51.731045 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2208) took 2044 ms. Trace:
W20260709 13:10:51.776762 30323 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 13:10:51.743062 26580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2759) took 2350 ms (client timeout 1652 ms). Trace:
I20260709 13:10:51.810267 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:51.685042 26508 pending_rounds.cc:107] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:10:51.810921 26508 raft_consensus.cc:2889] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.777015 30324 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:51.753971 26505 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
W20260709 13:10:51.810701 26580 rpcz_store.cc:269] 0709 13:10:49.392941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.396581 (+  3640us) service_pool.cc:224] Handling call
0709 13:10:51.742871 (+2346290us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002aa3d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:51.742982 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2414058752}
W20260709 13:10:51.755976 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 127915us
W20260709 13:10:51.777760 30332 log.cc:927] Time spent T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:10:51.725178 30005 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.788416 26579 rpcz_store.cc:276] 0709 13:10:50.515936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.073689 (+557753us) service_pool.cc:224] Handling call
0709 13:10:51.074036 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.307202 (+233166us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:51.360965 (+ 53763us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.657355 (+296390us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.695069 (+ 37714us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.695280 (+   211us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.695326 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.695410 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.718258 (+ 22848us) raft_consensus.cc:1685] finished
0709 13:10:51.718278 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.718436 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15477,"prepare.queue_time_us":53737,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":1293,"raft.queue_time_us":97464,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":5360,"thread_start_us":456300,"threads_started":2,"wal-append.queue_time_us":335928}
I20260709 13:10:51.824986 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:51.825783 26579 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:51.719242 30290 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:51.723330 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2683) took 1649 ms. Trace:
I20260709 13:10:51.825824 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:51.834215 26503 rpcz_store.cc:276] 0709 13:10:50.073493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.073648 (+   155us) service_pool.cc:224] Handling call
0709 13:10:50.121191 (+ 47543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.519206 (+398015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.723088 (+1203882us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54002c29d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:51.723264 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612293376}
I20260709 13:10:51.793332 30168 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:51.836498 30077 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:51.724305 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2767) took 1207 ms. Trace:
I20260709 13:10:51.778292 26506 pending_rounds.cc:85] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 5
I20260709 13:10:51.838984 26578 rpcz_store.cc:276] 0709 13:10:50.517316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.121523 (+604207us) service_pool.cc:224] Handling call
0709 13:10:51.121911 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.222465 (+100554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.724064 (+501599us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b5400100254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:51.724248 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195306752}
I20260709 13:10:51.839814 26506 pending_rounds.cc:107] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:10:51.797595 26576 rpcz_store.cc:276] 0709 13:10:50.629191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.157710 (+528519us) service_pool.cc:224] Handling call
0709 13:10:51.181617 (+ 23907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.181915 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.181941 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.182331 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.348487 (+166156us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:51.348550 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.348656 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.793009 (+444353us) raft_consensus.cc:1685] finished
0709 13:10:51.793026 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.793153 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3303,"raft.queue_time_us":18326,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10070,"thread_start_us":138358,"threads_started":1,"wal-append.queue_time_us":287000}
I20260709 13:10:51.840245 26506 raft_consensus.cc:2889] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.736971 26584 raft_consensus.cc:614] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:51.745658 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.799407 29753 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:51.671653 26501 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:51.807467 26510 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:51.836937 26473 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:51.837998 30208 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:51.847051 30329 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:51.847434 30208 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:51.848229 26473 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:51.809669 26507 rpcz_store.cc:276] 0709 13:10:49.686681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.689464 (+  2783us) service_pool.cc:224] Handling call
0709 13:10:49.689873 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.298590 (+608717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.709974 (+1411384us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b5400194454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:51.730966 (+ 20992us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397594880}
I20260709 13:10:51.778151 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:51.850191 26582 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:51.855593 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:51.695230 30335 consensus_queue.cc:1059] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.129s
W20260709 13:10:51.866190 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 237313us
I20260709 13:10:51.867250 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:51.869441 27273 raft_consensus.cc:2368] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10.
I20260709 13:10:51.807027 30046 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.810706 30238 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:51.876701 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:51.856787 30329 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:51.857343 30092 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.879175 26659 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.861202 30154 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:51.818351 29914 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:51.894311 30267 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:51.894846 30322 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:51.872457 30077 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:51.874843 30213 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:51.900653 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:51.909428 26501 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.910844 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:51.906629 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:51.876197 30208 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:51.920701 26501 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:10:51.927933 26507 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:51.928262 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:51.946013 26510 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:51.932034 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.931515 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:51.943182 26503 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:10:51.897861 29282 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:51.899868 30238 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:51.878458 30335 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:10:51.900552 30154 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:51.949234 26652 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:51.952193 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:51.955824 26654 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:10:51.908928 30290 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.914017 30213 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:51.934553 30208 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:51.931461 30346 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:51.944172 30243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.008s	sys 0.017s
W20260709 13:10:51.989655 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.960347 30077 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.925657 30092 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:51.999437 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:52.001999 27240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.030s	sys 0.029s
I20260709 13:10:51.948673 30098 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:51.964766 30283 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:51.997345 30243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.009s	sys 0.017s
I20260709 13:10:52.012944 26510 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
W20260709 13:10:52.008656 30234 consensus_meta.cc:287] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.004s
I20260709 13:10:51.973706 30242 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:10:51.976383 30081 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:10:51.976574 30290 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:52.019146 30347 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:10:52.011076 29796 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.032876 30154 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.039602 30092 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:52.040326 29796 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:52.041328 30348 log.cc:927] Time spent T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:52.043350 30046 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:52.033114 30005 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:52.045172 27276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 584) took 1822 ms (client timeout 2096 ms). Trace:
W20260709 13:10:52.045553 27276 rpcz_store.cc:269] 0709 13:10:50.222550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.451528 (+228978us) service_pool.cc:224] Handling call
0709 13:10:52.045006 (+1593478us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b540085cfd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:52.045119 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118275840}
I20260709 13:10:52.046802 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:52.047716 27276 raft_consensus.cc:2410] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:52.048105 30290 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:51.996691 30346 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:52.049508 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.048454 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:52.009725 27240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.030s	sys 0.029s
I20260709 13:10:52.053330 26659 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:10:52.079173 27276 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.009196 30077 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.089850 27278 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:52.008678 30337 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.008549 30147 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.033118 30234 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:52.019366 30329 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:10:52.095873 30290 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.098588 30290 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.100188 27276 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:52.095669 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:52.100930 30290 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:52.103827 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:52.102909 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:52.112285 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:52.112582 27271 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:52.115614 27276 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:52.116518 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 877) took 1071 ms. Trace:
I20260709 13:10:52.116974 27276 rpcz_store.cc:276] 0709 13:10:51.044953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.114393 (+1069440us) service_pool.cc:224] Handling call
0709 13:10:52.115227 (+   834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.116227 (+  1000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.116453 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:52.118732 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:52.092374 30005 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:52.123579 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 156009us
I20260709 13:10:52.125216 30234 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:52.127058 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:52.134413 27240 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:52.092188 30350 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:10:52.141008 27272 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:52.022866 30213 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.085835 30168 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.141459 27240 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:52.106777 30283 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:52.121899 29914 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:52.124423 30238 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:52.122262 30321 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:52.149003 27240 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:52.149871 27275 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:10:52.150808 30283 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:52.155368 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.137691 30143 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:52.092406 30208 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.131102 30335 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:10:52.144601 30247 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:52.181038 26505 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:52.143651 30071 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:52.182611 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 89799.1us
I20260709 13:10:52.137257 30005 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.158744 30234 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.159193 30213 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.194941 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:52.189680 29910 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:10:52.195405 30071 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:52.196754 30168 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:52.197880 30143 raft_consensus.cc:697] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:52.210829 30143 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.188220 30354 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:10:52.202621 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:52.203734 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:52.180265 30083 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.206779 26508 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:52.207500 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:52.218521 26509 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:52.193262 30247 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.219648 30247 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:52.209774 30356 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:10:52.215499 26473 leader_election.cc:400] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:52.209177 30346 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:52.219779 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 917) took 2132 ms. Trace:
I20260709 13:10:52.227007 26473 leader_election.cc:403] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.227258 27277 rpcz_store.cc:276] 0709 13:10:50.087606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.590884 (+503278us) service_pool.cc:224] Handling call
0709 13:10:50.594392 (+  3508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.743984 (+1149592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.744161 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.744207 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:51.744243 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.219565 (+475322us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400740254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:52.219612 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.219730 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643387776}
I20260709 13:10:52.190407 30076 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:10:52.231958 26473 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:52.232851 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:52.216846 30071 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.221405 30365 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:52.257299 26508 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:10:52.258551 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:52.242834 30168 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6.
I20260709 13:10:52.250639 30329 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:52.226774 30083 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.271577 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:52.271973 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.256680 30365 raft_consensus.cc:697] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:52.274314 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:52.274766 30365 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.269647 30337 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:52.278168 30366 log.cc:927] Time spent T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:10:52.264355 30283 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:52.271214 30077 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:52.280795 30005 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:52.256930 30372 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:52.269599 29282 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:52.281661 30372 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:52.282656 30372 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.283380 30083 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:52.283995 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.285115 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.286583 29672 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.286854 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.287168 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:52.272430 30361 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:10:52.287997 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.288319 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.288614 26652 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:52.286867 26655 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:52.274876 27277 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:52.290817 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.291955 26657 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:52.290277 27241 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:52.294670 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 62789.1us
I20260709 13:10:52.296002 26473 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:52.296314 27241 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:52.298224 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.302111 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.269517 30147 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:52.294589 30076 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.326470 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:52.327133 30329 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:52.327239 30076 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.328433 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:52.328801 30238 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:52.329329 30238 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:52.329460 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:52.329674 30076 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:52.300849 30234 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:52.329784 30238 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.328716 30372 consensus_queue.cc:1059] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:52.330802 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:52.331113 30372 raft_consensus.cc:3055] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:52.331538 30372 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:52.331918 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:52.332543 27277 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:52.333001 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:52.330159 30011 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:52.335690 30372 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.337062 30372 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.301654 30005 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:52.337654 30005 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:52.338073 30005 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:52.303364 30339 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:52.340983 30339 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:52.341355 30339 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.275812 30324 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.344164 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:52.348764 27269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 863) took 2225 ms (client timeout 1614 ms). Trace:
W20260709 13:10:52.349186 27269 rpcz_store.cc:269] 0709 13:10:50.123295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.278309 (+155014us) service_pool.cc:224] Handling call
0709 13:10:52.348587 (+2070278us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b5400284454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:52.348696 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157346688}
I20260709 13:10:52.349951 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 870) took 1306 ms. Trace:
I20260709 13:10:52.350373 27274 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:10:52.343461 30011 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:52.352011 27241 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:52.352429 30011 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.354061 27241 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:52.354386 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 850) took 2567 ms. Trace:
I20260709 13:10:52.354823 27278 rpcz_store.cc:276] 0709 13:10:49.786972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.520221 (+733249us) service_pool.cc:224] Handling call
0709 13:10:52.049344 (+1529123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.095469 (+ 46125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.354204 (+258735us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540085cfd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:52.354327 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3515924864}
I20260709 13:10:52.355770 30234 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:52.356261 30354 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:52.350327 27273 rpcz_store.cc:276] 0709 13:10:51.043342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.450523 (+407181us) service_pool.cc:224] Handling call
0709 13:10:52.349764 (+899241us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54007201d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:52.349884 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889483520}
I20260709 13:10:52.359861 30354 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:52.361920 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:52.362330 30354 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.364872 26473 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:52.365777 26583 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:52.370018 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.373843 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.374529 26657 raft_consensus.cc:2376] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12. Re-sending same reply.
I20260709 13:10:52.375973 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:52.376588 26652 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.376648 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.376895 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.377610 26651 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:52.378225 26657 raft_consensus.cc:2410] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:52.361182 30147 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:52.379979 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:52.380993 26654 raft_consensus.cc:3055] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:52.374907 26473 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:52.387526 26654 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:52.389096 26473 leader_election.cc:400] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10.
I20260709 13:10:52.389410 26473 leader_election.cc:403] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.385955 26651 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:52.356390 30234 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:10:52.392079 26580 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:52.395529 26580 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:52.396720 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:52.385654 30083 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:52.399859 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.400840 26659 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:52.402871 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.394070 30147 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.403532 26650 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:52.404701 26652 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:52.404964 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:52.375118 30320 consensus_meta.cc:287] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
I20260709 13:10:52.405915 26653 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:52.408267 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:52.388624 26654 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.410369 26654 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:52.411619 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:52.412166 26579 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 4.
I20260709 13:10:52.413239 26549 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:52.414003 30243 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:52.414902 26549 leader_election.cc:400] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7.
I20260709 13:10:52.415166 26585 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:52.415307 26549 leader_election.cc:403] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.410777 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:52.416045 30243 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.417063 26549 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:52.417586 26654 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:10:52.417933 26654 pending_rounds.cc:85] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 3
I20260709 13:10:52.417809 30283 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:52.419206 26654 pending_rounds.cc:107] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:10:52.419651 26654 raft_consensus.cc:2889] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:52.419546 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.419679 26549 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:52.420497 26655 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:52.423686 26577 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:52.388598 29404 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.403766 30147 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:52.408949 30168 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:52.436862 30168 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.438802 26549 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:52.425025 30077 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10.
W20260709 13:10:52.446429 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.449141 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:52.450191 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:52.451288 26580 raft_consensus.cc:2393] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:52.451313 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:52.452467 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:52.455065 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:52.435779 29901 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:52.423013 30320 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.459434 26549 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:52.460177 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:52.441166 30212 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:52.491359 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:52.492197 27276 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.461113 30346 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:52.440302 30168 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:52.463554 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:52.502977 26576 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:10:52.503352 27269 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:52.464594 27273 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:52.469071 26581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2771) took 1950 ms (client timeout 2085 ms). Trace:
I20260709 13:10:52.471129 30071 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.477268 30354 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.478506 30081 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:52.479972 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:52.504105 26581 rpcz_store.cc:269] 0709 13:10:50.518542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.588371 (+ 69829us) service_pool.cc:224] Handling call
0709 13:10:52.468874 (+1880503us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54000d8754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:52.469000 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1551894912}
W20260709 13:10:52.480087 27272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 876) took 1435 ms (client timeout 1782 ms). Trace:
W20260709 13:10:52.512506 27272 rpcz_store.cc:269] 0709 13:10:51.044686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.410761 (+366075us) service_pool.cc:224] Handling call
0709 13:10:52.479906 (+1069145us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400668d54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:52.480026 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564608896}
I20260709 13:10:52.480615 27271 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:52.481247 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:52.482226 26503 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:52.482792 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:52.514853 26501 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:52.483698 30223 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:52.483841 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 778) took 1977 ms. Trace:
I20260709 13:10:52.511740 30081 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:52.523087 26658 rpcz_store.cc:276] 0709 13:10:50.506441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.508550 (+  2109us) service_pool.cc:224] Handling call
0709 13:10:50.520603 (+ 12053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.701587 (+180984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.483602 (+1782015us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b540039b7d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:52.483776 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110307712}
I20260709 13:10:52.524181 30081 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.525318 30081 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:52.484830 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.438334 29404 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.486828 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:52.526665 26577 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:52.527241 29753 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.527827 29753 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.530035 29753 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:52.530087 30011 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:10:52.530773 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.532660 26397 maintenance_manager.cc:419] P 6b5d6a3be49c419aa4980b2ed2efd28a: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033349
I20260709 13:10:52.541906 30201 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:52.542762 30201 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.545715 30201 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:52.546679 30201 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.547195 30201 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.549266 30201 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:52.553396 29753 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.554145 29753 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.556972 29753 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:52.557878 29753 consensus_queue.cc:1059] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:52.559363 30272 raft_consensus.cc:3055] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:52.559825 30272 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:52.560864 30272 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.562902 30272 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.574466 29932 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:52.577164 29932 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:52.587888 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 128525us
I20260709 13:10:52.589525 26549 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:52.593916 26504 raft_consensus.cc:2368] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10.
I20260709 13:10:52.595508 27269 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:52.440722 30283 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
W20260709 13:10:52.594357 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 205384us
W20260709 13:10:52.604614 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.511427 30324 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:52.610170 27269 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:10:52.612084 27269 pending_rounds.cc:85] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 7
I20260709 13:10:52.612354 27269 pending_rounds.cc:107] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:10:52.612633 27269 raft_consensus.cc:2889] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:52.613986 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:52.620573 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:52.622663 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45760.6us
I20260709 13:10:52.626952 27269 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:52.617002 26549 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:52.599992 30346 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.629508 27270 raft_consensus.cc:2410] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:52.631227 26549 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:52.626016 30081 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:52.630458 29282 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.639724 29282 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:52.640273 30387 log.cc:927] Time spent T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:10:52.608626 30223 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.586568 30005 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.638700 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:52.626101 30143 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:52.629149 30335 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.645660 30321 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:52.682175 27269 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
W20260709 13:10:52.681342 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 46531.7us
W20260709 13:10:52.688457 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 57302us
I20260709 13:10:52.637487 30262 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:52.691004 27269 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:52.655155 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:52.651108 30081 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:52.689673 26549 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:52.687418 30335 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:52.685544 30143 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.692600 30324 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:52.702040 29404 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:52.708727 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 183795us
I20260709 13:10:52.637537 27276 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:52.704726 26549 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:52.707716 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:52.693095 30262 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.628731 30201 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 13:10:52.705549 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 50520.7us
I20260709 13:10:52.717877 26549 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:52.707446 30324 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:52.726069 26549 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:52.707011 30365 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:52.726851 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.710808 30070 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.735011 26476 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:52.740278 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.741149 26658 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:52.747939 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.749516 30287 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:52.750233 30287 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.751135 26652 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:52.754133 30287 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:52.756520 30287 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.757207 30287 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.760286 30287 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:52.761226 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.763263 26652 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:52.764249 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:52.766659 26549 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:52.769944 30368 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:52.771118 30287 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:52.771939 30321 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:52.737833 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 50264.2us
W20260709 13:10:52.824324 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 89458.4us
I20260709 13:10:52.723330 29404 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:52.724817 30262 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:52.849432 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:52.736781 30324 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:52.871109 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.736665 30283 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:52.738998 30337 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:52.827266 30284 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:52.822263 30365 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:52.721820 30238 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.890748 30354 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:52.826709 30092 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:10:52.857297 29404 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:52.858417 30071 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:52.859025 30081 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:52.849514 30213 consensus_meta.cc:287] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.004s
I20260709 13:10:52.822561 30367 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:10:52.881296 30083 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:10:52.982558 27243 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:52.919158 30337 raft_consensus.cc:697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:52.915005 30320 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:52.955560 27273 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:52.921955 30365 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:52.978837 30243 consensus_meta.cc:287] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:10:52.991930 30071 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:52.920540 30147 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:52.990620 27243 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:52.913739 30283 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:53.003458 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:53.073943 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 83420.4us
I20260709 13:10:53.075138 27243 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:53.076869 27243 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:53.013069 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 189672us
W20260709 13:10:53.101073 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.992915 30401 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:53.039752 30243 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7.
I20260709 13:10:53.115939 26584 raft_consensus.cc:2410] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:52.989308 30213 consensus_queue.cc:1059] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:10:53.013911 30321 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:53.123020 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.085408 30354 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:53.104779 29672 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:53.104156 30111 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:53.098541 30367 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:53.154316 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.121594 30143 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:53.108196 30005 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:53.109892 29932 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:10:53.055842 30283 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:53.124483 30335 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:53.147976 29672 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:53.103384 29404 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:53.183770 30339 consensus_meta.cc:287] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.842s	user 0.011s	sys 0.000s
I20260709 13:10:53.163080 30321 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:53.232556 26622 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.519s (SENT) [suppressed 33 similar messages]
I20260709 13:10:53.185392 30405 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.203025 30153 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:53.209127 29672 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.197734 30223 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:53.250350 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 424944us
W20260709 13:10:53.372354 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.389515 26625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.017s	sys 0.014s
W20260709 13:10:53.390477 26625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.018s	sys 0.014s
I20260709 13:10:53.399586 26625 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:53.402300 26650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.011s	sys 0.029s
W20260709 13:10:53.403335 26655 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.016s	sys 0.030s
W20260709 13:10:53.403900 26655 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.016s	sys 0.031s
W20260709 13:10:53.404388 26650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.011s	sys 0.029s
I20260709 13:10:53.408154 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:53.409390 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.409502 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:53.411525 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:53.412523 26650 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
W20260709 13:10:53.301177 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 200820us
I20260709 13:10:53.414855 26549 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:53.419135 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:53.419281 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:53.412781 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:53.423504 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:53.424994 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:53.432689 26650 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:53.433266 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:53.438887 26658 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:53.437103 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:53.444805 26650 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:53.446550 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:53.447903 26650 raft_consensus.cc:2393] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:53.450395 29826 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:53.452322 29826 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:53.452806 29826 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:53.459676 26504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2695) took 1978 ms (client timeout 1776 ms). Trace:
I20260709 13:10:53.294219 30147 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:53.264380 30005 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:53.462404 26504 rpcz_store.cc:269] 0709 13:10:51.480872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.495463 (+ 14591us) service_pool.cc:224] Handling call
0709 13:10:53.458850 (+1963387us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540008edd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:53.459348 (+   498us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2395439488}
W20260709 13:10:53.466429 27270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 848) took 3684 ms (client timeout 1533 ms). Trace:
W20260709 13:10:53.474241 27270 rpcz_store.cc:269] 0709 13:10:49.781448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.782554 (+  1106us) service_pool.cc:224] Handling call
0709 13:10:53.465793 (+3683239us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b54006117d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:53.466100 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6379406080}
W20260709 13:10:53.467883 30168 consensus_meta.cc:287] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.000s
I20260709 13:10:53.476147 30168 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.471946 30005 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.467931 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 586) took 3236 ms. Trace:
I20260709 13:10:53.460354 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:53.255642 30083 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.485116 27274 rpcz_store.cc:276] 0709 13:10:50.231564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.690573 (+459009us) service_pool.cc:224] Handling call
0709 13:10:52.350005 (+1659432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.350800 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.467392 (+1116592us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400284450. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:53.467657 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3773611776}
I20260709 13:10:53.486481 30083 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:53.487578 29282 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:53.490207 30168 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:53.493431 30180 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:53.494925 30180 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:53.496076 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:53.495860 30180 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.496903 27274 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:53.497902 30164 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:53.478178 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.484582 30153 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:53.463347 30070 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:53.502447 30153 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:53.498881 30164 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:53.503283 30153 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.502279 26650 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:53.505858 26650 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:53.511660 27243 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:53.519994 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 919) took 1071 ms. Trace:
I20260709 13:10:53.520498 27271 rpcz_store.cc:276] 0709 13:10:52.448562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.448683 (+   121us) service_pool.cc:224] Handling call
0709 13:10:52.480429 (+ 31746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.513544 (+ 33115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.519543 (+1005999us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b5400668d50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:53.519789 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72153856}
I20260709 13:10:53.526737 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1935) took 2079 ms. Trace:
I20260709 13:10:53.527316 26583 rpcz_store.cc:276] 0709 13:10:51.447403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.792641 (+345238us) service_pool.cc:224] Handling call
0709 13:10:51.792993 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.367222 (+574229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.526081 (+1158859us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54000d9b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:53.526476 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316233472}
I20260709 13:10:53.530153 30070 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:53.530812 30070 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.531272 30070 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:53.534783 26654 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:53.322513 30247 consensus_meta.cc:287] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.083s	user 0.010s	sys 0.002s
I20260709 13:10:53.604142 30320 raft_consensus.cc:3055] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:53.604033 30247 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.236084 30238 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:53.230732 30339 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.537283 26654 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:10:53.637357 26654 pending_rounds.cc:85] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 4
I20260709 13:10:53.637878 26654 pending_rounds.cc:107] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:10:53.638271 26654 raft_consensus.cc:2889] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:53.168779 30367 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:53.328181 30394 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:10:53.605074 30320 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:53.644619 26507 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:53.645850 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:53.645720 30320 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:53.646633 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 247353us
I20260709 13:10:53.647779 30320 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:53.648252 26625 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:53.649346 30247 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:53.650341 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1940) took 1256 ms. Trace:
I20260709 13:10:53.650930 26582 rpcz_store.cc:276] 0709 13:10:52.393829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.394097 (+   268us) service_pool.cc:224] Handling call
0709 13:10:52.394550 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.395011 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.395058 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.395732 (+   674us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.705355 (+309623us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:52.705391 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.705453 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.649745 (+944292us) raft_consensus.cc:1685] finished
0709 13:10:53.649790 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.650067 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3370,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":283156,"threads_started":1,"wal-append.queue_time_us":681753}
I20260709 13:10:53.611240 26508 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:53.167344 30337 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.612558 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:53.613691 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:53.614167 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:53.614707 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.623974 26658 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:53.618837 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 693) took 1062 ms. Trace:
I20260709 13:10:53.625875 30005 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:53.699267 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.251454 30405 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.737439 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:53.712330 27240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.107s	user 0.048s	sys 0.046s
I20260709 13:10:53.726819 26508 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:53.727478 26656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.039s
W20260709 13:10:53.743657 26622 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.017s	sys 0.022s
I20260709 13:10:53.752174 26584 rpcz_store.cc:276] 0709 13:10:52.450044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.451093 (+  1049us) service_pool.cc:224] Handling call
0709 13:10:53.511780 (+1060687us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54002aa3d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:53.512052 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1526091008}
W20260709 13:10:53.765781 27240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.161s	user 0.048s	sys 0.046s
W20260709 13:10:53.736086 30111 consensus_meta.cc:287] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.010s
W20260709 13:10:53.771564 26656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.009s	sys 0.039s
W20260709 13:10:53.729092 30368 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.958s	user 0.000s	sys 0.021s
W20260709 13:10:53.767930 26622 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.017s	sys 0.022s
I20260709 13:10:53.652949 30321 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:53.730165 30272 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:53.757982 30367 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:53.750936 30070 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.778380 30368 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:53.778705 26509 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:10:53.779034 30164 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:53.779184 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 1.17444e+06us
I20260709 13:10:53.775915 27243 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:53.776410 26654 raft_consensus.cc:1275] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:10:53.803550 26576 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.019s	sys 0.026s
I20260709 13:10:53.804256 30111 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:53.816798 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.835701 26576 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.020s	sys 0.027s
W20260709 13:10:53.840713 26657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.000s	sys 0.016s
I20260709 13:10:53.841816 30005 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:53.842154 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2055) took 1100 ms. Trace:
I20260709 13:10:53.842327 30005 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.842828 30005 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:53.842602 26655 rpcz_store.cc:276] 0709 13:10:52.741244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.741401 (+   157us) service_pool.cc:224] Handling call
0709 13:10:52.853763 (+112362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.854073 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:53.406555 (+552482us) log.cc:844] Serialized 14 byte log entry
0709 13:10:53.777470 (+370915us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.808075 (+ 30605us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:53.841771 (+ 33696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.841887 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.842074 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":407938,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3052,"raft.queue_time_us":7846,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":60967,"thread_start_us":903524,"threads_started":2}
W20260709 13:10:53.844559 30283 consensus_meta.cc:287] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.004s
I20260709 13:10:53.807477 30213 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.846078 30213 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.848961 30213 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:53.779757 30339 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:53.841387 26658 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:53.851074 30262 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.962s	user 0.016s	sys 0.015s
I20260709 13:10:53.851240 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:53.851554 30262 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:53.854477 30070 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:53.855886 30212 consensus_meta.cc:287] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.343s	user 0.012s	sys 0.006s
I20260709 13:10:53.856297 30390 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:53.856856 30390 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:53.857511 30180 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:53.858033 26510 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:10:53.852036 26654 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:53.859198 30167 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.860190 30167 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:53.850139 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 78814.2us
W20260709 13:10:53.866771 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet fb7b25ba8d2644ceb86280e40ef3c8dc: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:10:53.869824 30396 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 1.142s	user 0.003s	sys 0.000s
I20260709 13:10:53.760778 29672 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:53.872112 30399 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.945s	user 0.000s	sys 0.002s
I20260709 13:10:53.874781 30296 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:53.875550 30296 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:53.877033 30393 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.986s	user 0.005s	sys 0.000s
I20260709 13:10:53.879690 30405 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:53.880753 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 500) took 1544 ms. Trace:
I20260709 13:10:53.881240 26506 rpcz_store.cc:276] 0709 13:10:52.335690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.360435 (+ 24745us) service_pool.cc:224] Handling call
0709 13:10:52.367043 (+  6608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.367414 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.367445 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.375583 (+  8138us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.598075 (+222492us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:52.598115 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.598179 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.866970 (+1268791us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:53.880153 (+ 13183us) raft_consensus.cc:1685] finished
0709 13:10:53.880180 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.880526 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":666,"raft.queue_time_us":7156,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":12264,"spinlock_wait_cycles":155945856,"thread_start_us":171287,"threads_started":1,"wal-append.queue_time_us":314974}
I20260709 13:10:53.883279 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:53.883930 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:53.884200 26505 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
W20260709 13:10:53.884761 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 652204us
I20260709 13:10:53.831007 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:53.845276 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:53.851523 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:53.845105 30283 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:53.894629 30409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.025s	sys 0.029s
W20260709 13:10:53.895251 30409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.025s	sys 0.030s
I20260709 13:10:53.896411 30283 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:53.897799 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:53.899075 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:53.900298 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:53.901927 30390 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.903061 30390 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:53.904325 30365 consensus_meta.cc:287] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.827s	user 0.003s	sys 0.013s
I20260709 13:10:53.904860 30365 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:53.896625 30324 consensus_meta.cc:287] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.977s	user 0.016s	sys 0.002s
I20260709 13:10:53.911785 26501 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:53.915015 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:53.916970 26505 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:53.921253 29672 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:53.922284 30416 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.597s	user 0.000s	sys 0.003s
I20260709 13:10:53.923036 30153 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:53.925203 30316 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:53.925686 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:53.926014 26508 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:53.926406 27278 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:53.926693 30287 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:53.944698 26549 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:53.952225 26650 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:53.953382 27271 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:53.955276 26504 raft_consensus.cc:2410] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:53.927178 30287 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:53.964607 27275 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:53.966099 30296 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:53.961066 30213 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:10:53.971058 30320 raft_consensus.cc:3055] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:53.971594 30320 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:53.978499 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:53.980587 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:53.984028 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:53.973037 30320 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.986940 30320 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:53.987047 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 80727.1us
I20260709 13:10:53.987633 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2065) took 1207 ms. Trace:
I20260709 13:10:53.988214 26657 rpcz_store.cc:276] 0709 13:10:52.779928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.780126 (+   198us) service_pool.cc:224] Handling call
0709 13:10:52.780489 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.261165 (+480676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.261205 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.261860 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.862740 (+600880us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:53.862813 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.862926 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.987395 (+124469us) raft_consensus.cc:1685] finished
0709 13:10:53.987414 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.987570 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49543,"raft.queue_time_us":232779,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":72193,"thread_start_us":1025946,"threads_started":2,"wal-append.queue_time_us":635352}
W20260709 13:10:53.989840 30208 consensus_queue.cc:1175] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" responder_term: 10 status { last_received { term: 10 index: 9 } last_committed_idx: 7 last_received_current_leader { term: 10 index: 9 } }
W20260709 13:10:53.990796 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.990984 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:53.991094 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:54.007252 26658 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:53.947325 30262 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:53.993988 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:53.937620 30324 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:53.996480 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:53.998925 30423 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 13:10:54.000906 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.987736 30321 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:53.985381 26508 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:54.011264 26654 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:54.027788 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.028445 26577 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:54.029088 26583 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:54.029933 30365 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:54.020210 30153 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:53.962249 30283 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:54.031667 30287 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.033780 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:54.034833 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:53.995910 30418 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:54.064291 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.035980 29672 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:54.076409 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.085183 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 298630us
I20260709 13:10:54.086185 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:54.087051 26581 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:54.089673 26578 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:54.090472 30005 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.047930 30111 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:54.096400 26655 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:54.069360 30321 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:54.149665 26579 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:54.098747 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:54.240752 26658 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:54.165757 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.076113 30070 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.243789 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:54.151211 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:54.128440 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2064) took 1173 ms. Trace:
I20260709 13:10:54.235227 30005 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:54.150563 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:54.149430 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:10:54.168078 30392 log.cc:927] Time spent T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 1.272s	user 0.000s	sys 0.001s
I20260709 13:10:54.262478 26578 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:10:54.255419 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:54.123793 30287 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:54.149745 30247 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.269436 26580 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:54.265762 27271 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:54.271745 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:54.278796 26509 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:54.094558 30283 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.279958 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:54.279986 27275 raft_consensus.cc:2393] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:54.097741 29672 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.289101 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:54.168390 30418 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:54.291555 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 145000us
I20260709 13:10:54.293772 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.298797 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:54.277180 30111 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.300607 30324 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:54.296252 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:54.310753 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.311630 30087 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:54.273720 30070 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.264408 26659 rpcz_store.cc:276] 0709 13:10:52.778816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.779020 (+   204us) service_pool.cc:224] Handling call
0709 13:10:52.779552 (+   532us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:52.789180 (+  9628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.789223 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:52.794903 (+  5680us) log.cc:844] Serialized 52 byte log entry
0709 13:10:53.247024 (+452121us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:53.247070 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.247139 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.873764 (+626625us) spinlock_profiling.cc:243] Waited 985 us on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:53.927222 (+ 53458us) raft_consensus.cc:1685] finished
0709 13:10:53.927244 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.952488 (+ 25244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12759,"raft.queue_time_us":209601,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":20531,"spinlock_wait_cycles":2268160,"thread_start_us":460613,"threads_started":2,"wal-append.queue_time_us":519220}
W20260709 13:10:54.380221 30433 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.410s	user 0.000s	sys 0.003s
I20260709 13:10:54.394694 30087 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.317420 26585 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:10:54.313639 30339 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.300009 30247 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:54.397172 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.397204 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.315771 26581 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:54.378321 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:54.312467 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.292929 30365 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.313419 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 884) took 2107 ms. Trace:
I20260709 13:10:54.403234 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:54.313735 30406 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:54.419656 30284 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:54.420331 30284 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:54.421192 30391 log.cc:927] Time spent T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 1.718s	user 0.002s	sys 0.000s
I20260709 13:10:54.419696 30406 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:54.422377 30406 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:54.423448 30440 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
W20260709 13:10:54.427659 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.421097 26474 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:54.429898 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.432816 26580 raft_consensus.cc:2393] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:54.414264 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:54.433660 27270 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:54.435195 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:54.312201 30398 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.311914 30111 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:54.415678 30390 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:10:54.445884 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.475203 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2063) took 1710 ms. Trace:
W20260709 13:10:54.475630 30441 log.cc:927] Time spent T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:10:54.446007 26549 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:54.412289 27277 rpcz_store.cc:276] 0709 13:10:52.206120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.333175 (+127055us) service_pool.cc:224] Handling call
0709 13:10:52.333503 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.333900 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.333933 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.334379 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.587135 (+252756us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:52.587173 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.587237 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.166877 (+1579640us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:54.312938 (+146061us) raft_consensus.cc:1685] finished
0709 13:10:54.312962 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.313249 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8173,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":79,"spinlock_wait_cycles":113492864,"thread_start_us":226188,"threads_started":1,"wal-append.queue_time_us":355254}
I20260709 13:10:54.477701 30164 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:54.478793 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:54.451223 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.504123 27278 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:54.490700 27275 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:54.452220 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:54.491459 30442 log.cc:927] Time spent T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
W20260709 13:10:54.503259 30201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.433s	user 0.009s	sys 0.035s
I20260709 13:10:54.493213 30390 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.495975 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:54.542989 26504 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:54.457953 29404 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:54.526705 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 81212.9us
I20260709 13:10:54.477746 30267 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:54.482789 26652 rpcz_store.cc:276] 0709 13:10:52.764730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.779052 (+ 14322us) service_pool.cc:224] Handling call
0709 13:10:52.779460 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:53.223430 (+443970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.223473 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:53.285819 (+ 62346us) log.cc:844] Serialized 52 byte log entry
0709 13:10:53.738150 (+452331us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:53.738266 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.738362 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.379721 (+641359us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b24001f7f78. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f88296c29c4 00007f88296c0acb 00007f882987bdc9 00007f882987ba55 00007f882987b09d 00007f882c4ad10e 00007f882c4c488c 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221
0709 13:10:54.474711 (+ 94990us) raft_consensus.cc:1685] finished
0709 13:10:54.474732 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.475008 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"raft.queue_time_us":209174,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":21628,"spinlock_wait_cycles":68056320,"thread_start_us":720422,"threads_started":2,"wal-append.queue_time_us":545108}
I20260709 13:10:54.689967 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1933) took 1294 ms. Trace:
I20260709 13:10:54.670845 27270 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
W20260709 13:10:54.691624 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 270648us
W20260709 13:10:54.648911 26508 consensus_meta.cc:287] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.000s
I20260709 13:10:54.578444 26580 raft_consensus.cc:1240] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:54.693292 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.696053 26508 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
W20260709 13:10:54.641741 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.694216 26650 rpcz_store.cc:276] 0709 13:10:53.395792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.506558 (+110766us) service_pool.cc:224] Handling call
0709 13:10:53.506943 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.960067 (+453124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.689689 (+729622us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5400169254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:54.689896 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921416960}
I20260709 13:10:54.701408 27271 raft_consensus.cc:2410] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:54.689237 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:54.701169 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:54.544817 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:54.705982 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:54.443912 30339 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:54.643338 30449 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:10:54.565486 30201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.712s	user 0.010s	sys 0.036s
W20260709 13:10:54.642416 29826 consensus_meta.cc:287] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.189s	user 0.008s	sys 0.009s
I20260709 13:10:54.715245 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:54.700953 30267 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:54.628998 30111 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.640645 30345 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:54.510968 30365 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:54.720716 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.650002 30247 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:10:54.638473 30418 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:54.638175 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:54.737995 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 274052us
I20260709 13:10:54.709431 30389 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:54.732470 27273 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:54.739027 30223 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:10:54.739557 30337 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:54.740043 30447 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:54.740476 30447 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.740815 30447 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:54.741182 26502 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:54.743088 27271 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:54.735654 26476 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:54.726392 26474 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:54.726819 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.747215 27276 raft_consensus.cc:2393] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:54.586750 30398 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:54.714713 29404 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:54.757927 30070 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:54.758919 26584 raft_consensus.cc:2393] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:54.758803 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2250) took 1125 ms. Trace:
I20260709 13:10:54.760365 30389 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.762463 30406 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:54.765045 30083 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:54.765995 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:54.811540 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 63002.1us
I20260709 13:10:54.768888 26585 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:54.744495 30320 consensus_meta.cc:287] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.757s	user 0.013s	sys 0.000s
I20260709 13:10:54.769697 30208 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:54.771027 30390 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:54.772761 30411 log.cc:927] Time spent T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 1.447s	user 0.000s	sys 0.004s
I20260709 13:10:54.773744 30283 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:54.775856 30339 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:54.776459 30428 log.cc:927] Time spent T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.687s	user 0.002s	sys 0.000s
W20260709 13:10:54.778203 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 57122.7us
I20260709 13:10:54.778915 30374 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:54.523799 30321 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.779392 30167 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:54.779731 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:54.780529 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:54.781068 30345 raft_consensus.cc:697] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:54.785840 26504 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:54.833606 26508 raft_consensus.cc:2410] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:54.795145 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:54.809319 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:10:54.810503 26577 consensus_meta.cc:287] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.732s	user 0.005s	sys 0.005s
I20260709 13:10:54.833681 27273 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:54.834977 26577 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:54.712458 30284 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:54.766894 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.841818 26579 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:54.841902 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2711) took 1106 ms. Trace:
I20260709 13:10:54.843461 30398 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:54.845048 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2067) took 1712 ms. Trace:
I20260709 13:10:54.836365 27278 raft_consensus.cc:2393] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:54.845450 26656 rpcz_store.cc:276] 0709 13:10:53.132564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.132739 (+   175us) service_pool.cc:224] Handling call
0709 13:10:53.133205 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.209958 (+ 76753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.210011 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.210581 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.858140 (+647559us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:53.858242 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.858346 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.775738 (+917392us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:54.844736 (+ 68998us) raft_consensus.cc:1685] finished
0709 13:10:54.844756 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.844986 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76191,"raft.queue_time_us":78314,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"spinlock_wait_cycles":41900800,"thread_start_us":567313,"threads_started":1,"wal-append.queue_time_us":858875}
I20260709 13:10:54.814381 27271 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:54.850184 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2060) took 2101 ms. Trace:
I20260709 13:10:54.850608 26651 rpcz_store.cc:276] 0709 13:10:52.748251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.748982 (+   731us) service_pool.cc:224] Handling call
0709 13:10:52.749305 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:52.774009 (+ 24704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.774055 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:52.774994 (+   939us) log.cc:844] Serialized 52 byte log entry
0709 13:10:53.222249 (+447255us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:53.222292 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.222358 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.771810 (+1549452us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:54.849631 (+ 77821us) raft_consensus.cc:1685] finished
0709 13:10:54.849682 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.849984 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":205097,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":11530,"spinlock_wait_cycles":2444544,"thread_start_us":470958,"threads_started":2,"wal-append.queue_time_us":546268}
W20260709 13:10:54.852917 30395 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 1.951s	user 0.000s	sys 0.002s
I20260709 13:10:54.854997 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1948) took 2093 ms. Trace:
I20260709 13:10:54.855413 26576 rpcz_store.cc:276] 0709 13:10:52.761397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.761593 (+   196us) service_pool.cc:224] Handling call
0709 13:10:52.761999 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.914810 (+152811us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:53.902583 (+987773us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.300132 (+397549us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:54.309895 (+  9763us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:54.381757 (+ 71862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.854707 (+472950us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540032dcd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:54.854749 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.854922 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13369,"prepare.queue_time_us":960907,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":23641,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":56400,"spinlock_wait_cycles":350835456,"thread_start_us":1272105,"threads_started":2,"wal-append.queue_time_us":738655}
I20260709 13:10:54.816464 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.842934 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.861537 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:54.857517 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.808286 26503 rpcz_store.cc:276] 0709 13:10:53.609449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.630752 (+ 21303us) service_pool.cc:224] Handling call
0709 13:10:53.631365 (+   613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.731341 (+ 99976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.731375 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.732004 (+   629us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.938625 (+206621us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:53.938695 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.938789 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.734638 (+795849us) raft_consensus.cc:1685] finished
0709 13:10:54.734659 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.734810 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45315,"raft.queue_time_us":105808,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":146,"thread_start_us":197343,"threads_started":1,"wal-append.queue_time_us":362069}
W20260709 13:10:54.815054 26655 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.002s
I20260709 13:10:54.820086 27275 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:10:54.819659 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 67747.2us
I20260709 13:10:54.819862 26583 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:54.821683 26581 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:54.791859 30365 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:54.819054 30201 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:10:54.824862 30208 raft_consensus.cc:697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:54.828310 29404 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:54.830466 26509 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:10:54.831310 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.738049 30111 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.730563 30267 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:54.834527 26505 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:54.836352 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:54.852834 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2706) took 2371 ms. Trace:
I20260709 13:10:54.859714 26474 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:54.872735 26655 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:54.873281 27270 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:54.745802 29672 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:54.724607 29826 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:54.860056 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:54.842483 26506 rpcz_store.cc:276] 0709 13:10:53.734996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.884974 (+149978us) service_pool.cc:224] Handling call
0709 13:10:53.885508 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.993823 (+108315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.993851 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.994426 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.259239 (+264813us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:54.259642 (+   403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.259791 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.841654 (+581863us) raft_consensus.cc:1685] finished
0709 13:10:54.841673 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.841835 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31824,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":175,"spinlock_wait_cycles":115328,"thread_start_us":259612,"threads_started":1,"wal-append.queue_time_us":815800}
W20260709 13:10:54.858047 26510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 501) took 2497 ms (client timeout 3094 ms). Trace:
I20260709 13:10:54.882587 26657 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:54.879293 26578 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:54.879367 26580 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:54.881790 26585 raft_consensus.cc:2393] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:54.880815 26507 rpcz_store.cc:276] 0709 13:10:52.480939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.481485 (+   546us) service_pool.cc:224] Handling call
0709 13:10:52.481780 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.645191 (+1163411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.852561 (+1207370us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001842d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:54.852747 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2665079040}
I20260709 13:10:54.859292 30389 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:54.882722 26510 rpcz_store.cc:269] 0709 13:10:52.360788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.361649 (+   861us) service_pool.cc:224] Handling call
0709 13:10:54.857813 (+2496164us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54003ece54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:54.857966 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3438617984}
I20260709 13:10:54.887840 26584 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 5.
I20260709 13:10:54.888731 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:54.892829 26581 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:54.894984 26577 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:10:54.896304 26653 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:54.894682 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:54.872270 30316 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:10:54.904641 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:54.897516 30374 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:54.910966 30374 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:54.911446 30374 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:54.911676 29404 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:54.896258 30234 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.913849 29404 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:54.913975 30234 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.914285 30208 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.914932 30153 raft_consensus.cc:3055] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:54.915390 30153 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:54.916397 30153 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:54.917096 30234 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:54.897785 30406 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:54.918769 30406 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.919462 30406 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:54.925449 27271 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:10:54.921977 26548 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:54.934865 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.858395 30345 consensus_queue.cc:237] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:55.010303 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.893117 26580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:10:55.053993 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:55.116233 26580 raft_consensus.cc:606] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:55.054347 26579 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:55.124053 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:55.126641 27243 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:54.936331 30389 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.129938 30430 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:55.131138 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 217686us
I20260709 13:10:55.131950 30346 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:55.154013 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 294452us
I20260709 13:10:55.154917 30111 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:55.155331 30406 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:55.053645 30153 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:55.128779 26625 leader_election.cc:336] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.556s (SENT)
I20260709 13:10:55.127661 26585 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:55.097667 30458 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:55.156776 26506 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:10:55.230033 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 96352.3us
I20260709 13:10:54.925676 30447 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:55.235450 26625 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:55.237021 26506 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:55.240830 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:55.242583 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 403635us
I20260709 13:10:55.247448 26583 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:55.105073 30374 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:55.253769 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:55.247164 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:55.233695 30458 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:55.268210 26502 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:55.264685 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:55.269313 26585 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:55.271003 26580 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:55.269344 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:55.252928 30234 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:55.181957 30389 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:55.275596 26579 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:55.275693 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 153903us
I20260709 13:10:55.278339 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:55.262717 29826 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:55.228451 30430 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:55.270147 30296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.044s	sys 0.088s
I20260709 13:10:55.283298 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 606) took 1158 ms. Trace:
I20260709 13:10:55.273407 30406 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:55.288478 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 159726us
W20260709 13:10:55.291888 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.286615 27274 rpcz_store.cc:276] 0709 13:10:54.124706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.124828 (+   122us) service_pool.cc:224] Handling call
0709 13:10:54.236801 (+111973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.289835 (+ 53034us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:54.784755 (+494920us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.282824 (+498069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:55.282894 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:55.282996 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.283109 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.283238 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":545,"prepare.queue_time_us":103911,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":5806,"thread_start_us":848734,"threads_started":2}
I20260709 13:10:55.293977 26502 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:55.295285 26506 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:55.294397 26502 pending_rounds.cc:85] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 7
I20260709 13:10:55.303874 26502 pending_rounds.cc:107] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:55.304397 26502 raft_consensus.cc:2889] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:55.302827 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:55.289239 30296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.044s	sys 0.088s
W20260709 13:10:55.310915 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 75513.9us
I20260709 13:10:55.292790 30465 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.291926 30398 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:55.317977 26625 leader_election.cc:336] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.652s (SENT)
W20260709 13:10:55.318485 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 84854.7us
I20260709 13:10:55.313809 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:10:55.324430 26548 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:55.313055 29672 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:55.328792 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.313809 30406 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:55.295600 30201 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:10:55.331677 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:55.332831 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:55.333300 27275 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:55.333525 27270 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:10:55.337831 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:55.337296 30458 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:55.339252 30458 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:55.315253 29826 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:55.341867 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:55.326841 30447 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:55.343513 30316 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:55.375765 30316 raft_consensus.cc:697] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:55.381510 27275 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
W20260709 13:10:55.391381 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 67024.8us
I20260709 13:10:55.346753 30398 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.379747 30390 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.344596 30389 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:55.346339 30406 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:55.416945 26473 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:55.384027 30339 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.387861 30296 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:55.400804 30335 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.418948 26548 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:55.409484 30374 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:55.384490 30465 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:55.436408 30464 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:55.436017 30468 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:55.438050 30412 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:55.438560 30365 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:55.440184 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:55.440569 30346 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:55.442021 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.458712 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.441718 30353 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:10:55.442229 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:55.464368 27271 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:55.443346 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2716) took 1458 ms. Trace:
I20260709 13:10:55.443506 30296 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:55.437094 30339 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:55.410822 30167 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:10:55.455827 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1954) took 1415 ms. Trace:
I20260709 13:10:55.413436 30447 consensus_queue.cc:1059] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:55.444458 30234 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:55.410982 30390 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:55.433820 30208 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:55.465483 26505 rpcz_store.cc:276] 0709 13:10:53.984870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.718893 (+734023us) service_pool.cc:224] Handling call
0709 13:10:54.834264 (+115371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.880595 (+ 46331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.443126 (+562531us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002fc950. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:55.443273 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234519296}
W20260709 13:10:55.472563 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.414203 26404 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 4 to 6, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 6 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:10:55.473536 26582 rpcz_store.cc:276] 0709 13:10:54.040862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.746721 (+705859us) service_pool.cc:224] Handling call
0709 13:10:54.790386 (+ 43665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.791483 (+  1097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.791770 (+   287us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.817549 (+ 25779us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.273974 (+456425us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:55.274015 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.274099 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.455591 (+181492us) raft_consensus.cc:1685] finished
0709 13:10:55.455611 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.455760 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":447560,"threads_started":1,"wal-append.queue_time_us":581275}
I20260709 13:10:55.481995 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:55.483027 30208 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.483605 30208 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:55.484611 30465 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:55.486414 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 175936us
I20260709 13:10:55.422307 30398 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:55.451766 30335 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:55.457190 30412 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:55.496840 30447 raft_consensus.cc:3055] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:55.497650 30447 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:55.462584 30430 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:55.478011 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 199786us
I20260709 13:10:55.506139 27243 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:55.433781 29826 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:55.498889 30447 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:55.528384 26506 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:10:55.528990 26506 pending_rounds.cc:85] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 4
I20260709 13:10:55.529279 26506 pending_rounds.cc:107] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:55.529872 26506 raft_consensus.cc:2889] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:55.531862 27243 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:55.539064 26505 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:55.553313 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 97278.7us
I20260709 13:10:55.554131 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:55.492412 30374 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:10:55.566287 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:55.539392 30070 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:55.565659 26507 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:55.492825 30389 consensus_queue.cc:1059] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:10:55.565440 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 797) took 1251 ms. Trace:
W20260709 13:10:55.566933 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 238206us
I20260709 13:10:55.469956 30316 consensus_queue.cc:237] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:55.561825 26474 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:55.579244 30474 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.579689 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:55.580053 30447 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:55.585278 30466 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:10:55.585987 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:55.586572 26507 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:55.586946 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:55.587550 26582 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:55.587764 26507 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:55.588987 26507 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:55.577382 26658 rpcz_store.cc:276] 0709 13:10:54.313932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.369358 (+ 55426us) service_pool.cc:224] Handling call
0709 13:10:54.404335 (+ 34977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.714306 (+309971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.714339 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.730298 (+ 15959us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.276012 (+545714us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:55.276055 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.276139 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.565139 (+289000us) raft_consensus.cc:1685] finished
0709 13:10:55.565169 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.565355 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1618,"raft.queue_time_us":35009,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"thread_start_us":698642,"threads_started":2,"wal-append.queue_time_us":503128}
I20260709 13:10:55.552824 30346 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.558506 30247 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:55.537599 30234 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:55.576552 30460 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:10:55.558804 30320 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:10:55.611276 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:55.616477 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 54728.6us
W20260709 13:10:55.616855 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 199994us
I20260709 13:10:55.624449 26474 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:55.625895 26473 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:55.627467 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 67849us
I20260709 13:10:55.599735 30201 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:55.598047 30338 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:55.633193 30167 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:55.636255 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:55.637331 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1950) took 1389 ms. Trace:
I20260709 13:10:55.637405 26585 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
W20260709 13:10:55.638230 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.629051 30262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.149s	user 0.020s	sys 0.041s
I20260709 13:10:55.644057 26657 rpcz_store.cc:276] 0709 13:10:54.248158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.248310 (+   152us) service_pool.cc:224] Handling call
0709 13:10:54.881815 (+633505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.883007 (+  1192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.637088 (+754081us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54002da350. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:55.637259 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422090496}
I20260709 13:10:55.652858 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:55.596269 30472 consensus_queue.cc:1059] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:10:55.599882 30474 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:55.603407 30346 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:55.649768 30262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.020s	sys 0.042s
I20260709 13:10:55.644465 30430 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:55.645551 30406 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:55.694150 27272 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:55.695022 30153 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:55.695813 30153 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:55.651209 30321 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:55.699508 30474 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:55.701278 30346 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:55.701926 30346 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:55.702505 30346 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:55.702972 30346 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:55.704402 26582 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
W20260709 13:10:55.705327 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 69152us
I20260709 13:10:55.687022 30234 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:55.687808 30390 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:55.688944 30335 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:55.690034 30469 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:10:55.690161 30472 raft_consensus.cc:3055] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:55.690896 29826 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:55.691179 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:55.692005 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:55.692795 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:55.617928 30296 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:55.768537 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 115769us
I20260709 13:10:55.768684 26622 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:10:55.769131 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 62802.6us
I20260709 13:10:55.874784 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:55.770049 30470 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:10:55.773453 30374 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:55.642608 30247 consensus_queue.cc:1059] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:10:55.652110 30201 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:55.794162 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 213990us
W20260709 13:10:55.831861 30267 consensus_meta.cc:287] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.942s	user 0.010s	sys 0.002s
I20260709 13:10:55.794054 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1928) took 2400 ms. Trace:
W20260709 13:10:55.846204 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.859819 26576 raft_consensus.cc:1240] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:55.869606 26657 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:55.876561 26474 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:55.771039 30339 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:55.880720 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:56.611694 26658 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:55.663112 30167 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.165s
W20260709 13:10:55.785869 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.947095 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:56.551327 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:56.035805 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.827877 30472 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:10:55.966370 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 261129us
W20260709 13:10:56.081357 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.016855 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 398172us
I20260709 13:10:55.956460 27243 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:56.010636 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:55.827704 30479 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.282s
I20260709 13:10:55.973246 30267 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:56.062757 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.366835 29672 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.032s	user 0.011s	sys 0.002s
I20260709 13:10:56.074795 30262 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:55.953814 26653 rpcz_store.cc:276] 0709 13:10:53.394020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.491146 (+ 97126us) service_pool.cc:224] Handling call
0709 13:10:53.539375 (+ 48229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.899052 (+1359677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.774754 (+875702us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001f5c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:55.793942 (+ 19188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3110032256}
W20260709 13:10:56.240928 30365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.002s	sys 0.021s
W20260709 13:10:56.056890 30476 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:10:55.965284 30070 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:55.946483 30234 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.542061 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:56.087422 30284 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:55.633910 30412 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:56.366050 26651 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:56.545924 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:56.294219 26550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.008s	sys 0.026s
W20260709 13:10:56.612432 26508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2258) took 2092 ms (client timeout 1787 ms). Trace:
I20260709 13:10:55.921769 30345 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.459s
I20260709 13:10:56.645396 26501 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:10:56.646708 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.621583 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 745039us
I20260709 13:10:56.348768 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2268) took 1486 ms. Trace:
W20260709 13:10:56.605723 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 532475us
I20260709 13:10:56.647595 27271 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:56.703189 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:56.704721 26657 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:56.720852 26578 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:56.798101 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 841702us
W20260709 13:10:56.720821 30365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.010s	sys 0.028s
I20260709 13:10:56.402555 30201 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:56.872710 30350 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.724773 26583 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:56.870098 26656 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.019s	sys 0.065s
W20260709 13:10:56.874142 26656 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.019s	sys 0.065s
I20260709 13:10:56.720466 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:56.870568 26585 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:56.705618 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:56.704149 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 829428us
I20260709 13:10:56.086072 30247 raft_consensus.cc:3055] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:56.644883 30153 consensus_meta.cc:287] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.949s	user 0.010s	sys 0.002s
I20260709 13:10:56.545195 30087 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:56.709834 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:56.915449 26504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 514) took 1272 ms (client timeout 1503 ms). Trace:
W20260709 13:10:56.915927 26504 rpcz_store.cc:269] 0709 13:10:55.643148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.647989 (+1004841us) service_pool.cc:224] Handling call
0709 13:10:56.915378 (+267389us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.710412 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:56.199014 30477 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:56.916771 26581 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:56.869969 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 904) took 1001 ms. Trace:
I20260709 13:10:56.917457 27271 rpcz_store.cc:276] 0709 13:10:55.868325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.868680 (+   355us) service_pool.cc:224] Handling call
0709 13:10:56.869889 (+1001209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.759027 29672 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:56.546070 26509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 510) took 2551 ms (client timeout 2037 ms). Trace:
I20260709 13:10:56.876087 26655 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:56.426347 30458 consensus_meta.cc:287] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.079s	user 0.011s	sys 0.001s
I20260709 13:10:56.873293 30350 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:56.955749 26657 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:56.956344 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2075) took 1088 ms. Trace:
I20260709 13:10:56.956651 26657 rpcz_store.cc:276] 0709 13:10:55.966542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.010277 (+ 43735us) service_pool.cc:224] Handling call
0709 13:10:56.956279 (+946002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.877856 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:56.878280 30247 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:56.881691 26548 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:56.644258 30321 consensus_meta.cc:287] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.946s	user 0.040s	sys 0.058s
I20260709 13:10:56.873123 27243 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:56.709486 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:56.870275 26508 rpcz_store.cc:269] 0709 13:10:54.520411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.705537 (+185126us) service_pool.cc:224] Handling call
0709 13:10:56.612201 (+1906664us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400359b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:56.612359 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269970688}
W20260709 13:10:56.960273 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.882380 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:56.649535 30374 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:56.885620 30242 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.833701 30167 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:56.965886 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 92862us
I20260709 13:10:56.886533 30479 consensus_queue.cc:1059] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:56.888077 30480 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
I20260709 13:10:56.887394 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2269) took 2025 ms. Trace:
I20260709 13:10:56.967680 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:56.967675 26506 rpcz_store.cc:276] 0709 13:10:54.862388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.449985 (+587597us) service_pool.cc:224] Handling call
0709 13:10:55.450324 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.538087 (+ 87763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.886550 (+1348463us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b54000b4fd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:56.887136 (+   586us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173520256}
I20260709 13:10:56.871625 26502 rpcz_store.cc:276] 0709 13:10:54.861985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.332132 (+470147us) service_pool.cc:224] Handling call
0709 13:10:55.346493 (+ 14361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.377536 (+ 31043us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:55.602252 (+224716us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.218941 (+616689us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.219379 (+   438us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.347973 (+128594us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.348085 (+   112us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:56.348210 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.348372 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.348626 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177755,"prepare.queue_time_us":586122,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":135,"raft.queue_time_us":137748,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":57750,"thread_start_us":585102,"threads_started":2}
W20260709 13:10:56.887408 30483 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.417s	user 0.000s	sys 0.001s
W20260709 13:10:56.896819 30208 consensus_meta.cc:287] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.412s	user 0.011s	sys 0.000s
I20260709 13:10:56.897444 30153 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:56.969126 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:56.904168 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2794) took 2016 ms. Trace:
I20260709 13:10:56.905022 30412 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:56.905220 26658 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:56.906477 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:56.906872 30267 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:56.882932 30497 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:10:56.909374 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:56.910072 30488 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.979966 30488 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:56.849261 30491 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:56.987378 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.938200 26507 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.007s	sys 0.006s
W20260709 13:10:56.988018 26507 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.007s	sys 0.006s
I20260709 13:10:56.970397 26584 rpcz_store.cc:276] 0709 13:10:54.889432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.893331 (+  3899us) service_pool.cc:224] Handling call
0709 13:10:54.910356 (+ 17025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.053907 (+143551us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:55.329100 (+275193us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.903629 (+1574529us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b18001f82e0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882c4d14bc 00007f882981f48b 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f8829839455 00007f882c921060 00007f882c933716 00007f882c944287
0709 13:10:56.903766 (+   137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.903835 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:56.903905 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.903992 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.904106 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69537,"prepare.queue_time_us":8994,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":214255,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":42498,"spinlock_wait_cycles":463225728,"thread_start_us":730958,"threads_started":3,"wal-append.queue_time_us":919220}
I20260709 13:10:56.953137 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:56.953011 30070 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:56.885013 30234 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:56.953938 30472 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:56.848644 30346 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:56.718420 30262 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.013605 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 618) took 1560 ms. Trace:
I20260709 13:10:56.720602 30339 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:56.968401 26652 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:56.888067 26579 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:56.970407 27270 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:56.971467 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:56.974344 26650 raft_consensus.cc:1240] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:56.974555 26625 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:56.976009 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:56.970355 26502 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:10:56.986083 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:56.989221 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:57.019433 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 512) took 1376 ms. Trace:
I20260709 13:10:56.989904 26659 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:10:57.019925 26659 pending_rounds.cc:85] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 8
I20260709 13:10:57.019805 26502 rpcz_store.cc:276] 0709 13:10:55.642593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.968858 (+1326265us) service_pool.cc:224] Handling call
0709 13:10:57.019377 (+ 50519us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.014016 26655 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:57.020283 26659 pending_rounds.cc:107] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:57.020576 26659 raft_consensus.cc:2889] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:57.020941 26506 raft_consensus.cc:2410] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:10:56.994264 26577 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:56.998407 27243 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.005101 26654 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:56.999694 26504 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:56.987579 30491 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:56.966094 30321 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:56.974162 30345 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:56.934940 26509 rpcz_store.cc:269] 0709 13:10:53.994839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.290084 (+295245us) service_pool.cc:224] Handling call
0709 13:10:56.545884 (+2255800us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b5400194e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:56.546002 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212738304}
I20260709 13:10:57.017395 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:56.991021 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2074) took 1182 ms. Trace:
I20260709 13:10:57.032212 26658 rpcz_store.cc:276] 0709 13:10:55.791155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.791323 (+   168us) service_pool.cc:224] Handling call
0709 13:10:56.973615 (+1182292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.017995 30262 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:57.022555 26504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 513) took 1379 ms (client timeout 1617 ms). Trace:
I20260709 13:10:56.993374 30458 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:10:57.024192 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.026715 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 518) took 1340 ms. Trace:
W20260709 13:10:57.035163 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 159310us
I20260709 13:10:57.040373 26502 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:57.043839 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.044414 26506 rpcz_store.cc:276] 0709 13:10:55.686357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.975787 (+1289430us) service_pool.cc:224] Handling call
0709 13:10:57.026652 (+ 50865us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:57.037401 26504 rpcz_store.cc:269] 0709 13:10:55.642870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.952822 (+1309952us) service_pool.cc:224] Handling call
0709 13:10:57.022499 (+ 69677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.021127 26655 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:57.007443 30234 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:57.016562 27273 rpcz_store.cc:276] 0709 13:10:55.453252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.453385 (+   133us) service_pool.cc:224] Handling call
0709 13:10:55.453869 (+   484us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:55.454357 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.454387 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:55.455094 (+   707us) log.cc:844] Serialized 52 byte log entry
0709 13:10:55.948701 (+493607us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:56.717952 (+769251us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.805976 (+ 88024us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.007943 (+201967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.008017 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.008072 (+    55us) raft_consensus.cc:1685] finished
0709 13:10:57.008084 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.013383 (+  5299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79944,"prepare.queue_time_us":1008818,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":389253,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":15011,"thread_start_us":1178417,"threads_started":3,"wal-append.queue_time_us":1526439}
I20260709 13:10:56.982040 30242 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.040915 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 511) took 1398 ms. Trace:
I20260709 13:10:56.969199 30208 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.044569 26577 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:57.038182 30488 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:57.046217 30267 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:57.049105 30479 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:57.030743 30201 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.031136 30491 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:57.034422 26581 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:10:57.022786 30477 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.054584 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2277) took 1559 ms. Trace:
I20260709 13:10:57.054919 26503 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:57.068219 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 112940us
W20260709 13:10:57.055090 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.068697 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 517) took 1408 ms. Trace:
W20260709 13:10:57.068480 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 103509us
I20260709 13:10:57.069118 26503 rpcz_store.cc:276] 0709 13:10:55.660417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.044162 (+1383745us) service_pool.cc:224] Handling call
0709 13:10:57.054760 (+ 10598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.068449 (+ 13689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.068647 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.051934 30472 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:57.050321 30234 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:57.030320 30339 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.056363 26502 rpcz_store.cc:276] 0709 13:10:55.642269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.020561 (+1378292us) service_pool.cc:224] Handling call
0709 13:10:57.036278 (+ 15717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.040727 (+  4449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.040872 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.983374 30167 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.045717 30401 raft_consensus.cc:3055] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:57.071082 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.073254 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.096307 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2270) took 2233 ms. Trace:
I20260709 13:10:57.096434 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:57.096745 26505 rpcz_store.cc:276] 0709 13:10:54.862812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.479463 (+616651us) service_pool.cc:224] Handling call
0709 13:10:55.479836 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.546420 (+ 66584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.096068 (+1549648us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b540008cd54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:57.096247 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135694080}
I20260709 13:10:57.097719 30488 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:57.098083 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:57.098248 30488 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.098698 26581 raft_consensus.cc:2376] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10. Re-sending same reply.
I20260709 13:10:57.098886 30242 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.098080 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:57.099699 30511 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:57.099949 26505 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:57.037047 30247 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.106608 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.106920 30398 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.107290 26584 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:57.107352 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.097159 26502 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:57.108018 26579 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:57.108184 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2717) took 3123 ms. Trace:
I20260709 13:10:57.108907 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.109319 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.109885 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.110504 26580 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:57.111371 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.112084 26578 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:57.110033 30350 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.106715 30247 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:57.105294 26652 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:10:57.113552 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.108604 26501 rpcz_store.cc:276] 0709 13:10:53.985190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.720756 (+735566us) service_pool.cc:224] Handling call
0709 13:10:56.612330 (+1891574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.871988 (+259658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.108019 (+236031us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5400359b50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:57.108134 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4313575168}
I20260709 13:10:57.069224 26507 rpcz_store.cc:276] 0709 13:10:55.495197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.589750 (+ 94553us) service_pool.cc:224] Handling call
0709 13:10:55.590064 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.615306 (+ 25242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.615355 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.630125 (+ 14770us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.895460 (+265335us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:56.988371 (+1092911us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.054172 (+ 65801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.054294 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.054354 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:57.054372 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.054511 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3063,"prepare.queue_time_us":127448,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":24590,"raft.queue_time_us":78475,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":28187,"thread_start_us":1326918,"threads_started":3,"wal-append.queue_time_us":1058401}
I20260709 13:10:57.109484 26583 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
W20260709 13:10:57.119097 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 120806us
I20260709 13:10:57.078747 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:57.066198 30479 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:57.140223 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 62139.4us
I20260709 13:10:57.142055 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.072559 30477 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:57.142967 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2278) took 1641 ms. Trace:
I20260709 13:10:57.147233 26583 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:57.100301 30488 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.160984 26581 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:57.170151 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.171267 26655 raft_consensus.cc:2410] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:10:57.112632 30234 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:57.093343 30401 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:57.179936 26549 connection.cc:256] RPC call timeout handler was delayed by -1.2832694349999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260709 13:10:57.180478 30267 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.181245 30267 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:57.184429 30509 log.cc:927] Time spent T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:10:57.185520 26549 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:57.187896 30321 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:57.188515 30321 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:10:57.172392 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 129032us
I20260709 13:10:57.072237 30201 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.176859 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:57.194089 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.100250 30511 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.149904 30506 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.184360 30267 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:57.213495 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:57.206369 30512 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:57.210263 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.169924 30508 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:57.218232 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.228750 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.229641 26655 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 5.
I20260709 13:10:57.231415 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.233434 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.234364 26654 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:10:57.239219 26549 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:57.208469 30111 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:57.241554 26652 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:57.242834 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.246536 26658 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:57.242761 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.243572 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:57.248186 26650 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.172998 30398 consensus_queue.cc:1059] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:10:57.213529 30087 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:57.251075 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.218374 30493 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:57.257920 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 111875us
I20260709 13:10:57.273433 26657 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:57.249946 30111 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:57.251734 30087 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:57.291754 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 2a158e3bdc954edd8dde2444100459ef: Illegal state: Replica b9c3761688a64982ae1c4aeb758e09ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:10:57.226859 30153 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:10:57.288167 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 74714.4us
I20260709 13:10:57.284209 26404 catalog_manager.cc:5697] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.295750 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:57.296489 27274 raft_consensus.cc:2376] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7. Re-sending same reply.
I20260709 13:10:57.299183 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:57.147272 26510 rpcz_store.cc:276] 0709 13:10:55.501535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.014781 (+1513246us) service_pool.cc:224] Handling call
0709 13:10:57.015118 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.015347 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:57.035773 (+ 20426us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.136410 (+100637us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.142189 (+  5779us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.142528 (+   339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.142595 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:57.142670 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.142761 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.142903 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6698,"prepare.queue_time_us":22841,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":64,"raft.queue_time_us":763,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3700,"spinlock_wait_cycles":58959104,"thread_start_us":99534,"threads_started":1}
I20260709 13:10:57.301678 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:57.303936 27241 connection.cc:256] RPC call timeout handler was delayed by -1.5488159739998082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 13:10:57.304003 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:57.304461 27241 connection.cc:256] RPC call timeout handler was delayed by -1.5371159739997893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 13:10:57.305056 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:57.305820 27276 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:57.306412 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:57.306951 27273 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:57.307974 27270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 616) took 1867 ms. Trace:
I20260709 13:10:57.308354 27270 rpcz_store.cc:276] 0709 13:10:55.440897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.441401 (+   504us) service_pool.cc:224] Handling call
0709 13:10:55.441753 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.018293 (+1576540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.307753 (+289460us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54006117d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:57.307919 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3485411584}
I20260709 13:10:57.318511 30475 raft_consensus.cc:3055] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:57.319363 30475 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:57.322450 30458 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:57.323056 30458 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:57.323508 30458 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:57.323776 27241 connection.cc:256] RPC call timeout handler was delayed by -1.4372159739998551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 13:10:57.324476 27241 connection.cc:256] RPC call timeout handler was delayed by -1.35531597399995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 13:10:57.324900 27241 connection.cc:256] RPC call timeout handler was delayed by -1.3481159739999384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 13:10:57.325393 27241 connection.cc:256] RPC call timeout handler was delayed by -1.1111106219998419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:10:57.325863 27241 connection.cc:256] RPC call timeout handler was delayed by -1.0871159739999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 13:10:57.326253 27241 connection.cc:256] RPC call timeout handler was delayed by -1.0367159739998897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:10:57.242308 30365 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:10:57.311275 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1960) took 2892 ms. Trace:
I20260709 13:10:57.309528 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:57.332013 26576 rpcz_store.cc:276] 0709 13:10:54.418586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.878392 (+459806us) service_pool.cc:224] Handling call
0709 13:10:54.886904 (+  8512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.958250 (+1071346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.310954 (+1352704us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b54001a9fd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:57.311170 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236764032}
I20260709 13:10:57.333544 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:57.334342 27271 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:57.337109 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47943.2us
I20260709 13:10:57.226016 30508 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.273485 30398 consensus_queue.cc:1243] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:57.320550 30475 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.291304 30111 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.345630 26548 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.329423 30087 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.219417 30506 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.350960 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.335171 30296 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.331645 30208 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.357327 26657 raft_consensus.cc:2393] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:57.315287 30350 consensus_queue.cc:1059] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:10:57.290617 30284 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:10:57.358405 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 145000us
I20260709 13:10:57.336912 30346 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:10:57.364163 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 516) took 1719 ms. Trace:
I20260709 13:10:57.337252 30525 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:57.240065 30512 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.327589 30522 consensus_queue.cc:1059] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:10:57.367203 26509 rpcz_store.cc:276] 0709 13:10:55.644953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.032243 (+1387290us) service_pool.cc:224] Handling call
0709 13:10:57.032528 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.036285 (+  3757us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:57.192907 (+156622us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.362754 (+169847us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.363122 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.363641 (+   519us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.363710 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:57.363781 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.363870 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.364021 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17680,"prepare.queue_time_us":36044,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2341,"raft.queue_time_us":12805,"raft.run_wall_time_us":2483,"spinlock_wait_cycles":4765952,"thread_start_us":265825,"threads_started":2}
I20260709 13:10:57.347769 30234 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.376631 30290 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:57.378595 30290 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:57.282323 30321 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.260869 30401 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.252854 30479 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:57.384536 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.385183 30374 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:57.386716 30490 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:57.387157 30506 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:57.388104 30511 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:57.389135 27273 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
W20260709 13:10:57.390672 30513 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:10:57.391165 30365 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:57.405604 30475 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:57.396872 30508 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:57.402055 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:57.419279 26650 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:57.380025 30339 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:57.442799 26508 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:57.379396 30525 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:57.405835 30167 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.419615 30490 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:57.453593 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 144203us
I20260709 13:10:57.362231 30296 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:57.456677 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 108089us
W20260709 13:10:57.458597 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 107760us
I20260709 13:10:57.420059 30267 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:10:57.459097 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 219998us
I20260709 13:10:57.450294 30401 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:57.467486 26549 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:57.478099 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 112245us
W20260709 13:10:57.468227 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 105188us
I20260709 13:10:57.467021 27241 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:57.482239 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.483635 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.484081 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.484793 26581 raft_consensus.cc:2410] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:57.485662 30458 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.486035 26549 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:57.485993 30525 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.486975 30530 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:57.487622 30530 raft_consensus.cc:697] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:57.487907 30458 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:57.486559 30508 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:57.483649 27241 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:57.489709 26549 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:57.509203 26549 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.510253 26549 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:57.490301 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 224216us
I20260709 13:10:57.459863 30490 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:57.448113 30524 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:10:57.507479 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.493907 30346 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:10:57.526700 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 47211.3us
W20260709 13:10:57.530038 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 46453.4us
I20260709 13:10:57.534370 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:57.520301 30290 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:57.499727 30499 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:10:57.526437 30522 consensus_queue.cc:1243] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer b1f40e8672c549d3b4be7862ac07b7e2 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:57.540336 26625 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:57.542784 26476 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.544304 26476 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.517942 30284 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:10:57.533651 30234 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:57.532274 30534 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:57.527690 30168 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:10:57.565996 27273 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:57.542007 30500 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:57.568320 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:57.543511 27241 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:57.567508 26476 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.537374 30290 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:10:57.577811 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.596566 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.600409 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 67260.7us
I20260709 13:10:57.488500 30530 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.601261 26549 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.564646 30491 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:57.616034 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 50320.9us
W20260709 13:10:57.616930 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 50613.4us
I20260709 13:10:57.636333 26476 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:57.580533 30262 consensus_meta.cc:287] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 13:10:57.569641 30167 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:57.602319 30290 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:57.581885 30500 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.577693 30534 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:57.570019 30339 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:57.637715 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 94263us
I20260709 13:10:57.641603 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:57.540244 30541 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:10:57.564646 30477 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.614092 30346 raft_consensus.cc:697] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:57.644358 27241 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:57.661398 30505 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:57.661919 30505 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:10:57.641896 30534 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.606508 30512 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:57.662338 30505 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:57.662880 30512 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:57.663553 30512 raft_consensus.cc:697] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:57.664640 30512 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.664796 30111 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.645988 30547 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:57.666055 30547 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.666416 30547 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.667116 30111 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:57.642936 30500 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.647995 30507 raft_consensus.cc:3055] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:57.648697 30412 consensus_meta.cc:287] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.003s
I20260709 13:10:57.649955 30296 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:57.651289 30201 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.619555 30511 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.569916 30539 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:10:57.633630 30508 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:57.655032 26476 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.642030 30339 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.662281 27241 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:57.674579 26651 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:10:57.720923 26651 pending_rounds.cc:85] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 7
W20260709 13:10:57.720777 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 65809.8us
I20260709 13:10:57.721179 26651 pending_rounds.cc:107] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:10:57.721406 26651 raft_consensus.cc:2889] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:57.637530 30167 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.722012 26476 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:57.640703 30168 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:57.669525 30472 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.000s
I20260709 13:10:57.639869 30262 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.723516 30401 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:57.751830 30296 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.788995 30401 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.789575 30401 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:57.662138 30528 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:57.691545 30284 consensus_queue.cc:1059] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:10:57.790145 30528 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:10:57.669697 30247 consensus_meta.cc:287] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.001s
I20260709 13:10:57.730530 30167 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.791353 26582 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:10:57.791432 27276 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:10:57.791824 27274 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:57.673851 30507 raft_consensus.cc:740] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:10:57.781286 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 119056us
I20260709 13:10:57.719998 30511 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.789268 30296 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.751785 30525 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:57.790434 30262 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:57.795300 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 194110us
I20260709 13:10:57.675132 30534 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.724753 30339 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:57.790798 30528 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.730352 30553 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:57.821719 30346 consensus_queue.cc:237] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:57.823100 30546 log.cc:927] Time spent T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:10:57.823364 30493 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:57.825037 30290 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.786324 30508 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:57.798237 30533 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:57.853727 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 131776us
I20260709 13:10:57.820951 30547 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.832659 30553 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.868592 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:57.867947 29914 raft_consensus.cc:3055] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:57.851513 30493 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:57.802776 30472 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:10:57.806445 30087 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:57.916150 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 279454us
I20260709 13:10:57.856424 30525 raft_consensus.cc:697] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:57.800992 30507 consensus_queue.cc:260] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.857445 30168 raft_consensus.cc:697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:57.922693 30290 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:57.926132 30539 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:57.926626 30539 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.926946 30539 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.928296 30566 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:57.929940 30284 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:10:57.910832 30553 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.929972 30511 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.930527 30284 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.932690 30284 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.933743 30339 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:57.934993 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:57.936125 30339 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.814781 30505 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.940120 30296 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:57.941524 26581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:10:57.948148 26581 raft_consensus.cc:606] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:10:57.942919 26509 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:57.930135 30526 log.cc:927] Time spent T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.657s	user 0.005s	sys 0.000s
I20260709 13:10:57.944463 26503 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:57.913880 29914 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:57.968284 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:57.972195 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:57.937071 30528 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.975817 30528 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:57.976243 30550 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:57.978277 30389 raft_consensus.cc:3055] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:57.978514 30559 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:10:57.978617 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:57.980947 30087 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.985728 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:57.986334 26576 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.987849 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1963) took 1339 ms. Trace:
I20260709 13:10:57.988232 26582 rpcz_store.cc:276] 0709 13:10:56.648637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.703498 (+ 54861us) service_pool.cc:224] Handling call
0709 13:10:56.703818 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.791990 (+1088172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.987606 (+195616us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003d1654. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:57.987791 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500482432}
I20260709 13:10:57.978760 30389 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:57.989902 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:57.990176 30389 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.990908 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.991344 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:57.991482 30389 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.991955 26581 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 5.
I20260709 13:10:57.993722 30547 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.994915 30168 consensus_queue.cc:237] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.996517 30477 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:57.997478 30553 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:57.998842 30530 raft_consensus.cc:3055] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:57.999229 30530 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:57.999701 30553 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:58.000178 30530 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.001694 30524 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:58.002296 30525 consensus_queue.cc:237] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.003163 27243 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:58.003472 30531 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:58.003165 30524 consensus_queue.cc:1059] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:10:58.005805 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.006500 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.937775 30284 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:58.009061 26583 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:57.984886 30500 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.009855 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:58.005396 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 477609us
I20260709 13:10:58.012121 26576 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:10:58.013492 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:58.014993 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 158608us
I20260709 13:10:58.015082 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:58.001401 30530 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:58.021992 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 453704us
I20260709 13:10:58.022596 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:58.023131 26659 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.023069 26622 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:58.005334 30458 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.035492 26503 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:58.011605 30234 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:58.035928 26503 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:58.008917 30491 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:58.037938 26503 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.039722 30505 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:58.023931 30296 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:58.044931 26583 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:58.051873 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.054574 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.056396 26503 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.035706 30507 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:58.057732 26581 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:58.042109 30234 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.955843 30508 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.049376 30284 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:58.063599 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.032740 30549 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:10:58.071054 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 59235.4us
I20260709 13:10:58.071094 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:58.073338 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.075366 26652 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.081210 26652 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:58.049374 30528 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:10:58.082283 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:58.083240 26652 raft_consensus.cc:2410] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:10:58.068204 30490 consensus_meta.cc:287] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.541s	user 0.004s	sys 0.006s
I20260709 13:10:58.047863 30339 consensus_queue.cc:1059] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:58.058563 30296 raft_consensus.cc:697] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:10:58.090212 30534 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:58.090451 30528 raft_consensus.cc:3055] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:58.090847 30528 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:58.091287 26581 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:58.091652 30528 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.092837 30528 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:58.096240 30545 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:58.097153 30545 raft_consensus.cc:697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:58.098589 30545 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.101115 30339 consensus_queue.cc:1243] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:58.101711 30567 raft_consensus.cc:3055] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:58.101950 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 78991.4us
I20260709 13:10:58.102200 30567 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:58.101779 30564 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:58.059109 30087 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:58.103139 30567 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.103418 30087 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.106235 30296 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.103153 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:58.059394 30562 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:58.064790 30234 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.066190 30153 consensus_queue.cc:1059] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:10:58.071398 30284 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:58.116304 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:10:58.112417 26509 consensus_queue.cc:237] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:10:58.128014 27241 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:58.083392 30465 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:58.134322 26581 raft_consensus.cc:1217] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Deduplicated request from leader. Original: 5.4->[7.5-10.6]   Dedup: 7.5->[10.6-10.6]
I20260709 13:10:58.135146 26581 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: [7.5-10.6]
I20260709 13:10:58.137432 26582 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:58.142212 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:58.143046 26576 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.104465 30567 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:58.048205 29914 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.148124 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:58.148644 26578 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.111145 30087 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:58.119573 30524 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:58.165076 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 74106.3us
I20260709 13:10:58.173051 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:58.176087 26549 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:58.178376 30499 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:58.178968 30499 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:58.179800 30499 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.173790 26625 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:58.113284 30475 consensus_queue.cc:1059] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:10:58.188427 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:58.131772 30472 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:58.146610 30458 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:58.244282 26580 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:58.245434 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.173344 30553 raft_consensus.cc:3055] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:58.195317 30168 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:10:58.111933 30490 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.151392 30568 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.144596 30562 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:58.531687 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.502552 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.695554 30528 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:58.695899 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.695966 30528 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:58.607860 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.184618 30500 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:58.347810 26503 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:58.396770 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.697160 30528 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.383350 30472 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:58.699234 30528 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.332508 26578 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:10:58.699071 30472 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:58.696148 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.700780 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.439507 30533 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.701726 30168 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.702473 30168 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:58.624064 30569 log.cc:927] Time spent T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:10:58.466810 30374 raft_consensus.cc:3055] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:58.705273 30374 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:10:58.705646 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.469990 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 73515.8us
W20260709 13:10:58.707721 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.708099 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.711007 30562 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:58.711320 30563 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:58.382925 30465 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.712044 30563 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.324456 26576 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:58.712910 30465 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.713835 26581 raft_consensus.cc:2393] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:58.714635 30563 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:58.715325 30465 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:58.312305 30461 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 2.652s	user 0.045s	sys 0.052s
I20260709 13:10:58.715767 30490 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:10:58.689122 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 579662us
I20260709 13:10:58.718014 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:58.702379 30533 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.720715 30533 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:58.517410 30525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.011s	sys 0.007s
I20260709 13:10:58.201282 30531 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:58.668408 30247 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.722406 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:58.722594 30568 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.173408 30524 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.694900 30553 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:58.202726 30389 consensus_queue.cc:1059] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.497s
I20260709 13:10:58.762053 30389 consensus_queue.cc:1243] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:58.200456 30339 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.498s
I20260709 13:10:58.762797 30339 consensus_queue.cc:1243] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:58.762374 30553 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.723716 27273 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:58.724303 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:58.763497 30553 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:58.763846 27270 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:58.765604 30539 consensus_meta.cc:287] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.838s	user 0.006s	sys 0.006s
I20260709 13:10:58.766209 30539 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:58.767304 30558 log.cc:927] Time spent T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.847s	user 0.003s	sys 0.000s
I20260709 13:10:58.767874 30548 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.768564 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:58.731922 30465 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:58.724824 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:58.317966 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.385931 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:58.771457 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.698202 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:10:58.727633 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.728025 26504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.014s	sys 0.055s
W20260709 13:10:58.772625 26504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.014s	sys 0.055s
W20260709 13:10:58.728581 30573 log.cc:927] Time spent T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
I20260709 13:10:58.728498 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:58.729903 30572 log.cc:927] Time spent T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:10:58.793181 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.301750 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:58.687919 30577 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:10:58.731475 30353 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:10:58.746047 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:58.802915 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:58.803490 26657 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:58.803759 30493 consensus_meta.cc:287] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.857s	user 0.007s	sys 0.001s
I20260709 13:10:58.804337 30493 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:58.754139 30401 consensus_meta.cc:287] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.955s	user 0.007s	sys 0.005s
I20260709 13:10:58.805858 30401 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.808051 30401 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:58.754604 30568 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:58.755600 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:58.808992 26655 raft_consensus.cc:2376] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10. Re-sending same reply.
W20260709 13:10:58.757965 30284 consensus_meta.cc:287] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.003s
I20260709 13:10:58.809826 30284 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.810652 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:58.811246 26581 raft_consensus.cc:2376] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9. Re-sending same reply.
I20260709 13:10:58.812245 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.812755 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.813653 26584 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:58.813794 26505 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:58.765486 30524 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:58.724901 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.818696 26580 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 6: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:10:58.776564 26659 consensus_meta.cc:287] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.000s
I20260709 13:10:58.819857 26659 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:58.787015 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:58.787336 30539 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:58.788010 27270 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:58.787889 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.732364 30472 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:10:58.790349 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 64015.4us
I20260709 13:10:58.855760 26657 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:10:58.303638 30167 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.859737 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:10:58.790046 30531 raft_consensus.cc:697] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:58.797276 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:58.795727 30374 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:10:58.860548 26474 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.532s (SENT) [suppressed 26 similar messages]
I20260709 13:10:58.744096 30533 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:10:58.813064 30284 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:58.741293 30168 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:58.814832 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:58.787863 30549 raft_consensus.cc:993] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:10:58.815989 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:58.813277 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:58.721969 26476 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:10:58.741480 30525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.014s	sys 0.012s
I20260709 13:10:58.879217 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:58.846696 26503 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:58.880030 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:58.880551 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:58.846203 30087 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:58.881531 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:58.850055 26549 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:10:58.881192 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 159302us
I20260709 13:10:58.882623 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:58.882774 26549 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:58.882886 26476 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:58.851636 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.807121 30493 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:10:58.794546 30488 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:58.800808 30574 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 13:10:58.861123 26507 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:58.865463 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:58.867336 27270 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:58.868376 27240 connection.cc:256] RPC call timeout handler was delayed by -1.8376558289999139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:10:58.817706 30465 raft_consensus.cc:697] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:58.890235 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:58.890162 30531 consensus_queue.cc:237] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.891678 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:58.892285 26510 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:10:58.867475 26506 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:58.863598 30346 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.848433 30576 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.871788 30374 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.872687 27274 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:58.874023 30500 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.874157 30549 raft_consensus.cc:1081] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:10:58.877030 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:58.924556 26657 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:58.768894 30247 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.883230 26503 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:58.745247 30458 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.883896 26579 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:10:58.884189 26584 raft_consensus.cc:2368] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
I20260709 13:10:58.884449 26577 raft_consensus.cc:1240] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:58.794932 30548 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.886194 26625 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:58.886945 26504 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:58.894017 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:58.869828 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.918211 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:58.887197 30510 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:58.920686 30576 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.888527 30539 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:58.922200 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:58.942766 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45196.7us
I20260709 13:10:58.943975 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:58.944625 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:58.923039 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:58.882259 30542 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:58.931705 26510 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.947324 27270 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:58.931705 26582 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
W20260709 13:10:58.932557 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 72908.8us
I20260709 13:10:58.889186 30505 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:58.940037 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:58.940371 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:58.951220 26503 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:58.941810 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:58.945261 27278 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:10:58.903901 30525 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:58.949150 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:58.951412 26506 raft_consensus.cc:2393] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:58.974038 30539 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:58.992542 26657 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
W20260709 13:10:58.941493 30507 consensus_meta.cc:287] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.873s	user 0.006s	sys 0.006s
I20260709 13:10:58.993276 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:58.993443 30507 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:58.973132 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:58.951848 30510 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.994462 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:58.994683 26504 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:10:58.994868 26650 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.931221 30500 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.999570 26655 raft_consensus.cc:2410] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 12 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:10:58.993546 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:59.002825 26657 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
W20260709 13:10:58.997822 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 137309us
W20260709 13:10:59.004001 26474 leader_election.cc:336] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.573s (SENT)
W20260709 13:10:59.004876 26474 leader_election.cc:336] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.584s (SENT)
I20260709 13:10:58.995080 26506 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:10:59.005281 26474 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:59.006218 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:59.006291 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:10:59.004942 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 118960us
I20260709 13:10:58.995589 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:59.010677 26504 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
W20260709 13:10:59.015393 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 132677us
I20260709 13:10:59.018396 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:59.019563 26510 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:10:58.890169 30465 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:58.893069 30087 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:58.939811 30458 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.013727 30208 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:59.013916 30510 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:58.993394 30539 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:59.080971 30208 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:59.081161 26652 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:10:58.895202 30488 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.084295 30488 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:59.085145 30488 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.087621 26474 leader_election.cc:336] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.658s (SENT)
I20260709 13:10:59.005676 30490 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:10:58.956730 27240 connection.cc:256] RPC call timeout handler was delayed by -1.0750084639998931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31400000000000006s for a response
I20260709 13:10:59.088229 26474 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:59.106062 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.106909 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:59.115271 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:59.107882 27278 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:10:59.052954 26503 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:59.119386 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2725) took 1065 ms. Trace:
I20260709 13:10:59.119859 26503 rpcz_store.cc:276] 0709 13:10:58.053801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.940090 (+886289us) service_pool.cc:224] Handling call
0709 13:10:59.119305 (+179215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:58.924932 30346 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:59.092393 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2300) took 1028 ms. Trace:
I20260709 13:10:59.087517 30488 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:59.088927 30168 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.102142 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.056391 26625 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.128428 26510 rpcz_store.cc:276] 0709 13:10:58.057074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.892873 (+835799us) service_pool.cc:224] Handling call
0709 13:10:59.085518 (+192645us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:59.129944 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 155547us
W20260709 13:10:59.135398 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.136368 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.044602 26650 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:10:59.006165 30525 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:59.149837 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:59.158891 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:59.183758 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.004938 30505 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:10:59.196440 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:59.197278 26579 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:59.131129 30296 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.258813 27276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 948) took 1919 ms (client timeout 1608 ms). Trace:
I20260709 13:10:59.251130 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:59.210831 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:59.276734 27276 rpcz_store.cc:269] 0709 13:10:57.320668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.333252 (+ 12584us) service_pool.cc:224] Handling call
0709 13:10:59.239783 (+1906531us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b5400845154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:59.239914 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051548032}
I20260709 13:10:59.135035 30168 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:59.257184 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:10:59.278258 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 236901us
W20260709 13:10:59.280104 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.242518 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 822) took 1148 ms. Trace:
I20260709 13:10:59.280690 26652 rpcz_store.cc:276] 0709 13:10:58.094622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.889915 (+795293us) service_pool.cc:224] Handling call
0709 13:10:59.242297 (+352382us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400168354. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:59.242439 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436900736}
I20260709 13:10:59.197685 27277 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:59.212560 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:59.282830 27273 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.262382 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:59.284117 27274 raft_consensus.cc:2393] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:10:59.284590 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 128835us
I20260709 13:10:59.286947 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:10:59.286278 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.197293 30401 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:59.136524 30490 raft_consensus.cc:697] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:10:59.289994 26581 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:10:59.291496 30531 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:59.160652 30267 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:59.291992 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:10:59.254985 30234 consensus_meta.cc:287] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.125s	user 0.010s	sys 0.000s
I20260709 13:10:59.293357 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:59.433524 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:59.433985 27278 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:59.294744 26622 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:59.295357 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.295312 26625 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.053746 30389 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:59.396445 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 308850us
I20260709 13:10:59.171360 30589 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:59.254976 30530 consensus_meta.cc:287] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.229s	user 0.009s	sys 0.002s
W20260709 13:10:59.292467 30553 consensus_meta.cc:287] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.006s
I20260709 13:10:59.241864 30247 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:59.235877 30507 raft_consensus.cc:697] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:59.466370 27273 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
W20260709 13:10:59.436787 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 142130us
W20260709 13:10:59.602233 27240 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 2.037s (SENT)
I20260709 13:10:59.609723 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.609965 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:10:59.603014 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 307748us
W20260709 13:10:59.568754 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.266746 30523 raft_consensus.cc:3055] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:59.608410 26622 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.490052 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:59.611764 26625 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:59.612056 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.615696 27277 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:59.296247 30087 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:59.298012 30531 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:10:59.519241 30267 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:59.256457 30524 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.489549 30353 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.630698 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.642841 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.619333 30567 consensus_meta.cc:287] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.451s	user 0.011s	sys 0.000s
I20260709 13:10:59.456929 30510 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:59.659441 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.636072 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:59.618665 30458 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:10:59.643868 26474 leader_election.cc:336] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 2.353s (SENT)
W20260709 13:10:59.647879 26507 consensus_meta.cc:287] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.000s
I20260709 13:10:59.648495 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.667085 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:10:59.649433 26625 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:10:59.647913 26579 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:10:59.532024 30398 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:59.655813 26504 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:59.618134 30562 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.660208 26652 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:59.638305 30531 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:59.618495 30545 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:59.677062 26507 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:59.643872 30553 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.621948 30247 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:59.668251 27273 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:59.292507 30296 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.614809 30523 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:59.674907 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:59.675282 26656 raft_consensus.cc:2393] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:59.686312 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:59.456717 30542 raft_consensus.cc:697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:59.663667 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:10:59.687461 26582 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:59.677620 26507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2722) took 1630 ms (client timeout 1576 ms). Trace:
I20260709 13:10:59.678877 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:59.642153 30087 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:59.681944 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:59.489635 30234 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.685012 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:59.675526 26474 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.686528 26579 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.687335 26622 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.677857 26510 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:59.688416 26580 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
W20260709 13:10:59.688372 26507 rpcz_store.cc:269] 0709 13:10:58.046726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.796903 (+750177us) service_pool.cc:224] Handling call
0709 13:10:59.677531 (+880628us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:59.674603 30401 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.675244 30589 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:59.513031 30490 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.697402 26622 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.698572 27276 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:10:59.621397 30505 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.455588 30525 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:59.702216 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:10:59.706919 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.707397 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.707686 27269 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:10:59.659765 30353 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.679167 30595 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.693002 30510 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:59.702996 27272 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:10:59.706029 30346 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:59.685104 30597 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:59.711730 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:59.697718 30284 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.007s	sys 0.034s
I20260709 13:10:59.716092 26582 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:10:59.680922 30562 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:59.677482 30472 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:10:59.684724 30398 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:59.676952 30533 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:59.732013 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2282) took 2674 ms. Trace:
I20260709 13:10:59.720276 27274 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:59.702626 30458 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:59.735982 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 92156.8us
W20260709 13:10:59.736678 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.722631 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2819) took 1026 ms. Trace:
I20260709 13:10:59.737298 26582 rpcz_store.cc:276] 0709 13:10:58.696143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.639204 (+943061us) service_pool.cc:224] Handling call
0709 13:10:59.722569 (+ 83365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:59.703462 26579 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:10:59.723084 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:59.720762 30510 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.716866 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:59.727164 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1961) took 1027 ms. Trace:
I20260709 13:10:59.702633 30401 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:59.742365 27269 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:59.686451 30553 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.727828 30542 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:59.731392 30593 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:10:59.708717 30601 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:59.732508 26502 rpcz_store.cc:276] 0709 13:10:57.057254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.108524 (+ 51270us) service_pool.cc:224] Handling call
0709 13:10:57.108813 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.139630 (+ 30817us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:57.150970 (+ 11340us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.360768 (+209798us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.360831 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:57.360889 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.824855 (+463966us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b180038dd00. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882980a2a6 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db
0709 13:10:57.858749 (+ 33894us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:10:59.731769 (+1873020us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b54003ec954. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:10:59.731824 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.731960 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1977,"prepare.queue_time_us":117455,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":54161,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":112641024,"thread_start_us":209088,"threads_started":2,"wal-append.queue_time_us":121032,"wal-append.run_cpu_time_us":5570,"wal-append.run_wall_time_us":1701194}
I20260709 13:10:59.702356 30519 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:59.693425 30507 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.757728 30234 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:10:59.759636 30296 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:59.760536 30601 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:59.761004 30601 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.761608 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:10:59.762899 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:59.764129 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:59.719297 30595 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.776732 30595 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:59.717489 30087 consensus_queue.cc:1059] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:10:59.777874 30087 consensus_queue.cc:1243] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer b1f40e8672c549d3b4be7862ac07b7e2 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:59.778570 30087 raft_consensus.cc:3055] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:59.779001 30087 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:10:59.780335 30087 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.792995 30087 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:59.739210 26474 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.806607 30353 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:59.807420 30353 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:59.807552 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 68384.1us
I20260709 13:10:59.808650 26474 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.809468 30524 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:59.809900 30567 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:59.810993 30605 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:10:59.812621 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2298) took 1765 ms. Trace:
I20260709 13:10:59.813143 26509 rpcz_store.cc:276] 0709 13:10:58.047590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.088432 (+1040842us) service_pool.cc:224] Handling call
0709 13:10:59.131280 (+ 42848us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:59.151846 (+ 20566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.151893 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:59.175876 (+ 23983us) log.cc:844] Serialized 52 byte log entry
0709 13:10:59.672176 (+496300us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:59.672214 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.672274 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.812328 (+140054us) raft_consensus.cc:1685] finished
0709 13:10:59.812355 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.812531 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99043,"raft.queue_time_us":2357,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":34375,"thread_start_us":415176,"threads_started":1,"wal-append.queue_time_us":457486}
I20260709 13:10:59.815685 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:59.816866 26509 raft_consensus.cc:2410] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:59.735024 30530 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:10:59.740630 30167 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:59.720134 30597 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.818893 30530 consensus_queue.cc:1243] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:59.819263 30597 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:59.717703 30602 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.742260 26652 rpcz_store.cc:276] 0709 13:10:58.699364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.696216 (+996852us) service_pool.cc:224] Handling call
0709 13:10:59.727017 (+ 30801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:59.822188 30553 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:10:59.822276 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:10:59.823062 26652 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:10:59.823683 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1973) took 1113 ms. Trace:
I20260709 13:10:59.823992 26652 rpcz_store.cc:276] 0709 13:10:58.710606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.821982 (+1111376us) service_pool.cc:224] Handling call
0709 13:10:59.823625 (+  1643us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:59.825146 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:59.755745 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:59.827333 26502 raft_consensus.cc:2376] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8. Re-sending same reply.
I20260709 13:10:59.828339 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:59.829133 26502 raft_consensus.cc:2393] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:10:59.756397 26473 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:59.831493 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 75164.3us
I20260709 13:10:59.832268 26473 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.833204 30567 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:59.834167 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:59.835023 26502 raft_consensus.cc:2376] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9. Re-sending same reply.
I20260709 13:10:59.771504 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:59.838503 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:59.839385 26502 raft_consensus.cc:2393] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:10:59.722306 30284 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.034s
I20260709 13:10:59.818521 26474 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.744560 30510 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:59.821395 30602 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:10:59.728516 30523 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:10:59.839169 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:10:59.913165 27275 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:10:59.913726 27277 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:10:59.866701 26507 raft_consensus.cc:1217] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Deduplicated request from leader. Original: 7.6->[8.7-10.8]   Dedup: 8.7->[10.8-10.8]
I20260709 13:10:59.883896 30519 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:59.884568 30167 consensus_queue.cc:1059] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:59.885443 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 51956.3us
I20260709 13:10:59.916932 26473 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.915197 26507 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:10:59.738590 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:59.888918 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:10:59.921322 30523 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:59.921759 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2113) took 1073 ms. Trace:
I20260709 13:10:59.922308 26652 rpcz_store.cc:276] 0709 13:10:58.848632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.888601 (+1039969us) service_pool.cc:224] Handling call
0709 13:10:59.921684 (+ 33083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:59.923523 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:10:59.896790 30374 consensus_meta.cc:287] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.968s	user 0.009s	sys 0.002s
I20260709 13:10:59.925218 30374 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:59.927909 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:59.929823 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:59.898967 27269 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:10:59.904986 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:10:59.942245 26503 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:10:59.905263 30531 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:10:59.910501 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 92095.9us
W20260709 13:10:59.950609 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.951475 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.951875 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.910706 26508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 515) took 4267 ms (client timeout 1867 ms). Trace:
W20260709 13:10:59.956341 26508 rpcz_store.cc:269] 0709 13:10:55.643420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.966588 (+1323168us) service_pool.cc:224] Handling call
0709 13:10:59.910524 (+2943936us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54002fba54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:10:59.910640 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972582272}
I20260709 13:10:59.804857 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:10:59.956959 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:59.915550 30519 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:59.912431 30353 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:59.920495 30602 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:10:59.946463 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2817) took 1250 ms. Trace:
I20260709 13:10:59.962206 26579 rpcz_store.cc:276] 0709 13:10:58.695602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.929433 (+1233831us) service_pool.cc:224] Handling call
0709 13:10:59.946404 (+ 16971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:59.964787 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.909500 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:59.964123 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:59.967374 26502 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:10:59.976343 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:59.957937 26503 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
W20260709 13:10:59.960749 26474 leader_election.cc:336] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 2.452s (SENT)
I20260709 13:10:59.978083 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:10:59.961436 26625 leader_election.cc:336] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.776s (SENT)
I20260709 13:10:59.978986 26625 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.980458 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:10:59.980938 26622 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:10:59.992470 26580 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [7.6-8.7]
I20260709 13:10:59.981386 26503 raft_consensus.cc:2368] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12.
I20260709 13:10:59.996142 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.011525 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:00.012609 26502 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:00.013109 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.981878 30458 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:59.963105 30519 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:59.999706 26579 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:00.019263 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.019526 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1994) took 1302 ms. Trace:
W20260709 13:11:00.019925 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 59227.8us
I20260709 13:10:59.962975 30353 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:10:59.996321 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2820) took 1299 ms. Trace:
W20260709 13:11:00.020287 26625 leader_election.cc:336] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.834s (SENT)
I20260709 13:11:00.021384 26625 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:00.019981 26579 rpcz_store.cc:276] 0709 13:10:58.716935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.964227 (+1247292us) service_pool.cc:224] Handling call
0709 13:10:59.999269 (+ 35042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.019241 (+ 19972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.019470 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:00.015252 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 98386.8us
I20260709 13:10:59.994652 30267 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:00.019935 26503 raft_consensus.cc:2368] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12.
W20260709 13:11:00.009066 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 274693us
I20260709 13:10:59.997344 30505 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.015362 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.020874 26580 rpcz_store.cc:276] 0709 13:10:58.696390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.960063 (+1263673us) service_pool.cc:224] Handling call
0709 13:10:59.992154 (+ 32091us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:59.995981 (+  3827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.996256 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.019179 30616 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:00.028640 26580 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:00.024585 26579 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:00.032640 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2822) took 1296 ms. Trace:
I20260709 13:11:00.032950 26579 rpcz_store.cc:276] 0709 13:10:58.736033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.022474 (+1286441us) service_pool.cc:224] Handling call
0709 13:11:00.022834 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.032354 (+  9520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.032597 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.026183 26548 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:00.023766 30353 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:00.026345 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.027241 30609 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:00.035980 30609 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:00.036401 30609 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:00.010879 30601 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:00.039423 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:00.040158 26578 raft_consensus.cc:2368] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10.
I20260709 13:11:00.040248 30601 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:00.040634 26578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2810) took 1737 ms (client timeout 1776 ms). Trace:
I20260709 13:11:00.035121 30505 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:00.043774 30548 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:00.044080 30505 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:00.045190 30567 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:00.027226 30458 raft_consensus.cc:697] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:00.046113 30479 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:00.046578 30458 consensus_queue.cc:237] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:00.050889 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 725) took 1176 ms. Trace:
I20260709 13:11:00.051761 30475 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:00.051311 26579 rpcz_store.cc:276] 0709 13:10:58.858065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.033513 (+1175448us) service_pool.cc:224] Handling call
0709 13:11:00.033842 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.034029 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.034053 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.034102 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:00.034154 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.034232 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.034497 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.053658 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 724) took 1196 ms. Trace:
I20260709 13:11:00.054111 26580 rpcz_store.cc:276] 0709 13:10:58.857713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.028106 (+1170393us) service_pool.cc:224] Handling call
0709 13:11:00.028461 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.053352 (+ 24891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.053597 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.054613 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:00.056015 26579 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:00.041074 26578 rpcz_store.cc:269] 0709 13:10:58.303330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.700309 (+396979us) service_pool.cc:224] Handling call
0709 13:11:00.039268 (+1338959us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b5800003098. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:11:00.040569 (+  1301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15546624}
I20260709 13:11:00.009668 30597 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.057479 30365 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:00.077318 26502 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:11:00.060154 26473 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:00.079357 30505 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:00.080035 30597 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:00.080492 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.082230 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:00.082590 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:00.083294 26502 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:00.083328 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:00.084199 26576 raft_consensus.cc:2410] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:11:00.084594 26576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2812) took 1780 ms (client timeout 1922 ms). Trace:
W20260709 13:11:00.086861 26655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1969) took 1385 ms (client timeout 1617 ms). Trace:
I20260709 13:11:00.087499 30609 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:00.088094 26473 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:00.088869 30615 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:00.089130 26473 consensus_peers.cc:597] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 941b69cce0d24bb9a4f60558447429c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:00.089313 30615 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.089731 30615 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:00.092284 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:00.092823 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.093319 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.093942 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:00.094738 27276 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:00.075661 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.096338 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2818) took 1400 ms. Trace:
I20260709 13:11:00.096465 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:00.096755 26581 rpcz_store.cc:276] 0709 13:10:58.695871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.813064 (+117193us) service_pool.cc:224] Handling call
0709 13:11:00.096073 (+1283009us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540015ca54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.096277 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699672832}
I20260709 13:11:00.097335 30472 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:00.098124 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.098080 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:00.098541 30609 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:00.098794 26581 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:00.099203 30609 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:00.099556 30505 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.095713 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:00.100399 27278 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:11:00.100315 30505 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:00.099222 26583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 718) took 2114 ms (client timeout 1706 ms). Trace:
W20260709 13:11:00.109336 26625 leader_election.cc:336] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.922s (SENT)
W20260709 13:11:00.101330 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.105458 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:00.114364 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:00.105839 26578 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 8. Ops: []
W20260709 13:11:00.101478 26583 rpcz_store.cc:269] 0709 13:10:57.984689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.989652 (+  4963us) service_pool.cc:224] Handling call
0709 13:11:00.099004 (+2109352us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b54000d9654. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.099116 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42547584}
I20260709 13:11:00.121290 26476 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:00.121335 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:00.122481 26476 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:00.087282 26655 rpcz_store.cc:269] 0709 13:10:58.701370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.815766 (+114396us) service_pool.cc:224] Handling call
0709 13:11:00.086670 (+1270904us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400108954. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.086795 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297289472}
I20260709 13:11:00.098562 26502 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:00.081461 26659 raft_consensus.cc:2410] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:00.103824 26651 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:00.123649 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.123792 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.124383 26655 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:00.106928 27241 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:00.124892 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1978) took 1399 ms. Trace:
I20260709 13:11:00.097081 27269 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
W20260709 13:11:00.084905 26576 rpcz_store.cc:269] 0709 13:10:58.304138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.714649 (+410511us) service_pool.cc:224] Handling call
0709 13:11:00.083191 (+1368542us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b5800003098. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:11:00.084541 (+  1350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14388992}
I20260709 13:11:00.117249 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2299) took 2069 ms. Trace:
I20260709 13:11:00.059779 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:00.126157 26503 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:00.125787 26510 rpcz_store.cc:276] 0709 13:10:58.048230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.134356 (+1086126us) service_pool.cc:224] Handling call
0709 13:10:59.677684 (+543328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.691149 (+ 13465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.116995 (+425846us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54000b3bd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.117174 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120665984}
I20260709 13:11:00.125233 26655 rpcz_store.cc:276] 0709 13:10:58.725919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.123431 (+1397512us) service_pool.cc:224] Handling call
0709 13:11:00.124842 (+  1411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.127301 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.122526 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:00.128100 26583 raft_consensus.cc:2376] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10. Re-sending same reply.
I20260709 13:11:00.060846 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2824) took 1175 ms. Trace:
I20260709 13:11:00.128556 26579 rpcz_store.cc:276] 0709 13:10:58.882177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.055629 (+1173452us) service_pool.cc:224] Handling call
0709 13:11:00.055868 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.057821 (+  1953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.057981 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.129252 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:00.129911 30616 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:00.130888 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.131172 30153 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.131693 26510 raft_consensus.cc:2410] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:00.131978 30153 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.127731 26655 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:00.133428 30488 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:00.133500 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1972) took 1423 ms. Trace:
I20260709 13:11:00.134150 26655 rpcz_store.cc:276] 0709 13:10:58.710168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.127142 (+1416974us) service_pool.cc:224] Handling call
0709 13:11:00.133310 (+  6168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.134790 29914 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.135149 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.135325 30153 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:00.132504 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.135979 26581 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:00.136251 26510 raft_consensus.cc:2410] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:00.063546 30510 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.136847 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:00.099731 30609 raft_consensus.cc:697] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:00.136252 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:00.063735 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 726) took 1201 ms. Trace:
I20260709 13:11:00.138386 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1966) took 1437 ms. Trace:
I20260709 13:11:00.124444 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2094) took 2117 ms. Trace:
I20260709 13:11:00.138964 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:00.138799 26659 rpcz_store.cc:276] 0709 13:10:58.700589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.080251 (+1379662us) service_pool.cc:224] Handling call
0709 13:11:00.138332 (+ 58081us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.138682 26580 rpcz_store.cc:276] 0709 13:10:58.858375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.054939 (+1196564us) service_pool.cc:224] Handling call
0709 13:11:00.059334 (+  4395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.059510 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.059532 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.059575 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:00.059610 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.059691 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.059783 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.139433 26651 rpcz_store.cc:276] 0709 13:10:58.007065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.103007 (+2095942us) service_pool.cc:224] Handling call
0709 13:11:00.103385 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.124216 (+ 20831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.124383 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.142467 27240 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:00.137950 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:00.143755 26581 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
W20260709 13:11:00.070027 30579 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 1.219s	user 0.006s	sys 0.012s
W20260709 13:11:00.071009 30570 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 1.738s	user 0.008s	sys 0.017s
I20260709 13:11:00.154843 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.165800 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1955) took 1467 ms. Trace:
I20260709 13:11:00.166572 26659 rpcz_store.cc:276] 0709 13:10:58.697884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.154579 (+1456695us) service_pool.cc:224] Handling call
0709 13:11:00.165740 (+ 11161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.170617 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:00.057319 30531 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:00.103188 30468 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.182328 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.109959 30296 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.102847 30505 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:00.191284 26503 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:00.195348 26580 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:00.063831 30567 consensus_queue.cc:1059] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:11:00.174016 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.196007 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.192530 26502 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:00.196806 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.173403 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:00.185050 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:00.112587 30353 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:00.197132 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.246165 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.422456 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:00.423431 26659 raft_consensus.cc:2410] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 12 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:00.148044 30167 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:00.166034 30234 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:00.422595 26502 raft_consensus.cc:2393] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:00.433362 26651 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:00.214169 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.244927 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.165716 30247 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:00.194388 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 71986.5us
I20260709 13:11:00.156806 30533 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:00.209663 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.443262 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 96264.5us
I20260709 13:11:00.436089 27240 leader_election.cc:400] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12.
I20260709 13:11:00.444020 27240 leader_election.cc:403] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:00.211975 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 61414.2us
I20260709 13:11:00.438280 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:00.438294 26503 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:00.441450 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1956) took 1743 ms. Trace:
I20260709 13:11:00.437156 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:00.190073 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 80764.1us
I20260709 13:11:00.188457 30609 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.444463 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.766151 26659 raft_consensus.cc:2393] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:00.508848 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2825) took 1626 ms. Trace:
I20260709 13:11:00.766891 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1987) took 1029 ms. Trace:
I20260709 13:11:00.767401 26659 rpcz_store.cc:276] 0709 13:10:59.737922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.444191 (+706269us) service_pool.cc:224] Handling call
0709 13:11:00.766818 (+322627us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.767030 26578 rpcz_store.cc:276] 0709 13:10:58.882429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.058283 (+1175854us) service_pool.cc:224] Handling call
0709 13:11:00.105675 (+ 47392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.120795 (+ 15120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.508594 (+387799us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b54000d9650. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.508775 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97207552}
I20260709 13:11:00.196228 30153 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.768762 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:00.769070 26578 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:00.512491 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2719) took 2471 ms. Trace:
W20260709 13:11:00.585991 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 143248us
I20260709 13:11:00.675380 30353 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:00.771867 26476 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:00.195868 30468 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.430925 30234 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.511353 26655 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:00.474210 30600 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.773820 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 349901us
I20260709 13:11:00.507958 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:00.503822 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:00.775594 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.800825 26503 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
W20260709 13:11:00.801034 26585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2811) took 2497 ms (client timeout 1834 ms). Trace:
I20260709 13:11:00.715168 30479 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:00.776031 26651 rpcz_store.cc:276] 0709 13:10:58.698126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.155283 (+1457157us) service_pool.cc:224] Handling call
0709 13:11:00.441383 (+286100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.500475 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2290) took 2558 ms. Trace:
W20260709 13:11:00.776625 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 188934us
I20260709 13:11:00.506804 26584 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:00.806299 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:00.502666 30208 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:00.252131 30505 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:00.500391 30538 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12.
I20260709 13:11:00.770331 26506 rpcz_store.cc:276] 0709 13:10:58.041228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.055398 (+1014170us) service_pool.cc:224] Handling call
0709 13:10:59.285301 (+229903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.637791 (+352490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.637837 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.637893 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:59.637946 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.512179 (+874233us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54001833d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:00.512270 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.512424 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809971456}
I20260709 13:11:00.805250 26501 rpcz_store.cc:276] 0709 13:10:57.941621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.941757 (+   136us) service_pool.cc:224] Handling call
0709 13:10:57.942132 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:57.942532 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:57.942767 (+   235us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.057791 (+115024us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:58.064369 (+  6578us) log.cc:844] Serialized 52 byte log entry
0709 13:10:58.064577 (+   208us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:58.064838 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.070679 (+  5841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.070751 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.807643 (+736892us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b18000cc880. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:00.070484 (+1262841us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:00.500240 (+429756us) raft_consensus.cc:1685] finished
0709 13:11:00.500260 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.500413 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22369,"prepare.queue_time_us":4151,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":90,"raft.queue_time_us":21517,"raft.run_cpu_time_us":452,"raft.run_wall_time_us":19666,"spinlock_wait_cycles":127033984,"thread_start_us":114400,"threads_started":1,"wal-append.queue_time_us":239555}
I20260709 13:11:00.766034 26625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2112) took 2002 ms. Trace:
W20260709 13:11:00.779220 26656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1960) took 2080 ms (client timeout 1612 ms). Trace:
I20260709 13:11:00.601248 30525 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.181s
W20260709 13:11:00.466426 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.795313 30412 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.815704 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.445616 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.497792 26652 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
W20260709 13:11:00.816628 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.817067 26502 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:00.796411 30234 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:00.206815 30296 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.442225 30401 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:00.766458 30625 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:11:00.791383 30576 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:00.443629 30247 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.436069 30472 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:00.505262 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2726) took 2436 ms. Trace:
I20260709 13:11:00.307751 30510 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:00.795763 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.514338 30598 log.cc:927] Time spent T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.854s	user 0.004s	sys 0.004s
I20260709 13:11:00.803890 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:00.801918 26585 rpcz_store.cc:269] 0709 13:10:58.303712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.705873 (+402161us) service_pool.cc:224] Handling call
0709 13:11:00.503592 (+1797719us) spinlock_profiling.cc:243] Waited 899 us on lock 0x7b5800003098. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:11:00.800930 (+297338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068736}
I20260709 13:11:00.807677 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:00.804131 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1988) took 1066 ms. Trace:
I20260709 13:11:00.566805 30606 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.595459 30167 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:00.820062 30505 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:00.804531 30600 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:00.784490 30353 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:00.811854 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 110264us
I20260709 13:11:00.499516 30519 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.833258 30412 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:00.814065 26656 rpcz_store.cc:269] 0709 13:10:58.699114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.786727 (+ 87613us) service_pool.cc:224] Handling call
0709 13:11:00.778975 (+1992248us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54001d47d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.779139 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1964990720}
W20260709 13:11:00.783414 26659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2105) took 2630 ms (client timeout 3285 ms). Trace:
I20260709 13:11:00.769302 30153 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.296825 30615 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.819171 30589 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.837829 30247 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:00.470703 26581 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:00.818496 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:00.813958 26625 rpcz_store.cc:276] 0709 13:10:58.763264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.765968 (+2002704us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:11:00.815347 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.795974 30533 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:00.843967 30606 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.845438 30167 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:00.847101 30519 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:00.847394 26508 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:00.872982 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 522) took 1164 ms. Trace:
I20260709 13:11:00.848421 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.874758 26656 raft_consensus.cc:2393] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:11:00.875641 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.876049 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.878365 30505 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.889711 30600 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:00.822192 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1997) took 1778 ms. Trace:
I20260709 13:11:00.893781 26576 rpcz_store.cc:276] 0709 13:10:59.043676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.125793 (+1082117us) service_pool.cc:224] Handling call
0709 13:11:00.130205 (+  4412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:00.130633 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.130660 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:00.134020 (+  3360us) log.cc:844] Serialized 52 byte log entry
0709 13:11:00.292155 (+158135us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:00.292213 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.292314 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:00.821831 (+529517us) raft_consensus.cc:1685] finished
0709 13:11:00.821849 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.822131 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":860,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":157684,"threads_started":1,"wal-append.queue_time_us":416760}
I20260709 13:11:00.850181 30153 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:00.850535 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:00.896800 30468 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:00.897365 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 46916us
I20260709 13:11:00.897677 30468 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:00.830166 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:00.809334 30602 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:00.898327 26622 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:00.842720 30525 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:00.852797 26651 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
I20260709 13:11:00.901654 30609 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:00.902107 30606 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:00.902273 30609 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:00.903316 30609 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:00.853495 30533 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:00.904592 26650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1962) took 2205 ms (client timeout 1678 ms). Trace:
I20260709 13:11:00.853505 30401 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:00.835819 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:00.905711 27272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 623) took 1792 ms (client timeout 1861 ms). Trace:
I20260709 13:11:00.905831 26501 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:00.906165 27272 rpcz_store.cc:269] 0709 13:10:59.113605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.113803 (+   198us) service_pool.cc:224] Handling call
0709 13:11:00.905544 (+1791741us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54004cc554. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.905661 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253154176}
I20260709 13:11:00.837157 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:00.908056 30548 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.908689 29914 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.908737 30548 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:00.909379 29914 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.856817 30247 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.911460 29914 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:00.911598 30247 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:00.836745 26507 rpcz_store.cc:276] 0709 13:10:58.069041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.697767 (+1628726us) service_pool.cc:224] Handling call
0709 13:10:59.866407 (+168640us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:59.917975 (+ 51568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.504967 (+586992us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54000b45d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.505168 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362800512}
I20260709 13:11:00.911726 30548 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:00.912041 29914 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:00.912741 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.912592 29914 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:00.913367 26507 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
W20260709 13:11:00.848568 26659 rpcz_store.cc:269] 0709 13:10:58.153260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.768503 (+2615243us) service_pool.cc:224] Handling call
0709 13:11:00.783343 (+ 14840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.873463 26508 rpcz_store.cc:276] 0709 13:10:59.708748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.994741 (+285993us) service_pool.cc:224] Handling call
0709 13:11:00.872665 (+877924us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b540008e8d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.872899 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1869449088}
I20260709 13:11:00.839638 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:00.916355 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 76785.2us
I20260709 13:11:00.916673 26508 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:00.837283 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:00.837899 26503 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:00.838495 26653 rpcz_store.cc:276] 0709 13:10:59.738186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.507638 (+769452us) service_pool.cc:224] Handling call
0709 13:11:00.804069 (+296431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.809952 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2831) took 1016 ms. Trace:
I20260709 13:11:00.832971 30208 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:00.811491 30488 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 13:11:00.919485 26505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2286) took 2979 ms (client timeout 1787 ms). Trace:
I20260709 13:11:00.947587 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:00.852736 26625 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54888 dropped due to backpressure: service queue is full with 50 items
I20260709 13:11:00.918823 26509 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:00.973148 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1991) took 1021 ms. Trace:
I20260709 13:11:00.917440 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:00.958056 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.948145 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:00.973605 26651 rpcz_store.cc:276] 0709 13:10:59.952007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.902167 (+950160us) service_pool.cc:224] Handling call
0709 13:11:00.973043 (+ 70876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71168}
I20260709 13:11:00.852735 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2826) took 1183 ms. Trace:
I20260709 13:11:00.974805 26659 raft_consensus.cc:2393] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:11:00.972498 26505 rpcz_store.cc:269] 0709 13:10:57.940280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.943338 (+  3058us) service_pool.cc:224] Handling call
0709 13:11:00.919251 (+2975913us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b5400359b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.919405 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937488128}
I20260709 13:11:00.975008 26581 rpcz_store.cc:276] 0709 13:10:59.669043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.470103 (+801060us) service_pool.cc:224] Handling call
0709 13:11:00.470490 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.852482 (+381992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.852677 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:00.976058 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 58688.4us
W20260709 13:11:00.904983 26650 rpcz_store.cc:269] 0709 13:10:58.699605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.943766 (+244161us) service_pool.cc:224] Handling call
0709 13:11:00.904422 (+1960656us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b5400169754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:00.904518 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115648256}
I20260709 13:11:00.917485 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2304) took 2117 ms. Trace:
I20260709 13:11:00.940963 26501 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:00.978277 26508 rpcz_store.cc:276] 0709 13:10:58.799729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.916015 (+2116286us) service_pool.cc:224] Handling call
0709 13:11:00.916370 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.917181 (+   811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.917417 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.971585 26584 rpcz_store.cc:276] 0709 13:10:59.793395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.506164 (+712769us) service_pool.cc:224] Handling call
0709 13:11:00.506579 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.809601 (+303022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.809878 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.947418 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:00.979960 26548 leader_election.cc:336] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.787s (SENT)
I20260709 13:11:00.981122 26656 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:00.973412 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2305) took 2173 ms. Trace:
I20260709 13:11:00.854120 26473 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:00.812425 30479 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:00.984076 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.983681 26509 rpcz_store.cc:276] 0709 13:10:58.800046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.918167 (+2118121us) service_pool.cc:224] Handling call
0709 13:11:00.918422 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.973174 (+ 54752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.973360 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.986915 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:00.986261 26548 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:00.988170 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:00.983994 26658 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:00.991017 27275 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:00.991382 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2095) took 2984 ms. Trace:
I20260709 13:11:00.991724 26658 rpcz_store.cc:276] 0709 13:10:58.007327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.903693 (+2896366us) service_pool.cc:224] Handling call
0709 13:11:00.947725 (+ 44032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.991138 (+ 43413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.991330 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.990311 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:00.993255 26509 raft_consensus.cc:2393] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:11:00.985154 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 131096us
I20260709 13:11:00.836746 30629 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.982111 30153 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:00.997177 26505 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:00.983392 30247 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:00.995177 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:01.026014 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:01.025441 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.026948 26653 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:11:01.027437 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1981) took 2173 ms. Trace:
I20260709 13:11:01.027568 30510 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:00.994026 26503 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:01.028512 27269 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:00.976286 30353 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:01.018795 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.022243 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:01.022732 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:01.023120 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2306) took 2199 ms. Trace:
I20260709 13:11:01.024749 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:01.030615 26509 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:01.029345 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:01.030659 26505 rpcz_store.cc:276] 0709 13:10:58.823379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.982126 (+2158747us) service_pool.cc:224] Handling call
0709 13:11:00.996967 (+ 14841us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.022760 (+ 25793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.023037 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.032455 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:01.033138 26503 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:00.850313 30615 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:01.027886 26653 rpcz_store.cc:276] 0709 13:10:58.853807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.993733 (+2139926us) service_pool.cc:224] Handling call
0709 13:11:01.027378 (+ 33645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.854350 30584 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:00.856650 30296 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:01.009768 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:00.989588 30525 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:00.988510 30389 raft_consensus.cc:2764] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:11:00.898418 30468 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.030557 26622 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:01.040259 26506 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:01.028196 30510 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:01.046288 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.055075 26503 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:11:01.056475 26503 raft_consensus.cc:3055] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:01.056918 26503 raft_consensus.cc:740] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:01.028648 30600 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:00.849005 30589 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.034976 30353 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:00.973011 26625 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54888 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1992)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1995)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2126)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 833)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2118)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 831)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 821)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 824)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 825)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2106)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1957)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1965)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1970)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2108)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1971)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1979)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1982)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2114)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54888 (request call id 2115)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2117)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2119)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2124)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2128)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 828)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 829)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 830)
W20260709 13:11:01.037271 30567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.023s	sys 0.010s
W20260709 13:11:01.069707 30567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.024s	sys 0.010s
I20260709 13:11:01.070706 26654 raft_consensus.cc:3055] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:01.071293 26654 raft_consensus.cc:740] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.072321 26654 consensus_queue.cc:260] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.057896 30602 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:01.073748 26654 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:01.077880 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 97940.4us
I20260709 13:11:01.035720 30548 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:01.034524 30153 raft_consensus.cc:697] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:01.083806 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:01.039669 30584 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:01.089037 26654 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:11:01.091665 26654 pending_rounds.cc:85] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 5
I20260709 13:11:01.089339 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:01.092981 26654 pending_rounds.cc:107] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:11:01.093315 26654 raft_consensus.cc:2889] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:01.054934 30510 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.093730 30525 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:01.102793 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2098) took 3094 ms. Trace:
I20260709 13:11:01.034737 30247 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.024600 30629 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.094776 26548 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:01.110623 26548 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:01.103199 26654 rpcz_store.cc:276] 0709 13:10:58.008080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.008782 (+   702us) service_pool.cc:224] Handling call
0709 13:10:58.024788 (+ 16006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.070574 (+3045786us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b54003f7120. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8a0dc0 00007f882c92b1c0 00007f882c92c231 00007f882c928d8f 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c
0709 13:11:01.102499 (+ 31925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.102741 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177185152}
I20260709 13:11:01.117326 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.107223 26503 consensus_queue.cc:260] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:01.118274 26654 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:11:01.118592 26503 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.113545 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:01.123098 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:01.114208 30522 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:11:01.095827 30548 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.117851 30541 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:01.099473 30543 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:01.105849 30602 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:01.130596 27270 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:11:01.142191 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.151381 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2118) took 1005 ms. Trace:
I20260709 13:11:01.151857 26654 rpcz_store.cc:276] 0709 13:11:00.145549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.119133 (+973584us) service_pool.cc:224] Handling call
0709 13:11:01.151296 (+ 32163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.117381 30600 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:01.126247 27275 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:01.144604 26576 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:11:01.132375 30284 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:01.147763 30541 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.158701 30525 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.159641 29914 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:01.159854 30247 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:01.161347 30629 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:01.162086 30591 consensus_queue.cc:1059] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:01.150270 30479 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:01.161896 30153 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.132005 30468 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.158776 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.164225 30284 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.174978 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2308) took 2319 ms. Trace:
I20260709 13:11:01.150346 30602 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:01.186444 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47659.2us
W20260709 13:11:01.126330 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.164677 30600 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.133745 30353 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.183084 27241 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:11:01.165426 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 134941us
I20260709 13:11:01.169884 30541 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:01.165874 30543 raft_consensus.cc:697] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.188611 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.192703 26625 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:01.178699 30548 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.177520 30493 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.200145 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:01.147989 30584 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.187294 30284 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:01.209405 26625 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:01.191051 30600 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:01.205677 29914 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:01.205818 30499 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:01.206965 30584 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:01.203742 30507 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:01.210711 30493 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.214265 30507 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.215215 30507 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.215744 30493 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:01.216187 30618 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.807s	user 0.000s	sys 0.001s
I20260709 13:11:01.189975 30602 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:01.208437 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:01.205382 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:01.191478 30479 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.213835 30638 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:01.211191 27241 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:01.202641 30591 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:01.197630 30629 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:01.219313 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:01.222168 29914 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:01.222958 30620 raft_consensus.cc:3055] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:01.223104 30542 consensus_queue.cc:1059] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:01.223626 30576 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:01.220137 30591 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:01.222961 30479 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.225816 30591 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.226871 30479 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:01.227365 30591 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:01.223472 30620 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:01.224208 30542 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:01.228845 26507 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:01.232000 26548 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:01.230629 30542 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.234733 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.234896 30353 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:01.234400 30542 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.236039 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.236780 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2120) took 1068 ms. Trace:
I20260709 13:11:01.237646 26658 rpcz_store.cc:276] 0709 13:11:00.168465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.235804 (+1067339us) service_pool.cc:224] Handling call
0709 13:11:01.236727 (+   923us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.238487 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.239786 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1987) took 3184 ms. Trace:
I20260709 13:11:01.240000 26580 raft_consensus.cc:1240] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:01.233338 30234 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.239595 30549 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:01.243505 30234 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:01.245194 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:01.247026 26658 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:01.248317 30543 consensus_queue.cc:237] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.240284 26577 rpcz_store.cc:276] 0709 13:10:58.055060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.055580 (+   520us) service_pool.cc:224] Handling call
0709 13:10:58.067483 (+ 11903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.928511 (+861028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.239475 (+2310964us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540032dcd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:01.239716 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878434176}
W20260709 13:11:01.230340 30571 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 2.605s	user 0.000s	sys 0.009s
I20260709 13:11:01.223255 30638 raft_consensus.cc:3055] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:01.228786 30629 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.230885 30627 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.236737 30493 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:01.274509 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 53259.8us
I20260709 13:11:01.256222 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:01.281981 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:01.283113 26658 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:01.236249 30644 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:01.281900 30549 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:01.301620 30549 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.302070 30549 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:01.285130 27241 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:01.284855 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:01.285830 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.297281 26625 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:01.283941 30542 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:01.314268 30507 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:01.253275 30638 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.316550 26658 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:01.317435 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2102) took 3289 ms. Trace:
I20260709 13:11:01.317878 26658 rpcz_store.cc:276] 0709 13:10:58.028600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.315879 (+3287279us) service_pool.cc:224] Handling call
0709 13:11:01.316311 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.317101 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.317354 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.257402 30629 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.315011 30507 raft_consensus.cc:697] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.315462 30234 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:01.325279 30234 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:01.326376 30234 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.326869 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 1999) took 2282 ms. Trace:
I20260709 13:11:01.327246 26580 rpcz_store.cc:276] 0709 13:10:59.044254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.301102 (+1256848us) service_pool.cc:224] Handling call
0709 13:11:01.239797 (+938695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.242541 (+  2744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.326671 (+ 84130us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b540032dcd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:01.326814 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105964288}
I20260709 13:11:01.329329 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2301) took 3267 ms. Trace:
I20260709 13:11:01.338094 26504 rpcz_store.cc:276] 0709 13:10:58.062119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.160995 (+1098876us) service_pool.cc:224] Handling call
0709 13:10:59.262126 (+101131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.671781 (+409655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.329037 (+1657256us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b540008f2d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:01.329255 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904313728}
W20260709 13:11:01.325320 30637 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:11:01.311269 30644 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:01.475780 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 178603us
I20260709 13:11:01.748879 30543 consensus_queue.cc:1059] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:01.321174 30576 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:11:01.497412 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.754068 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.754576 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.325477 30635 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:11:01.502871 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2309) took 2638 ms. Trace:
I20260709 13:11:01.503005 30541 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.503810 30153 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:01.761958 26658 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:01.514736 26504 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:11:01.762364 30576 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.763082 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2737) took 2870 ms. Trace:
I20260709 13:11:01.760191 30522 raft_consensus.cc:3055] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:01.763463 30576 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.764209 30522 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.295064 30645 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.227s
I20260709 13:11:01.281528 30627 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.757193 30353 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.766288 30353 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.768469 30353 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:01.295053 30620 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:01.539258 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.541285 30168 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:01.554100 30398 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:01.557657 30640 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.337s	user 0.001s	sys 0.001s
W20260709 13:11:01.776301 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.776753 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.552932 30549 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:01.777114 30488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.002s	sys 0.015s
W20260709 13:11:01.780237 30488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.002s	sys 0.015s
I20260709 13:11:01.782030 30549 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:01.563460 30650 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 13:11:01.544528 30510 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:01.596220 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.532362 30507 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.537423 30638 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.602486 30465 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:01.616403 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.658497 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.670374 26582 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:01.793638 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:01.793926 30500 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:01.794001 30465 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:01.794831 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.795014 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:01.671751 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:01.795979 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.796566 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:01.797376 26585 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 6.
I20260709 13:11:01.798378 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:01.672356 26577 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:01.672271 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:01.672833 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 910) took 1988 ms. Trace:
W20260709 13:11:01.676474 30648 log.cc:927] Time spent T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:11:01.677138 30374 raft_consensus.cc:3055] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:11:01.678269 30646 log.cc:927] Time spent T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:11:01.681938 27243 connection.cc:256] RPC call timeout handler was delayed by -2.1385767990000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 13:11:01.809980 30549 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:01.810488 27243 connection.cc:256] RPC call timeout handler was delayed by -1.3673478279999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:11:01.684552 26549 connection.cc:256] RPC call timeout handler was delayed by -1.139889409999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 13:11:01.810786 30549 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.812083 26654 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:01.765128 30522 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.695847 30602 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:01.701727 30634 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.540s	user 0.004s	sys 0.002s
I20260709 13:11:01.712337 30600 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.712479 30284 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.722688 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.796617 30465 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:01.707850 30609 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.843009 26576 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:01.726960 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:01.844717 26579 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:01.729341 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.846431 26651 raft_consensus.cc:2410] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:01.731371 30562 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:01.742169 30629 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.756148 26625 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:01.755868 26505 rpcz_store.cc:276] 0709 13:10:58.864298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.477147 (+2612849us) service_pool.cc:224] Handling call
0709 13:11:01.502312 (+ 25165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.502510 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:01.502540 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:01.502579 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:01.502623 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.502687 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.502814 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.757196 30548 consensus_queue.cc:1059] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:01.758404 30543 consensus_queue.cc:1059] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:01.758981 26655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1975) took 3047 ms (client timeout 2237 ms). Trace:
W20260709 13:11:01.867628 26655 rpcz_store.cc:269] 0709 13:10:58.711468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.134861 (+1423393us) service_pool.cc:224] Handling call
0709 13:11:01.758760 (+1623899us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400143054. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:01.758893 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863583104}
W20260709 13:11:01.868151 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 112105us
I20260709 13:11:01.869163 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:01.759804 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.760165 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2730) took 3666 ms. Trace:
W20260709 13:11:01.870090 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 55849.1us
I20260709 13:11:01.870048 26506 rpcz_store.cc:276] 0709 13:10:58.093118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.820578 (+2727460us) service_pool.cc:224] Handling call
0709 13:11:00.820872 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.052963 (+232091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.759733 (+706770us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400183dd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:01.759911 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503901440}
I20260709 13:11:01.763693 26581 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:01.871320 26549 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:01.765303 30645 raft_consensus.cc:3055] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:01.322878 30525 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.192s
I20260709 13:11:01.508637 30644 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:01.763473 26504 rpcz_store.cc:276] 0709 13:10:58.892216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.496180 (+2603964us) service_pool.cc:224] Handling call
0709 13:11:01.514370 (+ 18190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.762775 (+248405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.763022 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.796708 26656 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:01.879372 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1996) took 1113 ms. Trace:
I20260709 13:11:01.879801 26549 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:01.800513 27274 rpcz_store.cc:276] 0709 13:10:59.684698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.692951 (+  8253us) service_pool.cc:224] Handling call
0709 13:10:59.703633 (+ 10682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.743093 (+ 39460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.672590 (+1929497us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b540085cfd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:01.672762 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11458944}
I20260709 13:11:01.672961 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:01.803399 26509 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:11:01.806784 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2302) took 3007 ms. Trace:
I20260709 13:11:01.808979 30374 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:01.882053 30507 raft_consensus.cc:3055] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:01.886826 30507 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.887786 30507 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.889182 30507 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:01.810907 27243 connection.cc:256] RPC call timeout handler was delayed by -1.1686182900000404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
I20260709 13:11:01.807997 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2738) took 2915 ms. Trace:
I20260709 13:11:01.825378 30653 consensus_queue.cc:1059] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:11:01.799352 30620 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.185274 26503 rpcz_store.cc:276] 0709 13:10:58.855294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.056015 (+2200721us) service_pool.cc:224] Handling call
0709 13:11:01.056357 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.174565 (+118208us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:01.174598 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:01.174639 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:01.174680 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.174751 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.174911 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2184,"raft.queue_time_us":3231,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":5992}
W20260709 13:11:01.833040 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 63085.7us
I20260709 13:11:01.831904 26653 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
W20260709 13:11:01.902210 26653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2129) took 1402 ms (client timeout 1862 ms). Trace:
W20260709 13:11:01.902722 26653 rpcz_store.cc:269] 0709 13:11:00.499475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.722356 (+1222881us) service_pool.cc:224] Handling call
0709 13:11:01.902153 (+179797us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.839161 30545 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.840359 30510 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:01.840804 30284 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:01.858129 26651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1992) took 1905 ms (client timeout 2070 ms). Trace:
I20260709 13:11:01.813159 30589 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:01.862627 30609 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.973524 26655 raft_consensus.cc:2410] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:11:01.974334 30412 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:01.863653 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:01.975191 26505 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:01.975718 30609 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:01.759522 30541 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:01.874403 26652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2116) took 2740 ms (client timeout 1614 ms). Trace:
W20260709 13:11:01.976536 26652 rpcz_store.cc:269] 0709 13:10:59.134501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.923187 (+788686us) service_pool.cc:224] Handling call
0709 13:11:01.874228 (+1951041us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54001423d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:01.874334 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318784768}
I20260709 13:11:01.977200 30549 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:01.862540 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:01.977617 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:01.978431 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:01.971441 26622 leader_election.cc:336] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.608s (SENT)
I20260709 13:11:01.686976 30234 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.979715 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:01.980621 30609 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:01.980195 30234 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.982813 30234 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:01.983736 26657 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 819) took 3898 ms (client timeout 2418 ms). Trace:
I20260709 13:11:01.967341 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:01.984202 26657 rpcz_store.cc:269] 0709 13:10:58.085637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.114877 (+1029240us) service_pool.cc:224] Handling call
0709 13:11:01.983481 (+2868604us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54002db754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:01.983632 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4720842112}
I20260709 13:11:01.984656 26659 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
W20260709 13:11:01.985271 26659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 1995) took 1918 ms (client timeout 2119 ms). Trace:
W20260709 13:11:01.985656 26659 rpcz_store.cc:269] 0709 13:11:00.067153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.911922 (+1844769us) service_pool.cc:224] Handling call
0709 13:11:01.985217 (+ 73295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.986656 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:01.987767 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:01.988253 26659 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.970839 30629 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:01.991187 30627 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:01.993786 30638 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.882189 26502 rpcz_store.cc:276] 0709 13:10:58.799080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.826069 (+2026989us) service_pool.cc:224] Handling call
0709 13:11:00.826521 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.834882 (+  8361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.834903 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:00.842179 (+  7276us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.053075 (+210896us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:01.053116 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.053177 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.324919 (+271742us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:01.798753 (+473834us) raft_consensus.cc:1685] finished
0709 13:11:01.798774 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.806714 (+  7940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45,"raft.queue_time_us":11773,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":1804,"spinlock_wait_cycles":6899968,"thread_start_us":151283,"threads_started":1,"wal-append.queue_time_us":248723}
I20260709 13:11:01.889240 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:01.891036 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:01.879804 26656 rpcz_store.cc:276] 0709 13:11:00.765622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.795716 (+1030094us) service_pool.cc:224] Handling call
0709 13:11:01.879316 (+ 83600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.884411 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2740) took 2909 ms. Trace:
I20260709 13:11:01.999151 26509 rpcz_store.cc:276] 0709 13:10:58.975225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.772205 (+2796980us) service_pool.cc:224] Handling call
0709 13:11:01.799595 (+ 27390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.883069 (+ 83474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.884220 (+  1151us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54002fc950. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:01.884344 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61917440}
I20260709 13:11:02.000607 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:02.001120 26509 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:01.979765 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:01.899295 26510 rpcz_store.cc:276] 0709 13:10:58.892468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.735034 (+2842566us) service_pool.cc:224] Handling call
0709 13:11:01.735436 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.735691 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:01.783392 (+ 47701us) log.cc:844] Serialized 14 byte log entry
0709 13:11:01.807488 (+ 24096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:01.807577 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:01.807654 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.807754 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.807917 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":99233,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":3967,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":70160,"threads_started":2,"wal-append.queue_time_us":82618}
I20260709 13:11:02.002285 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.002368 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.002928 26510 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:11:01.985433 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:01.902114 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:02.003893 26504 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:02.004062 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:01.839319 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:02.004591 26657 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:02.004767 26580 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:01.903752 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.005836 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.006524 30507 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:02.006976 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:02.007077 30507 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.008713 30620 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:02.008575 30644 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.009718 26501 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 8: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:02.010051 26582 raft_consensus.cc:2368] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
I20260709 13:11:02.012575 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 834) took 1088 ms. Trace:
I20260709 13:11:02.012934 26654 rpcz_store.cc:276] 0709 13:11:00.923797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.208150 (+284353us) service_pool.cc:224] Handling call
0709 13:11:02.012386 (+804236us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540039c1d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:02.012521 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342751104}
I20260709 13:11:02.014006 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:02.014720 26650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2126) took 1516 ms (client timeout 1705 ms). Trace:
W20260709 13:11:02.015033 26650 rpcz_store.cc:269] 0709 13:11:00.498589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.013725 (+1515136us) service_pool.cc:224] Handling call
0709 13:11:02.014667 (+   942us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.016286 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2303) took 3216 ms. Trace:
I20260709 13:11:02.016654 26507 rpcz_store.cc:276] 0709 13:10:58.799422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.914168 (+2114746us) service_pool.cc:224] Handling call
0709 13:11:00.914448 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.229828 (+315380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.016071 (+786243us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b540008d9d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:02.016237 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722191232}
I20260709 13:11:01.906656 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:01.906832 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:02.018042 27271 raft_consensus.cc:2368] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8.
I20260709 13:11:02.018173 26653 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.907656 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:01.908536 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:02.019129 27274 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:01.882194 30542 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:01.908327 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.019930 27275 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:01.914410 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:01.915371 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:01.874195 30645 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:01.877846 30153 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:11:02.033830 30542 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.034318 30542 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:01.905516 30654 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:11:02.035436 30654 consensus_queue.cc:1243] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:02.035501 30644 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:02.036322 30542 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:01.884361 30602 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:01.885667 30499 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:11:02.037293 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:01.962875 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:01.963634 30545 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.038259 26581 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:11:01.885059 30374 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:01.966344 26549 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:02.039497 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:01.879168 30488 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:01.904742 30591 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:11:01.883941 30660 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:11:01.970714 27270 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:11:01.970474 26651 rpcz_store.cc:269] 0709 13:10:59.952305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.729033 (+1776728us) service_pool.cc:224] Handling call
0709 13:11:01.858057 (+129024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:01.972205 30468 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.975677 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:01.865211 30600 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:01.998659 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.009318 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:01.912165 30632 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.763s	user 0.007s	sys 0.010s
I20260709 13:11:02.020715 26503 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:01.913498 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 818) took 3849 ms. Trace:
I20260709 13:11:02.022353 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.026119 30609 consensus_queue.cc:1059] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:02.027518 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:02.020660 30562 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:02.029860 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.009245 30620 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.020937 30616 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:02.039400 26506 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:02.030730 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:02.040021 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 73767.9us
I20260709 13:11:02.208752 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:02.090996 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:02.148162 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:02.091364 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:02.171831 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.168759 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.213523 26507 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:02.110340 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.087919 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.063405 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.040254 26581 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:02.040491 26652 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:02.042441 26625 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:02.059572 26504 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:02.089844 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:11:02.218911 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 176579us
I20260709 13:11:02.110044 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.221099 27276 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.221228 26625 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:02.159262 26654 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:11:01.774428 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:02.108935 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:02.222172 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:02.222429 26579 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:11:02.066083 27275 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:11:02.168323 26650 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:02.048548 26580 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:02.223778 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 824) took 4043 ms. Trace:
I20260709 13:11:02.224383 26576 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:02.224011 26658 rpcz_store.cc:276] 0709 13:10:58.064442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.319599 (+3255157us) service_pool.cc:224] Handling call
0709 13:11:01.761606 (+442007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.762396 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.913195 (+150799us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400143050. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:01.913412 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015216000}
I20260709 13:11:02.224202 26650 rpcz_store.cc:276] 0709 13:10:58.180475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.167723 (+3987248us) service_pool.cc:224] Handling call
0709 13:11:02.168078 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.223534 (+ 55456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.223735 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.090653 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:02.090286 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:02.225687 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:02.212740 27278 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:11:02.222445 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 821) took 4128 ms. Trace:
I20260709 13:11:02.228644 26510 raft_consensus.cc:2393] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:02.228021 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2741) took 3252 ms. Trace:
I20260709 13:11:02.219605 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.224936 26580 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:02.229444 26506 rpcz_store.cc:276] 0709 13:10:58.975565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.038857 (+3063292us) service_pool.cc:224] Handling call
0709 13:11:02.039209 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.227785 (+188576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.227967 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:02.229966 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 220689us
I20260709 13:11:02.038172 30543 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:02.045320 26659 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:02.228436 26654 rpcz_store.cc:276] 0709 13:10:58.094275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.099709 (+4005434us) service_pool.cc:224] Handling call
0709 13:11:02.158878 (+ 59169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.222189 (+ 63311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.222393 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.231079 26656 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:02.231123 26502 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:02.232648 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.198540 26657 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:11:02.230628 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.233820 26508 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:02.234454 26504 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:02.059046 26505 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:02.235366 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.232334 30627 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:02.237501 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:02.238212 26578 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:02.239076 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.238273 27272 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 8: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:11:02.240525 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.241178 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.241269 27278 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:02.235918 26505 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
W20260709 13:11:02.241983 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.239406 27275 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:02.230742 26474 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:02.244150 26504 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:02.244565 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.244372 26659 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:02.245034 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.246704 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.250015 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1957) took 3551 ms. Trace:
I20260709 13:11:02.246831 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 519) took 2538 ms. Trace:
I20260709 13:11:02.232262 30562 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.252614 26655 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:02.262126 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 826) took 3753 ms. Trace:
I20260709 13:11:02.258342 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.262507 26655 rpcz_store.cc:276] 0709 13:10:58.508332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.235346 (+3727014us) service_pool.cc:224] Handling call
0709 13:11:02.235643 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.261882 (+ 26239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.262067 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.251165 26502 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:02.248626 26474 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:02.247663 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:02.068853 30599 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:02.259428 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.262126 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.266016 27272 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:02.227468 30468 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.039999 30662 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:02.068503 30499 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:02.063016 30398 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:02.272444 30548 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:02.275379 30548 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.233074 30234 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:11:02.033326 30510 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:02.250653 26659 rpcz_store.cc:276] 0709 13:10:58.698354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.243927 (+3545573us) service_pool.cc:224] Handling call
0709 13:11:02.244207 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.249673 (+  5466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.249932 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.263962 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 526) took 2554 ms. Trace:
I20260709 13:11:02.284701 26502 rpcz_store.cc:276] 0709 13:10:59.709342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.250744 (+2541402us) service_pool.cc:224] Handling call
0709 13:11:02.251007 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.263644 (+ 12637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.263842 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.252594 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 524) took 2543 ms. Trace:
I20260709 13:11:02.285807 26504 rpcz_store.cc:276] 0709 13:10:59.709056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.243488 (+2534432us) service_pool.cc:224] Handling call
0709 13:11:02.243856 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.251493 (+  7637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.251736 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.287082 30510 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.264561 26474 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:02.273869 30398 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.291060 30398 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:02.273634 30499 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.293969 30499 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.284139 26659 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:02.296470 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1967) took 3595 ms. Trace:
I20260709 13:11:02.296836 26659 rpcz_store.cc:276] 0709 13:10:58.700844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.283130 (+3582286us) service_pool.cc:224] Handling call
0709 13:11:02.283710 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.296035 (+ 12325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.296309 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.269698 30168 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:02.299147 30168 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:02.299629 30168 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.299999 30168 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:02.300671 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:02.167968 30374 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:02.301653 26659 raft_consensus.cc:1240] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:02.273427 30662 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.302394 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1968) took 3601 ms. Trace:
I20260709 13:11:02.302762 26659 rpcz_store.cc:276] 0709 13:10:58.701117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.301107 (+3599990us) service_pool.cc:224] Handling call
0709 13:11:02.301415 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.302137 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.302339 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.303153 26509 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:02.303889 30662 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:02.304445 26509 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:02.304665 30662 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:02.232139 30616 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.251561 26505 rpcz_store.cc:276] 0709 13:10:59.708193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.246121 (+2537928us) service_pool.cc:224] Handling call
0709 13:11:02.246379 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.246543 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.246567 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.246608 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:02.246647 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.246695 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.246783 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.329612 26505 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:02.329986 27240 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:02.330251 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2314) took 2159 ms. Trace:
I20260709 13:11:02.330886 26505 rpcz_store.cc:276] 0709 13:11:00.171083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.329098 (+2158015us) service_pool.cc:224] Handling call
0709 13:11:02.329425 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.330039 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.330200 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.331634 27276 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:02.333667 26655 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:02.265089 26654 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:11:02.268802 26625 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:02.209755 30507 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:02.266273 27273 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:02.270109 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.268134 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:02.335350 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 66578.3us
I20260709 13:11:02.268592 27277 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:02.336382 26625 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:02.232483 30543 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.278709 26585 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:02.232419 30653 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:02.339426 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1965) took 3639 ms. Trace:
I20260709 13:11:02.340337 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2107) took 3632 ms. Trace:
I20260709 13:11:02.340806 26655 rpcz_store.cc:276] 0709 13:10:58.707695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.309390 (+3601695us) service_pool.cc:224] Handling call
0709 13:11:02.333188 (+ 23798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.334245 (+  1057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.340283 (+  6038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.093770 30602 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.174s
I20260709 13:11:02.340176 26654 rpcz_store.cc:276] 0709 13:10:58.700356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.263931 (+3563575us) service_pool.cc:224] Handling call
0709 13:11:02.264262 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.339085 (+ 74823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.339356 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.348317 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2110) took 3635 ms. Trace:
I20260709 13:11:02.348915 26654 rpcz_store.cc:276] 0709 13:10:58.712649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.347212 (+3634563us) service_pool.cc:224] Handling call
0709 13:11:02.347624 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.347871 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.347908 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.347979 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:02.348033 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.348106 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.348242 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.298947 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.301338 27278 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:02.313719 30468 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:02.363704 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99192us
I20260709 13:11:02.315562 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:02.366040 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2310) took 2304 ms. Trace:
I20260709 13:11:02.289435 30510 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:02.324641 30522 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:02.270931 30542 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:02.279846 30548 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:02.220551 30353 consensus_queue.cc:1059] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:11:02.380232 30353 raft_consensus.cc:3055] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:02.380702 30353 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:02.325846 26652 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:02.327939 26657 raft_consensus.cc:1240] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:11:02.328224 26579 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:02.381517 30353 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.305049 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2312) took 2139 ms. Trace:
I20260709 13:11:02.303906 26659 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:02.260973 26507 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:02.251870 30627 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:02.280974 27272 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
W20260709 13:11:02.272758 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 46571.7us
I20260709 13:11:02.334059 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.338369 26625 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:02.340197 26656 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:02.341813 26653 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:02.344612 26581 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:02.350456 26655 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:11:02.350805 27273 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:02.285295 26503 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:02.352011 27240 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:02.418391 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 80109.2us
I20260709 13:11:02.340085 30653 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:02.421783 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 69855.3us
I20260709 13:11:02.339666 30651 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:02.341531 30543 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.343076 30609 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:02.366828 27275 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:11:02.322990 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.366763 26474 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:02.367750 26504 rpcz_store.cc:276] 0709 13:11:00.061671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.286891 (+2225220us) service_pool.cc:224] Handling call
0709 13:11:02.287322 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.365092 (+ 77770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.365126 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.365169 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:02.365540 (+   371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.365685 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.365965 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16822,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":77289,"threads_started":1}
I20260709 13:11:02.371852 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.372797 26585 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 6. Current term is 8. Ops: []
I20260709 13:11:02.355790 30234 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:02.441406 26502 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:11:02.401423 30644 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:02.442090 30644 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:02.442381 26654 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:02.378147 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:02.444073 27274 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:02.444169 30465 raft_consensus.cc:3055] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:02.444617 30465 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:02.399538 26582 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:02.445323 27274 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:02.464649 27274 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:02.395355 26584 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:02.403559 27241 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:11:02.409509 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.419250 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 171686us
W20260709 13:11:02.472301 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.473587 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.474246 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.387897 26509 rpcz_store.cc:276] 0709 13:11:00.165403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.304015 (+2138612us) service_pool.cc:224] Handling call
0709 13:11:02.304291 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.304830 (+   539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.305000 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.420423 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2108) took 3712 ms. Trace:
I20260709 13:11:02.476076 26656 rpcz_store.cc:276] 0709 13:10:58.708489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.310712 (+3602223us) service_pool.cc:224] Handling call
0709 13:11:02.339887 (+ 29175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.420187 (+ 80300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.420368 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.420809 26503 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:02.477615 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 539) took 1660 ms. Trace:
I20260709 13:11:02.478061 26503 rpcz_store.cc:276] 0709 13:11:00.817659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.420372 (+1602713us) service_pool.cc:224] Handling call
0709 13:11:02.420658 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.477276 (+ 56618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.477528 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.420902 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1970) took 3719 ms. Trace:
I20260709 13:11:02.421218 26506 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:02.353919 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.422271 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:02.402697 30606 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:02.423240 30548 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:02.425064 27240 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:02.425973 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1971) took 3716 ms. Trace:
I20260709 13:11:02.427058 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2315) took 2248 ms. Trace:
I20260709 13:11:02.485759 26655 rpcz_store.cc:276] 0709 13:10:58.709539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.343156 (+3633617us) service_pool.cc:224] Handling call
0709 13:11:02.350241 (+  7085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.425739 (+ 75498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.425928 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.486464 26622 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:02.487790 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:02.427347 26507 pending_rounds.cc:85] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 5
I20260709 13:11:02.383059 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2109) took 3674 ms. Trace:
I20260709 13:11:02.430042 26504 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:02.488904 26507 pending_rounds.cc:107] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:11:02.429606 27278 raft_consensus.cc:2376] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9. Re-sending same reply.
I20260709 13:11:02.489246 26507 raft_consensus.cc:2889] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.489033 26652 rpcz_store.cc:276] 0709 13:10:58.708895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.325191 (+3616296us) service_pool.cc:224] Handling call
0709 13:11:02.325491 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.382769 (+ 57278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.382997 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.489681 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 540) took 1671 ms. Trace:
I20260709 13:11:02.423775 30629 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:02.382443 30545 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:02.431190 27269 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.427965 30653 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:02.494299 26476 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:02.359165 30673 consensus_queue.cc:1059] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:11:02.433595 30499 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.434609 30616 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:02.434971 26653 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:02.501880 27274 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.437578 26650 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:11:02.502799 26650 pending_rounds.cc:85] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 7
I20260709 13:11:02.503068 26650 pending_rounds.cc:107] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:11:02.503293 26650 raft_consensus.cc:2889] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.438134 30645 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.438894 30398 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.439760 27275 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:02.505728 27275 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:02.506542 27275 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.507504 27275 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.440428 26585 raft_consensus.cc:3055] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:02.451678 30562 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:02.509730 26585 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:02.450490 30654 raft_consensus.cc:3055] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:02.510438 30654 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:02.510746 26585 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.390429 30677 ts_tablet_manager.cc:933] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:02.511384 30654 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.511612 26404 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 7 to 9, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 9 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.513006 26510 raft_consensus.cc:1240] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:02.511693 26585 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.516710 27269 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:02.392081 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1963) took 3692 ms. Trace:
I20260709 13:11:02.517864 26657 rpcz_store.cc:276] 0709 13:10:58.699850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.244619 (+3544769us) service_pool.cc:224] Handling call
0709 13:11:02.327696 (+ 83077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.385029 (+ 57333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.391882 (+  6853us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b5400169c50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:02.392017 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190286592}
I20260709 13:11:02.519021 26655 raft_consensus.cc:1240] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:02.446055 27276 raft_consensus.cc:2376] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7. Re-sending same reply.
W20260709 13:11:02.484153 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 80687.8us
I20260709 13:11:02.519743 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1982) took 3654 ms. Trace:
I20260709 13:11:02.430765 27243 leader_election.cc:400] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
I20260709 13:11:02.490134 26504 rpcz_store.cc:276] 0709 13:11:00.818076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.429600 (+1611524us) service_pool.cc:224] Handling call
0709 13:11:02.429867 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.489246 (+ 59379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.489624 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.520208 27243 leader_election.cc:403] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:02.520090 26655 rpcz_store.cc:276] 0709 13:10:58.865035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.492265 (+3627230us) service_pool.cc:224] Handling call
0709 13:11:02.497443 (+  5178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.519495 (+ 22052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.519683 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.451087 30353 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:02.492621 26509 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:02.355530 26396 maintenance_manager.cc:643] P 6b5d6a3be49c419aa4980b2ed2efd28a: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.821s	user 0.191s	sys 0.076s Metrics: {"bytes_written":29402,"cfile_init":1,"dirs.queue_time_us":375745,"dirs.run_cpu_time_us":392,"dirs.run_wall_time_us":1014,"drs_written":1,"lbm_read_time_us":499,"lbm_reads_lt_1ms":4,"lbm_write_time_us":63248,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":63,"thread_start_us":374233,"threads_started":2,"wal-append.queue_time_us":167630}
I20260709 13:11:02.524758 26404 catalog_manager.cc:5697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 2, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 2 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.435771 26581 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:02.526119 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2754) took 1681 ms. Trace:
I20260709 13:11:02.503908 30499 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:02.445418 30465 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.479982 26659 rpcz_store.cc:276] 0709 13:10:58.708988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.303472 (+3594484us) service_pool.cc:224] Handling call
0709 13:11:02.303750 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.420680 (+116930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.420848 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.520823 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.528090 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 1979) took 3758 ms. Trace:
I20260709 13:11:02.528445 26654 rpcz_store.cc:276] 0709 13:10:58.770119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.370365 (+3600246us) service_pool.cc:224] Handling call
0709 13:11:02.370726 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.442730 (+ 72004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.527873 (+ 85143us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b5400107a54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:02.528036 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163973888}
I20260709 13:11:02.528846 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:02.529830 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.484650 26505 rpcz_store.cc:276] 0709 13:11:00.178316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.332061 (+2153745us) service_pool.cc:224] Handling call
0709 13:11:02.332425 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.332670 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:02.343868 (+ 11198us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.426554 (+ 82686us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.426702 (+   148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.426757 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:02.426837 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.426903 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.427008 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24255,"prepare.queue_time_us":36270,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":867,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":13302,"thread_start_us":57571,"threads_started":1}
W20260709 13:11:02.530793 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.522341 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 155658us
I20260709 13:11:02.532259 26474 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:02.534192 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:02.534358 26474 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:02.535974 26654 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:02.512630 30654 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:02.538466 26659 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:02.539623 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2121) took 2356 ms. Trace:
I20260709 13:11:02.540037 26659 rpcz_store.cc:276] 0709 13:11:00.182971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.537493 (+2354522us) service_pool.cc:224] Handling call
0709 13:11:02.537912 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.539267 (+  1355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.539547 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.522976 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2317) took 2328 ms. Trace:
I20260709 13:11:02.524470 27275 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:11:02.451653 30620 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:02.502388 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 827) took 3707 ms. Trace:
I20260709 13:11:02.545734 26653 rpcz_store.cc:276] 0709 13:10:58.795502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.419846 (+3624344us) service_pool.cc:224] Handling call
0709 13:11:02.434688 (+ 14842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.502128 (+ 67440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.502330 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.525310 26655 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:02.526472 26509 rpcz_store.cc:276] 0709 13:11:00.845223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.482209 (+1636986us) service_pool.cc:224] Handling call
0709 13:11:02.482532 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.525788 (+ 43256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.526002 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.546893 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.483752 30548 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:02.542126 26501 rpcz_store.cc:276] 0709 13:11:00.194881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.363937 (+2169056us) service_pool.cc:224] Handling call
0709 13:11:02.377205 (+ 13268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.377504 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:02.426495 (+ 48991us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.522671 (+ 96176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.522708 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:02.522743 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.522819 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.522924 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30988,"prepare.queue_time_us":49704,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":35629,"thread_start_us":64266,"threads_started":1}
I20260709 13:11:02.494110 30627 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.548282 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2758) took 1348 ms. Trace:
I20260709 13:11:02.522142 30638 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:02.563024 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.549391 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2119) took 2381 ms. Trace:
I20260709 13:11:02.549767 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2117) took 2429 ms. Trace:
I20260709 13:11:02.565330 26654 rpcz_store.cc:276] 0709 13:11:00.156032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.529305 (+2373273us) service_pool.cc:224] Handling call
0709 13:11:02.535751 (+  6446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.536478 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.536713 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.565514 26655 rpcz_store.cc:276] 0709 13:11:00.119891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.522702 (+2402811us) service_pool.cc:224] Handling call
0709 13:11:02.525101 (+  2399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.549451 (+ 24350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.549699 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.549307 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:02.494936 30609 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:02.495298 30234 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:02.552975 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 127962us
I20260709 13:11:02.572770 26583 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:02.525780 26657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54888
I20260709 13:11:02.554257 26509 rpcz_store.cc:276] 0709 13:11:01.199580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.547179 (+1347599us) service_pool.cc:224] Handling call
0709 13:11:02.547542 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.547737 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.547759 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.547806 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:02.548000 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.548070 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.548219 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.576267 26509 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:02.576923 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2326) took 1355 ms. Trace:
I20260709 13:11:02.577312 26509 rpcz_store.cc:276] 0709 13:11:01.221538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.575517 (+1353979us) service_pool.cc:224] Handling call
0709 13:11:02.575866 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.576672 (+   806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.576863 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.541834 27275 pending_rounds.cc:85] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 8
I20260709 13:11:02.579066 27275 pending_rounds.cc:107] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:11:02.579444 27275 raft_consensus.cc:2889] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:02.555501 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 61278.2us
W20260709 13:11:02.581036 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.548714 30662 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:02.560822 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.585480 26653 raft_consensus.cc:1275] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:02.587044 26654 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:02.588240 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2127) took 2089 ms. Trace:
I20260709 13:11:02.588595 26654 rpcz_store.cc:276] 0709 13:11:00.498912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.586644 (+2087732us) service_pool.cc:224] Handling call
0709 13:11:02.586890 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.588029 (+  1139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.588190 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.544618 30616 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:02.442896 30644 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.567613 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:02.555188 30548 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.592374 30545 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:02.592986 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.593942 26397 maintenance_manager.cc:419] P 6b5d6a3be49c419aa4980b2ed2efd28a: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10084 bytes on disk
I20260709 13:11:02.593889 30374 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:02.598227 30562 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:11:02.665401 30374 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:02.666013 30374 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:02.666109 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.667115 30374 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.597272 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2124) took 2166 ms. Trace:
I20260709 13:11:02.668087 30591 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:02.668532 26653 rpcz_store.cc:276] 0709 13:11:00.432221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.564215 (+2131994us) service_pool.cc:224] Handling call
0709 13:11:02.585190 (+ 20975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.585885 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.597198 (+ 11313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.669915 26653 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:02.670470 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 828) took 2169 ms. Trace:
I20260709 13:11:02.670789 26653 rpcz_store.cc:276] 0709 13:11:00.500642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.669419 (+2168777us) service_pool.cc:224] Handling call
0709 13:11:02.669743 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.670254 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.670414 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.671280 26396 maintenance_manager.cc:643] P 6b5d6a3be49c419aa4980b2ed2efd28a: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":406,"lbm_reads_lt_1ms":4}
I20260709 13:11:02.671919 26653 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:02.556834 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2322) took 1578 ms. Trace:
I20260709 13:11:02.673295 26503 rpcz_store.cc:276] 0709 13:11:00.977951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.535406 (+1557455us) service_pool.cc:224] Handling call
0709 13:11:02.556234 (+ 20828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.556425 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.556461 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.556515 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:02.556578 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.556647 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.556770 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.553918 30153 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.551946 30674 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:02.562027 30638 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.564909 30398 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:02.600147 26501 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:02.687201 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2760) took 1486 ms. Trace:
I20260709 13:11:02.687721 26501 rpcz_store.cc:276] 0709 13:11:01.200330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.573898 (+1373568us) service_pool.cc:224] Handling call
0709 13:11:02.599921 (+ 26023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.686833 (+ 86912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.687131 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.688823 30638 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:02.607728 26585 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:02.568011 30620 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:02.690610 30620 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:02.691236 26584 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:02.691547 30620 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.692425 30153 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:02.625979 30599 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:02.703053 30599 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:02.703600 30599 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:02.571702 30609 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.583472 30499 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:02.554391 30522 consensus_queue.cc:1059] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:11:02.598188 30662 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.715494 30609 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:02.625175 30602 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:11:02.675601 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 830) took 2160 ms. Trace:
W20260709 13:11:02.685935 30680 log.cc:927] Time spent T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:11:02.567830 30627 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.691362 26508 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:02.614210 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 46702.1us
I20260709 13:11:02.785061 26548 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:02.620327 26657 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:11:02.714869 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.629045 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 538) took 2508 ms. Trace:
I20260709 13:11:02.786803 26502 rpcz_store.cc:276] 0709 13:11:00.120153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.290172 (+2170019us) service_pool.cc:224] Handling call
0709 13:11:02.290582 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.441821 (+151239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.628699 (+186878us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003525d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:02.628926 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346309504}
I20260709 13:11:02.628408 26655 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:02.788883 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2128) took 2289 ms. Trace:
I20260709 13:11:02.789354 26655 rpcz_store.cc:276] 0709 13:11:00.499191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.600002 (+2100811us) service_pool.cc:224] Handling call
0709 13:11:02.628077 (+ 28075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.788494 (+160417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.788809 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.738819 26653 rpcz_store.cc:276] 0709 13:11:00.515439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.671465 (+2156026us) service_pool.cc:224] Handling call
0709 13:11:02.671754 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.675321 (+  3567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.675534 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6400}
I20260709 13:11:02.646963 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:02.746063 30673 consensus_queue.cc:1243] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:11:02.752514 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.793470 26657 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:02.877746 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.878376 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.878800 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.798864 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.839576 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2321) took 1862 ms. Trace:
I20260709 13:11:02.880344 26505 rpcz_store.cc:276] 0709 13:11:00.977638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.531072 (+1553434us) service_pool.cc:224] Handling call
0709 13:11:02.531353 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.531598 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:02.570384 (+ 38786us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.838822 (+268438us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.839086 (+   264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.839151 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:02.839226 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.839327 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.839505 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38428,"prepare.queue_time_us":40853,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":89,"raft.queue_time_us":148,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"thread_start_us":267043,"threads_started":1}
I20260709 13:11:02.883275 26505 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:11:02.883688 26505 pending_rounds.cc:85] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 7
I20260709 13:11:02.884184 26505 pending_rounds.cc:107] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:11:02.884527 26505 raft_consensus.cc:2889] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:02.873687 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 88766us
I20260709 13:11:02.885938 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:02.888734 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.719532 30662 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:02.889673 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2320) took 1912 ms. Trace:
I20260709 13:11:02.675271 30168 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.895484 26657 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:02.718626 30684 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:02.913252 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2762) took 1078 ms. Trace:
I20260709 13:11:02.930235 26653 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:11:02.902205 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 286926us
I20260709 13:11:02.937372 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2130) took 1258 ms. Trace:
I20260709 13:11:02.754556 30499 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:02.937849 26653 rpcz_store.cc:276] 0709 13:11:01.679246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.792461 (+1113215us) service_pool.cc:224] Handling call
0709 13:11:02.929904 (+137443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.937096 (+  7192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.937313 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:03.119812 27243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.016s	sys 0.035s
W20260709 13:11:03.411608 26659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.021s
I20260709 13:11:02.978780 26657 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:03.277491 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.414163 26659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.000s	sys 0.021s
W20260709 13:11:03.324699 27240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.009s	sys 0.005s
W20260709 13:11:03.407833 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 873478us
W20260709 13:11:02.957993 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 437899us
W20260709 13:11:03.413683 27243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.022s	sys 0.037s
W20260709 13:11:03.415697 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 985001us
I20260709 13:11:03.415853 26474 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:03.416343 27243 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:03.413535 26655 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:03.411298 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.318378 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 380871us
I20260709 13:11:03.417003 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:03.409198 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 523355us
W20260709 13:11:03.068989 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.411293 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2106) took 4976 ms. Trace:
W20260709 13:11:03.419464 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.420506 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.419489 26658 rpcz_store.cc:276] 0709 13:10:58.435170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.232660 (+3797490us) service_pool.cc:224] Handling call
0709 13:11:02.233000 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.266796 (+ 33796us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:02.266833 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.267211 (+   378us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.447536 (+180325us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b1800400b40. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c90d1 00007f882c8e4a0f
0709 13:11:02.630978 (+183442us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:02.631034 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.631139 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:02.752826 (+121687us) raft_consensus.cc:1685] finished
0709 13:11:02.752870 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.411209 (+658339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33368,"raft.queue_time_us":33894,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10480,"spinlock_wait_cycles":64704896,"thread_start_us":183187,"threads_started":1,"wal-append.queue_time_us":465329}
I20260709 13:11:02.985085 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2331) took 1186 ms. Trace:
I20260709 13:11:03.412667 26505 rpcz_store.cc:276] 0709 13:11:01.807139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.882440 (+1075301us) service_pool.cc:224] Handling call
0709 13:11:02.882827 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.885063 (+  2236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.885314 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.422878 26505 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:11:03.359531 26503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.000s	sys 0.015s
W20260709 13:11:03.414676 27240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.009s	sys 0.007s
W20260709 13:11:03.423539 26503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.000s	sys 0.016s
W20260709 13:11:03.424300 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 851073us
I20260709 13:11:03.422000 26501 rpcz_store.cc:276] 0709 13:11:01.798167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.688764 (+890597us) service_pool.cc:224] Handling call
0709 13:11:02.689134 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.689366 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:02.692651 (+  3285us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.984580 (+291929us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.984659 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:02.984723 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.984816 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.984983 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3668,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":130,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":291100,"threads_started":1}
I20260709 13:11:03.425480 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2763) took 1611 ms. Trace:
I20260709 13:11:03.426573 26505 rpcz_store.cc:276] 0709 13:11:01.814571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.422252 (+1607681us) service_pool.cc:224] Handling call
0709 13:11:03.422540 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.425195 (+  2655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.425411 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.427834 26505 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:03.428370 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2766) took 1547 ms. Trace:
I20260709 13:11:03.428670 26505 rpcz_store.cc:276] 0709 13:11:01.881044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.427231 (+1546187us) service_pool.cc:224] Handling call
0709 13:11:03.427518 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.428157 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.428320 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34048}
I20260709 13:11:03.430791 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 836) took 2209 ms. Trace:
I20260709 13:11:03.431417 26655 rpcz_store.cc:276] 0709 13:11:01.221380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.790368 (+1568988us) service_pool.cc:224] Handling call
0709 13:11:03.409465 (+619097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.417009 (+  7544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.430715 (+ 13706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.432416 26505 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:03.432801 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54888 (request call id 2115) took 4360 ms. Trace:
I20260709 13:11:03.433367 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2767) took 1533 ms. Trace:
I20260709 13:11:03.435052 26655 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:03.433781 26505 rpcz_store.cc:276] 0709 13:11:01.899782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.429630 (+1529848us) service_pool.cc:224] Handling call
0709 13:11:03.429942 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.433134 (+  3192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.433318 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:02.998350 30680 log.cc:927] Time spent T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:11:02.896318 30629 raft_consensus.cc:697] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:02.896494 30234 raft_consensus.cc:697] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:02.991461 30676 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.445173 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2136) took 1539 ms. Trace:
W20260709 13:11:03.474545 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.433542 26657 rpcz_store.cc:276] 0709 13:10:59.101774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.518853 (+3417079us) service_pool.cc:224] Handling call
0709 13:11:03.414298 (+895445us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:03.438499 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.437155 26653 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:02.999836 30602 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:02.977949 30168 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:03.495850 26656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.014s
I20260709 13:11:03.186409 30677 tablet_copy_client.cc:323] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:11:02.991772 30398 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.162997 30616 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:03.505458 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.505177 30234 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:03.507004 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2122) took 3216 ms. Trace:
I20260709 13:11:03.507706 26659 rpcz_store.cc:276] 0709 13:11:00.290204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.541011 (+2250807us) service_pool.cc:224] Handling call
0709 13:11:02.541370 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.552376 (+ 11006us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:02.888085 (+335709us) log.cc:844] Serialized 14 byte log entry
0709 13:11:03.505891 (+617806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:03.505944 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:03.505991 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.506555 (+   564us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.506732 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3460,"thread_start_us":936738,"threads_started":3}
W20260709 13:11:03.200402 30353 consensus_meta.cc:287] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.654s	user 0.004s	sys 0.004s
I20260709 13:11:02.991981 30153 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:02.916349 30488 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:03.486683 26655 rpcz_store.cc:276] 0709 13:11:01.905997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.432945 (+1526948us) service_pool.cc:224] Handling call
0709 13:11:03.434860 (+  1915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.444785 (+  9925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.445104 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.447002 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2338) took 1469 ms. Trace:
I20260709 13:11:03.424834 30374 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:03.490469 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2132) took 1808 ms. Trace:
I20260709 13:11:03.217770 30684 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.301s
W20260709 13:11:02.979008 30681 log.cc:927] Time spent T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
W20260709 13:11:03.440652 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.496975 26656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.005s	sys 0.014s
I20260709 13:11:03.497653 26657 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:03.172513 30545 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.471771 30695 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
I20260709 13:11:03.435847 26501 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:03.500835 30627 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:03.500646 30685 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:11:03.472339 30499 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:03.495708 30676 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:03.905464 30638 consensus_meta.cc:287] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.216s	user 0.013s	sys 0.006s
W20260709 13:11:03.914242 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.935438 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 518460us
I20260709 13:11:03.739244 26654 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:11:03.930526 27243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.016s	sys 0.011s
W20260709 13:11:03.913245 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 491514us
I20260709 13:11:03.960873 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2333) took 2138 ms. Trace:
I20260709 13:11:03.610105 27270 raft_consensus.cc:3055] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:03.961021 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2141) took 1745 ms. Trace:
I20260709 13:11:03.575613 27273 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:03.574780 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 980) took 1277 ms. Trace:
W20260709 13:11:03.913544 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 495617us
I20260709 13:11:03.690172 26404 catalog_manager.cc:5697] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 3 to 5, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 5 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:03.616699 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2749) took 3589 ms. Trace:
W20260709 13:11:03.960491 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.963658 27276 rpcz_store.cc:276] 0709 13:11:02.297046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.333804 (+ 36758us) service_pool.cc:224] Handling call
0709 13:11:03.574569 (+1240765us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54005f1c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:03.574713 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61757696}
W20260709 13:11:03.966238 26473 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.590s (SENT) [suppressed 38 similar messages]
W20260709 13:11:03.960306 27243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.016s	sys 0.011s
I20260709 13:11:03.962085 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2137) took 2029 ms. Trace:
I20260709 13:11:03.962814 26654 rpcz_store.cc:276] 0709 13:11:02.216008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.738542 (+1522534us) service_pool.cc:224] Handling call
0709 13:11:03.738955 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.960787 (+221832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.960972 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.961545 26501 rpcz_store.cc:276] 0709 13:11:01.823428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.427159 (+1603731us) service_pool.cc:224] Handling call
0709 13:11:03.427518 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.960583 (+533065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.960818 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53888}
I20260709 13:11:03.962610 27270 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:11:03.969724 26549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.010s	sys 0.006s
W20260709 13:11:03.971983 26549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.011s	sys 0.006s
I20260709 13:11:03.972317 26501 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:03.964637 26506 rpcz_store.cc:276] 0709 13:11:00.026869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.268666 (+2241797us) service_pool.cc:224] Handling call
0709 13:11:02.421052 (+152386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.481824 (+ 60772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.616411 (+1134587us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54000023d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:03.616616 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349839744}
I20260709 13:11:03.967918 26657 rpcz_store.cc:276] 0709 13:11:01.932607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.494308 (+1561701us) service_pool.cc:224] Handling call
0709 13:11:03.494688 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.961800 (+467112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.962030 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.963912 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:03.960346 26505 rpcz_store.cc:276] 0709 13:11:01.977787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.436040 (+1458253us) service_pool.cc:224] Handling call
0709 13:11:03.436312 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.446567 (+ 10255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.446606 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:03.446659 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:03.446702 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.446776 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.446921 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:03.526836 30168 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:03.961145 26653 rpcz_store.cc:276] 0709 13:11:01.682234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.413233 (+1730999us) service_pool.cc:224] Handling call
0709 13:11:03.436766 (+ 23533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.490105 (+ 53339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.490405 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:03.736209 30694 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
W20260709 13:11:03.746994 30609 consensus_meta.cc:287] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.871s	user 0.010s	sys 0.000s
W20260709 13:11:03.736321 30654 consensus_meta.cc:287] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.186s	user 0.008s	sys 0.004s
I20260709 13:11:03.963806 26474 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:03.608496 30548 consensus_meta.cc:287] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.960s	user 0.009s	sys 0.007s
W20260709 13:11:03.596485 30599 consensus_meta.cc:287] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.858s	user 0.007s	sys 0.000s
W20260709 13:11:03.739544 30662 consensus_meta.cc:287] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.774s	user 0.002s	sys 0.007s
W20260709 13:11:03.602187 30696 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:11:03.737139 30700 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 13:11:03.981643 26580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.000s	sys 0.022s
W20260709 13:11:04.120282 26580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.000s	sys 0.023s
I20260709 13:11:04.121094 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 2018) took 2307 ms. Trace:
I20260709 13:11:04.121523 26580 rpcz_store.cc:276] 0709 13:11:01.813937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.230340 (+416403us) service_pool.cc:224] Handling call
0709 13:11:02.264647 (+ 34307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.264852 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:02.610091 (+345239us) log.cc:844] Serialized 14 byte log entry
0709 13:11:03.074482 (+464391us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.120678 (+1046196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.120734 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:04.120792 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.120896 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.121032 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12492,"prepare.queue_time_us":177681,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":438,"raft.queue_time_us":1018000,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":82532,"spinlock_wait_cycles":52521856,"thread_start_us":1793158,"threads_started":3,"wal-append.queue_time_us":883963}
I20260709 13:11:03.506683 30398 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:03.597270 30543 consensus_meta.cc:287] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.145s	user 0.012s	sys 0.000s
W20260709 13:11:03.968079 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 551764us
I20260709 13:11:03.942239 30720 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.734784 30709 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.008088 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.533806 30353 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:03.942716 30716 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.941506 30718 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.943333 30602 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:03.522886 30616 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:03.973085 27270 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:03.602615 30687 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:03.977787 30653 consensus_meta.cc:287] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.453s	user 0.016s	sys 0.005s
W20260709 13:11:04.040836 27240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.010s	sys 0.031s
I20260709 13:11:03.944262 30638 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:03.736680 30153 consensus_queue.cc:1059] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.297s
I20260709 13:11:03.979527 30488 raft_consensus.cc:697] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:03.980218 30542 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.980607 30627 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.690675 30629 consensus_queue.cc:237] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:03.982149 30168 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:04.036832 30675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.012s	sys 0.012s
I20260709 13:11:04.074699 30599 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:04.302623 30675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.012s	sys 0.012s
I20260709 13:11:04.125772 27243 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:04.035472 30620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.012s
I20260709 13:11:03.988479 30684 consensus_queue.cc:1243] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:03.745163 30697 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.295s
I20260709 13:11:03.977984 30712 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:03.562338 30699 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.480s
I20260709 13:11:04.323073 30699 consensus_queue.cc:1059] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:03.755671 30698 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.326s
I20260709 13:11:04.031597 30708 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:04.325327 30708 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.300252 30542 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.327448 30708 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:04.304049 30627 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:03.966444 30704 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.216s
I20260709 13:11:04.329418 30627 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.303634 30711 consensus_queue.cc:1059] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:11:04.331332 30705 log.cc:927] Time spent T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.395s	user 0.000s	sys 0.000s
I20260709 13:11:04.295184 30717 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:04.332124 30717 raft_consensus.cc:697] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:04.333007 30717 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.334945 30698 raft_consensus.cc:3055] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:04.335335 30698 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:11:04.309708 30620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.014s	sys 0.012s
I20260709 13:11:04.336108 30698 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.337689 30722 raft_consensus.cc:3055] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:04.338138 30722 raft_consensus.cc:740] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:04.338960 30722 consensus_queue.cc:260] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.341403 30599 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:04.342195 30703 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
I20260709 13:11:04.342413 30599 raft_consensus.cc:3055] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:04.342890 30599 raft_consensus.cc:740] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:04.343669 30599 consensus_queue.cc:260] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.042474 30688 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:04.344766 30692 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.589s	user 0.000s	sys 0.001s
I20260709 13:11:04.264003 30707 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.345920 30602 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.346163 30707 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.349668 30707 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:04.350291 30676 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.060832 30548 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.359719 30398 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.360231 30548 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.154186 30543 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.361140 30638 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:04.362142 30543 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:04.228950 30694 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:11:04.248862 30718 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.248673 30716 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.264686 30687 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.249253 30709 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.121637 30662 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.319525 30685 raft_consensus.cc:2764] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:11:04.291713 30488 consensus_queue.cc:237] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.418179 26509 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:11:03.972515 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.419904 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.420754 30709 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:04.404824 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2330) took 2606 ms. Trace:
I20260709 13:11:04.319754 30712 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.977258 26505 pending_rounds.cc:85] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 4
I20260709 13:11:04.422179 30712 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:04.422245 30674 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.422724 26505 pending_rounds.cc:107] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.5
I20260709 13:11:04.423390 26505 raft_consensus.cc:2917] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Aborting config change with OpId 7.5: Aborted: Op aborted by new leader
I20260709 13:11:04.424419 26505 raft_consensus.cc:2889] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:04.423650 30674 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.365151 30718 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:04.035770 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 72036.3us
I20260709 13:11:04.040362 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 527) took 4328 ms. Trace:
I20260709 13:11:04.190300 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:04.406852 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2318) took 4209 ms. Trace:
I20260709 13:11:04.412757 26655 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:11:04.155922 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:04.250130 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:04.162263 27242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.045s	sys 0.056s
I20260709 13:11:04.457008 26653 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:04.457690 27242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.048s	sys 0.063s
W20260709 13:11:04.459540 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.259073 27240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.010s	sys 0.031s
W20260709 13:11:04.311123 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 185443us
W20260709 13:11:04.460969 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 1.03578e+06us
I20260709 13:11:04.462376 30685 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.463449 30685 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.228607 27270 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:04.466917 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:04.467837 30684 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:04.303435 30168 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.470300 30708 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:04.471619 30685 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:04.426435 30718 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.222190 30353 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.474035 30353 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.473764 30718 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.476418 30718 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:04.415035 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.327481 30542 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:04.416481 30706 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.765s	user 0.000s	sys 0.004s
I20260709 13:11:03.985832 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2773) took 1510 ms. Trace:
I20260709 13:11:03.968045 30545 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.031539 30609 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.266932 30653 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.510221 26651 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:04.510895 26654 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:11:04.511547 30653 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.511629 30609 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:04.191140 30654 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:04.372342 30716 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:04.157132 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.412935 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.364416 30616 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:04.403553 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 437037us
I20260709 13:11:04.530174 30716 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.531409 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.531114 30716 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:04.531898 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.408794 26502 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:04.533617 30398 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:04.534420 30398 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.226218 30720 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.428505 26652 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:04.429739 26507 rpcz_store.cc:276] 0709 13:11:00.197070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.419502 (+2222432us) service_pool.cc:224] Handling call
0709 13:11:02.427155 (+  7653us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:02.533587 (+106432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.533619 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:02.534145 (+   526us) log.cc:844] Serialized 52 byte log entry
0709 13:11:02.672920 (+138775us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b18003e2d80. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c90d1 00007f882c8e4a0f
0709 13:11:02.749409 (+ 76489us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:02.749475 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.749620 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.406006 (+1656386us) raft_consensus.cc:1685] finished
0709 13:11:04.406066 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.406635 (+   569us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35549,"raft.queue_time_us":46824,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":15940,"spinlock_wait_cycles":10814720,"thread_start_us":76207,"threads_started":1,"wal-append.queue_time_us":904781}
I20260709 13:11:04.425540 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46306 (request call id 1) took 6384 ms. Trace:
I20260709 13:11:04.541112 26505 rpcz_store.cc:276] 0709 13:10:58.040927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.048136 (+  7209us) service_pool.cc:224] Handling call
0709 13:10:58.724581 (+676445us) log.cc:844] Serialized 513 byte log entry
0709 13:11:01.172893 (+2448312us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b180025fe40. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:04.425358 (+3252465us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":910,"raft.run_wall_time_us":203587,"spinlock_wait_cycles":32019712,"thread_start_us":212592,"threads_started":1,"wal-append.queue_time_us":422791,"wal-append.run_cpu_time_us":1782,"wal-append.run_wall_time_us":1032877}
I20260709 13:11:04.543757 30674 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:04.429790 26581 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:04.427366 26474 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:04.480293 26501 rpcz_store.cc:276] 0709 13:11:02.475214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.971845 (+1496631us) service_pool.cc:224] Handling call
0709 13:11:03.972157 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.985429 (+ 13272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.985749 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.428897 26510 rpcz_store.cc:276] 0709 13:10:59.711604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.267768 (+2556164us) service_pool.cc:224] Handling call
0709 13:11:02.268046 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.513404 (+245358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.040071 (+1526667us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5400359154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:04.040282 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562882304}
W20260709 13:11:04.505908 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 307488us
I20260709 13:11:04.455308 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:04.480986 30662 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:04.421761 26503 rpcz_store.cc:276] 0709 13:11:01.797830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.674199 (+876369us) service_pool.cc:224] Handling call
0709 13:11:02.704648 (+ 30449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.716442 (+ 11794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.716488 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.717157 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:11:03.424706 (+707549us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:03.424744 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.424807 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.403558 (+978751us) raft_consensus.cc:1685] finished
0709 13:11:04.403663 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.404282 (+   619us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":19505,"thread_start_us":707187,"threads_started":1,"wal-append.queue_time_us":1229336}
I20260709 13:11:04.455183 30549 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:04.538112 30720 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:04.547812 27241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.002s	sys 0.000s
I20260709 13:11:04.554843 26577 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:04.555691 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.555889 30645 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.547968 30562 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.557017 30562 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.558550 30687 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:04.559523 30562 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.559772 30549 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:04.560839 27241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.003s	sys 0.001s
W20260709 13:11:04.566058 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.571399 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 625287us
W20260709 13:11:04.571880 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 144991us
I20260709 13:11:04.575428 30549 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.577029 30716 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:04.578320 26550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.003s	sys 0.003s
W20260709 13:11:04.578806 26550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.004s	sys 0.004s
I20260709 13:11:04.577543 26404 catalog_manager.cc:5697] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 1 to 5, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 5 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.579449 27243 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:04.560365 30545 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:04.581555 30398 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:04.582194 26548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.002s	sys 0.005s
I20260709 13:11:04.582418 30398 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:04.582670 26548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.002s	sys 0.006s
I20260709 13:11:04.583076 30398 raft_consensus.cc:697] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:11:04.583207 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 619354us
I20260709 13:11:04.584365 26548 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:04.586135 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 825) took 6390 ms. Trace:
I20260709 13:11:04.586584 26650 rpcz_store.cc:276] 0709 13:10:58.195475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.226102 (+4030627us) service_pool.cc:224] Handling call
0709 13:11:02.226338 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.503715 (+277377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.585501 (+2081786us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400108e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:04.585921 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485066624}
W20260709 13:11:04.587437 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.587906 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 841) took 2183 ms. Trace:
I20260709 13:11:04.588366 26655 rpcz_store.cc:276] 0709 13:11:02.404099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.943696 (+1539597us) service_pool.cc:224] Handling call
0709 13:11:03.944053 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.430081 (+486028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.587522 (+157441us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400143054. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:04.587832 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075716864}
I20260709 13:11:04.588976 26650 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:04.571388 30654 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.592746 30654 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:04.594799 27276 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:11:04.595582 30465 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:04.597195 30735 log.cc:927] Time spent T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:11:04.597025 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:04.598388 27275 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:11:04.598759 30698 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.600242 30687 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:04.601648 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:02.915333 26504 rpcz_store.cc:276] 0709 13:11:00.977171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.530013 (+1552842us) service_pool.cc:224] Handling call
0709 13:11:02.530291 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.530541 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:02.570217 (+ 39676us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.874003 (+303786us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.889309 (+ 15306us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:02.889365 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:02.889416 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.889488 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.889620 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48058,"prepare.queue_time_us":41548,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":48729,"spinlock_wait_cycles":16640,"thread_start_us":269920,"threads_started":1}
I20260709 13:11:04.602775 27277 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:04.605113 26405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34748 (request call id 320) took 30646 ms (client timeout 15000 ms). Trace:
I20260709 13:11:04.605927 30616 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.606160 27272 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:04.606813 30616 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.610214 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 979) took 2313 ms. Trace:
I20260709 13:11:04.610594 30616 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.627089 30718 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:04.596916 26653 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:04.615025 26506 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:04.617822 27269 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:04.639974 26654 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:11:04.616501 27271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 977) took 2320 ms (client timeout 1504 ms). Trace:
W20260709 13:11:04.615609 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 150026us
I20260709 13:11:04.613917 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2328) took 2826 ms. Trace:
I20260709 13:11:04.637126 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:04.624971 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2114) took 5584 ms. Trace:
I20260709 13:11:04.610718 27273 rpcz_store.cc:276] 0709 13:11:02.296745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.428446 (+131701us) service_pool.cc:224] Handling call
0709 13:11:03.574961 (+1146515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.963280 (+388319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.609722 (+646442us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54005f1c50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:04.609979 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2636067072}
I20260709 13:11:04.621176 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:04.641678 27271 rpcz_store.cc:269] 0709 13:11:02.296192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.322611 (+ 26419us) service_pool.cc:224] Handling call
0709 13:11:04.616019 (+2293408us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54005aa354. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:04.616256 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4602618624}
I20260709 13:11:04.581039 26404 catalog_manager.cc:5697] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 3 to 5, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 5 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.612735 27274 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.653825 26577 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
W20260709 13:11:04.656301 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.642894 26508 rpcz_store.cc:276] 0709 13:11:01.787868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.672644 (+884776us) service_pool.cc:224] Handling call
0709 13:11:02.672949 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.784577 (+111628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.613372 (+1828795us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b54003ec954. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:04.613718 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41966976}
I20260709 13:11:04.656265 30616 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.659859 30740 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:04.626478 30737 consensus_queue.cc:1059] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:11:04.661197 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:04.605127 30599 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:04.662202 30660 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:04.625744 30644 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:04.581511 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 941b69cce0d24bb9a4f60558447429c4: Aborted: Op aborted by new leader
I20260709 13:11:04.663242 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:04.665895 30591 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:04.669750 30717 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:04.626817 30716 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:04.619334 30722 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:04.616091 30711 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:04.694453 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:04.704321 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 829) took 4189 ms. Trace:
I20260709 13:11:04.700992 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:04.705224 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2761) took 2905 ms. Trace:
I20260709 13:11:04.705693 26502 rpcz_store.cc:276] 0709 13:11:01.800014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.788118 (+988104us) service_pool.cc:224] Handling call
0709 13:11:03.409696 (+621578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.533748 (+1124052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.704951 (+171203us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b5400352ad4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:04.705163 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2294728448}
I20260709 13:11:04.708703 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2774) took 2233 ms. Trace:
I20260709 13:11:04.709966 30616 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.657943 30353 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.704841 26652 rpcz_store.cc:276] 0709 13:11:00.515123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.671401 (+2156278us) service_pool.cc:224] Handling call
0709 13:11:02.671672 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.538677 (+1867005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.703994 (+165317us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540039b7d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:04.704226 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4038913920}
I20260709 13:11:04.761950 26404 catalog_manager.cc:5697] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 5 to 6, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 6 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.647306 26656 rpcz_store.cc:276] 0709 13:10:59.040127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.495562 (+3455435us) service_pool.cc:224] Handling call
0709 13:11:02.528249 (+ 32687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.528458 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:02.985545 (+457087us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.621903 (+1636358us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.624080 (+  2177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.624208 (+   128us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:04.624364 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.624497 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.624733 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30443,"prepare.queue_time_us":1318000,"prepare.run_cpu_time_us":6291,"prepare.run_wall_time_us":20115,"raft.queue_time_us":189002,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":74421,"thread_start_us":2038086,"threads_started":4,"wal-append.queue_time_us":748126}
I20260709 13:11:04.772028 30662 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.773396 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:04.782996 27272 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:04.775218 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:04.776443 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:04.777146 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2340) took 2240 ms. Trace:
I20260709 13:11:04.777419 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:04.778141 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:04.779384 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:04.780179 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:04.796336 26505 rpcz_store.cc:276] 0709 13:11:02.536374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.976546 (+1440172us) service_pool.cc:224] Handling call
0709 13:11:03.977017 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.543450 (+566433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.543493 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.544088 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.645974 (+101886us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:04.645997 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.646044 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.776864 (+130820us) raft_consensus.cc:1685] finished
0709 13:11:04.776895 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.777071 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":101518,"threads_started":1,"wal-append.queue_time_us":165447}
W20260709 13:11:04.797708 26651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2138) took 2585 ms (client timeout 1614 ms). Trace:
I20260709 13:11:04.798619 26504 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.799803 27271 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:04.780114 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:04.801935 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:04.802268 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2327) took 3473 ms. Trace:
I20260709 13:11:04.803330 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:04.804059 27276 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:04.802220 26583 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:04.802806 26509 rpcz_store.cc:276] 0709 13:11:01.328937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.578306 (+1249369us) service_pool.cc:224] Handling call
0709 13:11:02.578712 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.418757 (+1840045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.801904 (+383147us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54000b40d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:04.802161 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4228742528}
I20260709 13:11:04.801226 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:04.807175 30549 raft_consensus.cc:3055] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:04.807420 26658 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:04.798360 26579 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.807689 30549 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:04.808827 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2000) took 2907 ms. Trace:
I20260709 13:11:04.809118 30549 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.809192 26658 rpcz_store.cc:276] 0709 13:11:01.900935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.422090 (+1521155us) service_pool.cc:224] Handling call
0709 13:11:03.422377 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.807866 (+1385489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.808551 (+   685us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540039bcd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:04.808760 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3184186624}
I20260709 13:11:04.801371 27269 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:04.781854 30602 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:04.819885 30720 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:04.820413 30720 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:04.822002 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:04.823029 30353 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:04.824165 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:04.825207 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:04.826079 26503 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:04.781740 30676 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.781814 30674 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:04.782392 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2140) took 2566 ms. Trace:
I20260709 13:11:04.782970 30374 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:04.827879 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:04.827672 30374 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.829514 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:04.827286 30674 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.780821 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:04.783655 30734 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.298s	user 0.006s	sys 0.000s
I20260709 13:11:04.783872 30688 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.784199 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 83042.2us
I20260709 13:11:04.784055 30660 consensus_queue.cc:1059] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:04.784777 30716 raft_consensus.cc:697] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:04.830403 26505 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.785374 30488 raft_consensus.cc:3055] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:04.869259 30488 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:04.868858 30688 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.870340 30488 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.870514 30716 consensus_queue.cc:237] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.871809 30488 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.871991 30688 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.785838 30591 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:04.873304 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:04.772585 30545 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.789199 30719 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.875597 30374 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:04.875551 30719 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:04.856961 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.876647 30704 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:04.877584 30645 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.877892 30727 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.878216 30465 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:04.878604 30727 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.878932 30465 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.879528 30609 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.879799 30522 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.880291 30609 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.880455 30522 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.880940 30465 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:04.881145 30727 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:04.861657 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.858867 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 237900us
W20260709 13:11:04.882357 26622 connection.cc:256] RPC call timeout handler was delayed by -1.9447371700000531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
I20260709 13:11:04.880311 30654 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:11:04.882611 30522 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:04.884768 30653 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.882611 30609 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:04.791519 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 104057us
W20260709 13:11:04.885843 26622 connection.cc:256] RPC call timeout handler was delayed by -1.527000930999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 13:11:04.886385 30591 consensus_queue.cc:1059] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:11:04.885353 26625 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:04.793717 27275 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:11:04.888868 30737 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:04.886747 30645 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.891482 27273 raft_consensus.cc:2410] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:04.892060 30645 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.892609 30645 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.792639 26506 rpcz_store.cc:276] 0709 13:11:02.475550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.974671 (+1499121us) service_pool.cc:224] Handling call
0709 13:11:04.614272 (+639601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.637682 (+ 23410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.708419 (+ 70737us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54003ec950. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:04.708618 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1330346368}
I20260709 13:11:04.885520 30653 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.894860 30545 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.896554 30653 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.896991 30545 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.824345 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:04.584499 30398 consensus_queue.cc:237] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.781005 30712 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.705760 30695 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.867594 30660 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:04.883793 30542 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.700933 30562 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:04.889124 30591 raft_consensus.cc:3055] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:04.897094 30653 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.864136 30721 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.821578 30720 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:04.785195 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.903024 26474 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:04.605646 26405 rpcz_store.cc:269] 0709 13:10:33.958561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.958837 (+   276us) service_pool.cc:224] Handling call
0709 13:10:34.183594 (+224757us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b540013f454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c893090 00007f882c931f3a 00007f88326e81cc 00007f88327e637e 00007f8830ca72a4 00007f8830ca7232 00007f8830ca7161 00007f8830ca70dc 00007f8830ca6392 00007f882ac6448c 00007f882ac638c6
0709 13:11:04.604792 (+30421198us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:44.389060 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:44.421889 (+ 32829us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:44.421947 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:10:44.421971 (+    24us) tablet.cc:662] Decoding operations
0709 13:10:44.423636 (+  1665us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:44.423711 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:44.423748 (+    37us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:10:44.425111 (+  1363us) tablet.cc:701] Row locks acquired
0709 13:10:44.425160 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:10:44.425358 (+   198us) write_op.cc:270] Start()
0709 13:10:44.425530 (+   172us) write_op.cc:276] Timestamp: P: 1783602644425278 usec, L: 0
0709 13:10:44.425552 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:44.580173 (+154621us) log.cc:844] Serialized 5980 byte log entry
0709 13:10:45.645022 (+1064849us) op_driver.cc:464] REPLICATION: finished
0709 13:10:45.843400 (+198378us) write_op.cc:301] APPLY: starting
0709 13:10:45.843548 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:45.844009 (+   461us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:45.844191 (+   182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:45.909778 (+ 65587us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:45.910165 (+   387us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:10:45.928931 (+ 18766us) write_op.cc:312] APPLY: finished
0709 13:10:46.033790 (+104859us) log.cc:844] Serialized 107 byte log entry
0709 13:10:46.103659 (+ 69869us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:46.118278 (+ 14619us) write_op.cc:454] Released schema lock
0709 13:10:46.130871 (+ 12593us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:46.171189 (+ 40318us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:46.177107 (+  5918us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16392,"reported_tablets":43,"spinlock_wait_cycles":33325824,"child_traces":[["op",{"apply.queue_time_us":191213,"apply.run_cpu_time_us":6438,"apply.run_wall_time_us":310221,"num_ops":15,"prepare.queue_time_us":288888,"prepare.run_cpu_time_us":48797,"prepare.run_wall_time_us":611029,"raft.queue_time_us":366356,"raft.run_cpu_time_us":9555,"raft.run_wall_time_us":241112,"replication_time_us":1164503,"thread_start_us":756429,"threads_started":4,"wal-append.queue_time_us":461720,"wal-append.run_cpu_time_us":61489,"wal-append.run_wall_time_us":2098747}]]}
I20260709 13:11:04.853893 27277 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:04.827243 26659 rpcz_store.cc:276] 0709 13:11:02.215484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.509345 (+1293861us) service_pool.cc:224] Handling call
0709 13:11:03.528421 (+ 19076us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:04.187114 (+658693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.187146 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:04.266099 (+ 78953us) log.cc:844] Serialized 52 byte log entry
0709 13:11:04.562072 (+295973us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:04.638184 (+ 76112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.645053 (+  6869us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.782021 (+136968us) raft_consensus.cc:1685] finished
0709 13:11:04.782041 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.782232 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":513692,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":104115,"thread_start_us":336688,"threads_started":2,"wal-append.queue_time_us":382368}
W20260709 13:11:04.905368 26622 connection.cc:256] RPC call timeout handler was delayed by -1.4869372680000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
I20260709 13:11:04.790783 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2857) took 2257 ms. Trace:
I20260709 13:11:04.906356 27276 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:04.783135 26549 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:04.907881 26583 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:11:04.909230 26579 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:04.885689 30609 raft_consensus.cc:3055] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:04.828641 26509 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:04.917965 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2341) took 2369 ms. Trace:
I20260709 13:11:04.942546 26507 rpcz_store.cc:276] 0709 13:11:02.536696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.539573 (+2002877us) service_pool.cc:224] Handling call
0709 13:11:04.540493 (+   920us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.565913 (+ 25420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.565954 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.599359 (+ 33405us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.691060 (+ 91701us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:04.691100 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.691168 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.905739 (+214571us) raft_consensus.cc:1685] finished
0709 13:11:04.905758 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.905899 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6590,"raft.queue_time_us":21798,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":27384,"thread_start_us":91186,"threads_started":1,"wal-append.queue_time_us":256686}
W20260709 13:11:04.798321 26651 rpcz_store.cc:269] 0709 13:11:02.212741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.218113 (+  5372us) service_pool.cc:224] Handling call
0709 13:11:04.797354 (+2579241us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54001423d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:04.797621 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5224085760}
I20260709 13:11:04.862726 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:04.925500 26504 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:04.893311 30645 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.814939 30168 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.923751 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:04.908959 30549 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:04.940706 26622 connection.cc:256] RPC call timeout handler was delayed by -1.4674300760000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 13:11:04.939533 26584 rpcz_store.cc:276] 0709 13:11:02.533318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.549283 (+ 15965us) service_pool.cc:224] Handling call
0709 13:11:02.691010 (+141727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.691841 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.707853 (+2016012us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540015c550. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:04.790506 (+ 82653us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258911104}
I20260709 13:11:04.947660 30542 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.913738 30660 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:04.948918 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 63523.4us
W20260709 13:11:04.949508 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 166539us
I20260709 13:11:04.919874 30562 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:04.920115 30591 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:04.951623 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.951105 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.935379 30465 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:04.965391 26622 connection.cc:256] RPC call timeout handler was delayed by -1.1800372679999782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:11:04.967553 26622 connection.cc:256] RPC call timeout handler was delayed by -1.1302059659999486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
I20260709 13:11:04.969118 27270 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:04.942667 30698 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:04.968658 26622 connection.cc:256] RPC call timeout handler was delayed by -1.1248059659999399s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:11:04.972819 26622 connection.cc:256] RPC call timeout handler was delayed by -1.1055686039999273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.268s for a response
I20260709 13:11:04.973956 27270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 976) took 2678 ms. Trace:
I20260709 13:11:04.974501 27270 rpcz_store.cc:276] 0709 13:11:02.295898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.334956 (+ 39058us) service_pool.cc:224] Handling call
0709 13:11:02.353538 (+ 18582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.610000 (+1256462us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54003feba0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8a0dc0 00007f882c92b1c0 00007f882c92c231 00007f882c928d8f 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c
0709 13:11:04.973492 (+1363492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.973884 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201320192}
I20260709 13:11:04.974689 30591 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.944799 30662 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.976603 30591 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:04.942238 30609 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:04.827193 30676 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.963246 30562 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:04.943223 30653 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:04.993387 30711 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:11:04.998559 30645 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:04.999145 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.999256 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 307878us
I20260709 13:11:04.980876 30662 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:04.978647 30698 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.935175 30695 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:04.984851 26404 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:05.002934 30600 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:05.007211 30673 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:11:05.007571 30711 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:05.011396 26502 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:04.991657 30374 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:05.010720 27274 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:11:05.010243 30685 consensus_queue.cc:1059] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:11:04.954284 30721 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:05.017545 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.016862 27274 pending_rounds.cc:85] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 8
I20260709 13:11:05.019809 27274 pending_rounds.cc:107] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:11:04.988296 30602 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:11:05.020237 27274 raft_consensus.cc:2889] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:05.012471 30698 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.027242 30600 raft_consensus.cc:697] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:05.028563 30600 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.036861 26507 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:05.041906 26576 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.044416 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:05.016844 30711 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:05.045068 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 986) took 2616 ms. Trace:
I20260709 13:11:05.022820 30720 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.020443 30660 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:05.067090 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 182728us
I20260709 13:11:05.066442 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.045480 27274 rpcz_store.cc:276] 0709 13:11:02.429069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.444906 (+ 15837us) service_pool.cc:224] Handling call
0709 13:11:02.445219 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.611498 (+2166279us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5800814dd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c8850aa 00007f882c907447 00007f882c91ffe7 00007f882c9217de 00007f882c92bb49 00007f882c92c416 00007f882c928d8f 00007f882c92883e 00007f88318ed419 00007f882ae64bd4
0709 13:11:05.037648 (+426150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.045012 (+  7364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933653248}
I20260709 13:11:05.010242 30609 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:05.049474 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet 941b69cce0d24bb9a4f60558447429c4 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:11:05.076018 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet 941b69cce0d24bb9a4f60558447429c4 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-941b69cce0d24bb9a4f60558447429c4
I20260709 13:11:05.076542 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.078421 30660 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.078804 30674 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:05.079478 26404 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 8 to 9, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 9 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:05.049340 30704 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:05.049811 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.082086 30685 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.019467 30616 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:05.050344 30662 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:05.082710 30685 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.083458 30662 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:05.085107 26520 tablet_copy_source_session.cc:215] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:05.051060 30687 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.085928 30685 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:05.085865 30687 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.086459 30542 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:05.086723 30685 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:05.087146 30542 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:05.088456 30687 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:05.050386 30545 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:05.051505 30629 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.052152 30645 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:05.049871 30234 raft_consensus.cc:3055] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:05.089823 30234 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:05.090449 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:05.090843 30234 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.053932 30754 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:05.092450 30234 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.093176 30754 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:05.093783 30545 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:05.096984 30616 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:05.097714 30616 raft_consensus.cc:697] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:05.098333 30653 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:05.099047 26625 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:05.098975 30653 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:05.098726 30616 consensus_queue.cc:237] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:05.054869 30465 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:05.055757 30727 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:05.025219 30374 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:05.074213 26658 raft_consensus.cc:2410] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:11:05.074669 26505 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:05.091748 30662 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:05.054373 30719 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:05.081174 26404 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.114253 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:05.117828 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.075532 26509 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:05.136337 26501 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:11:05.102834 30754 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:05.142006 27278 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:05.141021 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.149861 26508 raft_consensus.cc:2410] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 8 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:11:05.158164 30374 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.144819 30599 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:05.161765 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.162015 30599 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.164049 30599 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:05.165504 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:05.168409 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 69493.4us
I20260709 13:11:05.091292 30629 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.121950 30522 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:11:05.176570 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.166250 26657 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:05.172089 26576 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
W20260709 13:11:05.168301 26549 leader_election.cc:336] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.614s (SENT)
I20260709 13:11:05.175159 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.175997 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.179555 27270 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:05.183202 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.152976 30712 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:05.184036 27276 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 6.
W20260709 13:11:05.185350 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 129429us
I20260709 13:11:05.185906 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.187703 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:11:05.191525 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.175647 30673 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.205752 27274 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:05.177942 30168 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:05.207470 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.210740 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:05.211069 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:05.211485 27272 raft_consensus.cc:2376] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8. Re-sending same reply.
I20260709 13:11:05.211694 27269 raft_consensus.cc:2376] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8. Re-sending same reply.
I20260709 13:11:05.212648 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.212750 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:05.213790 30685 consensus_queue.cc:1059] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:05.214243 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.214769 30685 raft_consensus.cc:3055] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:05.214998 27272 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:05.215916 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.216199 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.215132 30685 raft_consensus.cc:740] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:05.216740 27270 raft_consensus.cc:2410] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:11:05.213299 27269 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:05.216949 27272 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
W20260709 13:11:05.216756 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.217959 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.219336 26625 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:05.220175 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 45377.5us
I20260709 13:11:05.221539 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.222381 27276 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:11:05.223135 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.218290 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:05.223733 27275 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:05.225346 30673 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.226205 26658 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:05.227633 26658 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:05.229089 30695 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:05.230010 30711 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.231789 30711 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:05.233834 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 215617us
I20260709 13:11:05.235757 27243 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:05.237962 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.241048 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:05.241917 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.242285 30721 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:05.242321 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.245909 30562 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:05.246835 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 62142.1us
I20260709 13:11:05.224342 26404 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 3 to 7, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 7 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.252557 26577 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:05.254734 30718 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:05.255240 26473 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:05.255497 30718 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.256598 26473 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:05.256819 26584 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 5.
I20260709 13:11:05.257440 30353 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:05.257850 30688 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:05.258342 30688 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:05.258816 30688 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:05.191239 30662 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:11:05.259130 30465 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:05.259064 30353 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:05.260689 30353 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.261011 30353 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.260941 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.261942 30676 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:05.242093 30755 log.cc:927] Time spent T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 13:11:05.274189 30562 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:05.252940 26404 catalog_manager.cc:5697] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 6 to 7, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 7 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.228792 30698 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.264487 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.264526 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.258711 26625 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:05.276144 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:05.286290 26579 raft_consensus.cc:2393] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:05.286571 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 50907.1us
I20260709 13:11:05.288226 27243 leader_election.cc:400] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
I20260709 13:11:05.288560 26659 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:11:05.288480 30660 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:05.289134 26404 catalog_manager.cc:5697] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 3 to 6, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 6 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:05.221589 30754 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:05.289551 30660 raft_consensus.cc:3055] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:05.295347 30660 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:05.296312 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.290963 26404 catalog_manager.cc:5697] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.288592 27243 leader_election.cc:403] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:05.292536 26473 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:05.312269 26548 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:05.310078 30754 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:05.304876 30720 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:11:05.314656 30754 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:05.315193 30754 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.315311 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:05.315721 30720 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:05.316182 30488 raft_consensus.cc:2764] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:11:05.319062 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:05.318684 30660 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:05.319978 30600 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:05.320360 30660 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.320772 30600 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:05.288612 30629 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:05.291155 30695 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:05.272329 30353 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.294186 30718 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:05.361780 30727 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:05.364830 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 45880.6us
W20260709 13:11:05.366969 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 108431us
I20260709 13:11:05.367697 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.368492 27278 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:05.368716 26625 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:05.291071 30698 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:05.370433 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.371016 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:05.371333 27275 raft_consensus.cc:2393] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:05.372363 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.372635 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.373608 26502 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:11:05.372378 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.374334 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.373982 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.377247 26509 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:05.374680 27277 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:05.321806 30600 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.381670 30234 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
I20260709 13:11:05.382776 30716 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:05.387807 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.388121 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.388406 26582 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:05.389295 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.390312 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.391139 26580 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:11:05.391391 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.292475 30742 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:11:05.393090 30762 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.393688 30762 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.396347 30762 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:05.356539 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 52095.7us
I20260709 13:11:05.390401 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:05.398835 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.372753 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:05.402403 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 124831us
I20260709 13:11:05.325846 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:05.316151 30720 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.408134 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:05.404251 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.364428 30685 consensus_queue.cc:260] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.405499 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.387349 30688 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.412606 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.353720 30695 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.415138 26502 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:11:05.415570 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.420576 27275 raft_consensus.cc:2393] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 8: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:11:05.421332 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 133405us
W20260709 13:11:05.423780 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 55180.8us
I20260709 13:11:05.424856 26625 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:05.427039 26651 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:05.430382 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.428251 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:05.432121 26510 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.433969 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:05.436131 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.439391 26506 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:05.431509 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:05.445762 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:05.445464 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.446666 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.447077 26504 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:05.447209 26473 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:05.447400 27275 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:11:05.434122 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:05.436794 27278 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:05.410939 30720 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:05.413857 30727 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:05.451261 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.447947 26625 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:05.410508 30761 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:05.450951 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:05.457659 26507 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:05.458544 26651 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:05.463829 26650 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:05.456670 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.426620 30695 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:05.466059 26659 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:05.467418 26625 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:05.468199 30562 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:05.438068 30653 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:05.472272 27271 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:05.451514 30465 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:05.482750 27240 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:05.474308 26502 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:05.476270 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:05.479789 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.484344 26504 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:05.485011 26578 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:05.485476 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.477283 27241 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:05.469512 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.486811 26501 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:05.486979 26507 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 13: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:05.489348 26503 raft_consensus.cc:2368] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7.
I20260709 13:11:05.491113 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.491926 26502 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:05.475021 30562 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.496791 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:05.460009 30711 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:11:05.495961 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.479624 30234 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:05.498941 27241 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:05.499574 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:05.501231 26473 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:05.479100 30545 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:05.488903 30654 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:05.489745 30712 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:05.462638 30762 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:11:05.465910 30759 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:11:05.498370 30727 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:05.474052 30738 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:11:05.506948 30704 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:05.502000 30562 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.504098 30465 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:05.582734 30465 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:05.567720 30654 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:05.522887 27243 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:05.568010 26506 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:11:05.574920 26625 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:05.570621 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.576085 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:05.512760 30616 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:05.522693 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:05.579252 26504 raft_consensus.cc:1240] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:05.505303 30645 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:05.567808 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50878.3us
I20260709 13:11:05.581703 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:05.670679 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 94671us
I20260709 13:11:05.674089 26548 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:05.571230 30374 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:05.574457 30704 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.522678 30722 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:05.567723 30676 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:05.675443 27271 raft_consensus.cc:2393] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 6: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:11:05.675779 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 104960us
W20260709 13:11:05.570281 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 46600.7us
W20260709 13:11:05.589671 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 167558us
I20260709 13:11:05.706679 26506 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:05.673139 30674 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.741487 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:05.677023 26549 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:05.598297 30645 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.567066 30764 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:05.588308 30727 raft_consensus.cc:697] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:05.761690 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:05.678704 30374 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:05.760138 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 245575us
I20260709 13:11:05.763115 30645 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.702651 30704 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.699092 30602 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:05.675303 30616 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.705874 30653 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:05.701965 30722 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.768447 26505 raft_consensus.cc:1275] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:11:05.769940 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 95960.2us
I20260709 13:11:05.587031 30654 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:05.706179 30676 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:05.743691 30353 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:05.787724 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 282586us
I20260709 13:11:05.769443 30234 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:05.789489 30776 log.cc:927] Time spent T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:11:05.789999 30771 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:11:05.784461 30764 raft_consensus.cc:697] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:11:05.828001 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.766600 30762 consensus_queue.cc:1243] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:05.828625 26548 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:05.763826 30688 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:05.769003 30374 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:05.828430 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 151493us
I20260709 13:11:05.791428 30616 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:05.708431 30754 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:05.786614 30644 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:05.855597 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.787346 30602 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.905508 26579 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:11:05.870025 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.818508 30722 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:05.878592 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 50056.5us
I20260709 13:11:05.910571 26548 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:05.880007 26578 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:05.842360 30591 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:05.842622 30676 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.880532 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.880631 26510 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:11:05.769068 30674 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:05.890463 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 104775us
I20260709 13:11:05.891688 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.823726 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:05.907289 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.908483 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.909013 26651 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:05.909133 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.932798 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:05.946995 30772 log.cc:927] Time spent T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:11:05.933380 30688 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:05.947657 30688 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.948206 30688 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.949699 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:05.950583 30677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941b69cce0d24bb9a4f60558447429c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.950879 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.893712 30742 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:05.934882 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.943318 26585 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:11:05.944195 26651 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:05.902973 30644 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.970671 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:05.911372 30602 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:05.988545 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 78086.6us
I20260709 13:11:05.940476 30591 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:05.998090 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:05.951210 30754 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:05.983460 30653 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:11:05.985298 30765 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:11:06.005952 26548 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:05.949741 30782 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:05.987648 30644 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.023423 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:06.007354 30766 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.440s	user 0.000s	sys 0.002s
I20260709 13:11:06.003837 30591 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:06.034499 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.070515 26650 raft_consensus.cc:2393] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 13: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:06.071120 30606 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:06.071542 30606 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.071885 30606 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:06.072275 30758 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.195s
I20260709 13:11:05.959367 30727 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.032367 26584 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:05.959945 30762 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:11:05.972880 30488 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:11:06.061362 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.029312 26651 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:06.026759 30775 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.449s	user 0.001s	sys 0.000s
I20260709 13:11:05.937654 30763 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.337s
W20260709 13:11:06.029042 30779 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 13:11:06.067304 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 72393.2us
I20260709 13:11:06.067435 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.082504 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:06.095808 26585 raft_consensus.cc:2393] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:06.029251 30599 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:06.100879 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:06.098184 26652 raft_consensus.cc:2393] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:06.055030 30782 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:06.110955 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:06.104568 30769 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.482s	user 0.001s	sys 0.001s
I20260709 13:11:06.104660 26651 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:06.105099 30768 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.395s	user 0.001s	sys 0.001s
W20260709 13:11:06.108114 30562 consensus_meta.cc:287] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:11:06.109277 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.109838 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2150) took 1044 ms. Trace:
I20260709 13:11:06.114924 26654 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:06.115521 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.117916 26656 rpcz_store.cc:276] 0709 13:11:05.065684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.065829 (+   145us) service_pool.cc:224] Handling call
0709 13:11:05.066179 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:05.176635 (+110456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.176666 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:05.206650 (+ 29984us) log.cc:844] Serialized 52 byte log entry
0709 13:11:05.476487 (+269837us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:05.476527 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.476643 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.109611 (+632968us) raft_consensus.cc:1685] finished
0709 13:11:06.109633 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.109777 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23993,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":290538,"threads_started":2,"wal-append.queue_time_us":434826}
I20260709 13:11:06.146392 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.139032 30562 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.150134 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:06.150725 26652 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.151002 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:06.146814 30766 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:11:06.174547 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.177335 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.178972 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:06.189520 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 88709.9us
I20260709 13:11:06.187398 26658 raft_consensus.cc:2410] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:11:06.198815 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 195219us
I20260709 13:11:06.190374 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:06.178128 30775 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:11:06.116780 30599 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:06.177266 30770 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:11:06.221359 26548 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:06.222800 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.227092 26656 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:06.231472 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2157) took 1070 ms. Trace:
I20260709 13:11:06.164819 30718 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 13:11:06.235998 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 7a3ba69234d6417b968d15d31d856dbf: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:06.248021 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.241221 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:06.256875 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.257578 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.257977 26510 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:06.258332 30673 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:06.259202 30609 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:06.109748 30764 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:06.242544 30781 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:11:06.231936 26653 rpcz_store.cc:276] 0709 13:11:05.160863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.160978 (+   115us) service_pool.cc:224] Handling call
0709 13:11:05.161302 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.177428 (+ 16126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.177481 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.183101 (+  5620us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.409543 (+226442us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:05.409619 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.409694 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.231262 (+821568us) raft_consensus.cc:1685] finished
0709 13:11:06.231285 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.231418 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9334,"raft.queue_time_us":12820,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3424,"thread_start_us":183075,"threads_started":1,"wal-append.queue_time_us":289526}
W20260709 13:11:06.288856 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.268847 30645 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:06.147439 30653 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:06.304194 30720 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.838s	user 0.007s	sys 0.004s
I20260709 13:11:06.322119 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:06.304596 30660 consensus_meta.cc:287] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.984s	user 0.010s	sys 0.005s
I20260709 13:11:06.323179 30599 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:06.323289 30801 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:11:06.227772 30787 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:11:06.327893 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.272774 30782 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.335139 26581 raft_consensus.cc:2410] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:11:06.357483 26652 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
W20260709 13:11:06.336970 26622 leader_election.cc:336] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.510s (SENT)
W20260709 13:11:06.360208 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.362473 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:06.366456 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:06.331437 30662 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.331610 30674 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:06.338938 30549 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:06.376027 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2159) took 1214 ms. Trace:
W20260709 13:11:06.358937 26473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.008s	sys 0.005s
I20260709 13:11:06.337984 30740 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:06.372478 26507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.016s	sys 0.060s
W20260709 13:11:06.379719 26473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.008s	sys 0.005s
W20260709 13:11:06.386103 26507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.017s	sys 0.060s
W20260709 13:11:06.386569 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 645148us
I20260709 13:11:06.390697 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:06.373847 30234 consensus_meta.cc:287] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.004s
I20260709 13:11:06.392136 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:06.378634 26657 rpcz_store.cc:276] 0709 13:11:05.167454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.204053 (+ 36599us) service_pool.cc:224] Handling call
0709 13:11:05.221976 (+ 17923us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:05.272379 (+ 50403us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:05.272792 (+   413us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.417594 (+144802us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:05.430492 (+ 12898us) log.cc:844] Serialized 52 byte log entry
0709 13:11:05.430654 (+   162us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:05.430695 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.430755 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.375750 (+944995us) raft_consensus.cc:1685] finished
0709 13:11:06.375777 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.375959 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":185,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":1501,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":10197,"thread_start_us":143381,"threads_started":1,"wal-append.queue_time_us":212781}
I20260709 13:11:06.394119 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:06.338480 30720 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.441470 30398 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:06.442075 30720 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:06.442500 26584 raft_consensus.cc:1240] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:06.442663 30718 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:06.443076 30718 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:06.444058 30718 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:06.445294 30718 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:06.397092 27276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.027s	sys 0.065s
W20260709 13:11:06.457994 27276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.027s	sys 0.065s
I20260709 13:11:06.384614 30465 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:06.384075 30549 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.382462 30763 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:06.407392 27273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.007s
I20260709 13:11:06.395468 30674 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:06.424569 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2350) took 1017 ms. Trace:
I20260709 13:11:06.464211 26509 rpcz_store.cc:276] 0709 13:11:05.407454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.410326 (+  2872us) service_pool.cc:224] Handling call
0709 13:11:05.431229 (+ 20903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.475645 (+ 44416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.475688 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.490148 (+ 14460us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.020701 (+530553us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:06.021166 (+   465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.021417 (+   251us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.424332 (+402915us) raft_consensus.cc:1685] finished
0709 13:11:06.424354 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.424507 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":449695,"threads_started":1,"wal-append.queue_time_us":638275}
I20260709 13:11:06.427743 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:06.427841 30687 raft_consensus.cc:3055] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:06.432663 30685 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.433445 30802 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:06.434674 30704 consensus_meta.cc:287] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
I20260709 13:11:06.435950 30795 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.436390 30804 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:06.437395 30780 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:06.437978 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:06.438822 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 64229.9us
I20260709 13:11:06.439756 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:06.447449 30722 consensus_meta.cc:287] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.002s
I20260709 13:11:06.433451 30234 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:06.387154 30662 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.397053 30591 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.434674 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:06.353880 30629 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.003s	sys 0.008s
I20260709 13:11:06.420977 30660 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.382831 30644 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:06.460433 26651 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
W20260709 13:11:06.460739 26476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.000s	sys 0.017s
W20260709 13:11:06.503743 26476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.000s	sys 0.017s
W20260709 13:11:06.460469 26504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.000s	sys 0.017s
I20260709 13:11:06.461670 26576 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:11:06.504665 26504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.000s	sys 0.018s
W20260709 13:11:06.462730 27273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.007s	sys 0.008s
I20260709 13:11:06.468763 26581 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:06.469532 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:06.474377 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 153984us
I20260709 13:11:06.492148 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:06.492458 26653 raft_consensus.cc:2393] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:06.493032 26580 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:11:06.510134 26580 pending_rounds.cc:85] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 8
I20260709 13:11:06.510550 26580 pending_rounds.cc:107] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:11:06.510855 26580 raft_consensus.cc:2889] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.461748 30549 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:06.493289 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:06.495857 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.472716 30787 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:06.517285 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2343) took 1133 ms. Trace:
W20260709 13:11:06.496495 30695 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.004s	user 0.012s	sys 0.000s
I20260709 13:11:06.513825 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:06.470320 30687 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:06.517829 26508 rpcz_store.cc:276] 0709 13:11:05.370369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.372089 (+  1720us) service_pool.cc:224] Handling call
0709 13:11:06.434449 (+1062360us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5800010598. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829804b71 00007f8829804a22 00007f883271dc09 00007f8831877ee0 00007f88319410ab 00007f8831941131 00007f88318ef0a0 00007f88318ee984 00007f882ae696d4 00007f882ae69662
0709 13:11:06.503905 (+ 69456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64151936}
I20260709 13:11:06.503616 26651 pending_rounds.cc:85] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 6
I20260709 13:11:06.521487 26651 pending_rounds.cc:107] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:11:06.521938 26651 raft_consensus.cc:2889] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.524353 26577 raft_consensus.cc:2393] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:06.499037 30629 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.004s	sys 0.009s
I20260709 13:11:06.526424 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:06.527015 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.528370 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:06.531085 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:06.541057 26578 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:11:06.542309 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.527377 26502 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:06.543056 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:06.541013 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:06.550252 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:06.533154 27240 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:06.490432 30704 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.555233 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:06.555547 27275 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:06.557475 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:06.517863 30764 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:06.570681 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:06.548918 30719 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:11:06.473892 30763 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.570797 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:06.587769 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:06.517660 30787 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:06.576653 26622 leader_election.cc:336] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.544s (SENT)
W20260709 13:11:06.569948 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 76779.3us
I20260709 13:11:06.524353 30645 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:06.498555 30722 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.514883 30660 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:06.592693 27274 raft_consensus.cc:2368] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9.
I20260709 13:11:06.585088 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:06.588583 26509 raft_consensus.cc:2393] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:06.569897 26508 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:06.588954 27240 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:06.557725 30673 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.590909 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:06.594445 30787 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.527808 30695 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.616442 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:06.532352 30234 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:11:06.595176 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.566355 30711 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:06.554731 30721 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:06.607079 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:06.478000 30802 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:06.625495 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 67824.8us
I20260709 13:11:06.633797 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.595461 26654 raft_consensus.cc:1275] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:11:06.638532 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2359) took 1182 ms. Trace:
W20260709 13:11:06.639629 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.639592 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 50755.2us
W20260709 13:11:06.641597 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.500912 30804 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:06.498980 30795 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.651875 30673 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.652709 30817 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.654706 30662 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:06.655565 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.645262 26653 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:06.741931 26504 rpcz_store.cc:276] 0709 13:11:05.456532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.605703 (+149171us) service_pool.cc:224] Handling call
0709 13:11:05.740669 (+134966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:05.741526 (+   857us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:06.513447 (+771921us) log.cc:844] Serialized 14 byte log entry
0709 13:11:06.638102 (+124655us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.638174 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:06.638235 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.638318 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.638462 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4363,"prepare.queue_time_us":76613,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":8137,"raft.queue_time_us":25898,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":44810,"thread_start_us":844940,"threads_started":2}
I20260709 13:11:06.781000 26625 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:06.695369 27275 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:06.695398 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:06.649209 30687 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.701769 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:06.702519 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.787695 26653 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:11:06.705058 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 61671.4us
I20260709 13:11:06.705827 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.789371 26549 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:06.656636 30688 consensus_meta.cc:287] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.708s	user 0.008s	sys 0.006s
I20260709 13:11:06.789987 27272 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:11:06.790314 30688 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.791200 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:06.791880 27272 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:06.792858 26508 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:06.744335 26505 raft_consensus.cc:1217] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Deduplicated request from leader. Original: 4.6->[5.7-9.10]   Dedup: 8.9->[9.10-9.10]
I20260709 13:11:06.794242 26505 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: [5.7-9.10]
I20260709 13:11:06.737092 30599 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.754318 26654 pending_rounds.cc:85] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 4
I20260709 13:11:06.707286 30711 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:06.707531 30786 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:06.772536 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.772665 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:06.775213 30804 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:06.778162 30808 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.779852 26657 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:11:06.811022 26657 pending_rounds.cc:85] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 6
I20260709 13:11:06.811300 26657 pending_rounds.cc:107] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:11:06.811709 26657 raft_consensus.cc:2889] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.702525 30704 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:06.782402 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:06.746367 27240 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:06.795619 26651 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:11:06.796845 26622 leader_election.cc:336] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.610s (SENT)
W20260709 13:11:06.816537 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 181878us
I20260709 13:11:06.811164 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.798431 26654 pending_rounds.cc:107] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:11:06.805821 27271 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:06.818538 26654 raft_consensus.cc:2889] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.806398 26504 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:11:06.780447 30374 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.839s	user 0.006s	sys 0.006s
I20260709 13:11:06.823087 26502 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 13:11:06.818091 27275 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
W20260709 13:11:06.826066 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 79813.5us
I20260709 13:11:06.826192 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:06.827173 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:06.824060 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:06.835465 26473 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:06.836355 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:06.837037 26506 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:06.778813 30785 consensus_queue.cc:1059] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:06.828850 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:06.844214 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:06.817288 30662 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.858876 30830 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:06.859951 30830 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:06.808712 30786 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.846939 27270 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:06.831828 30789 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.812s	user 0.004s	sys 0.000s
I20260709 13:11:06.855671 26657 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:06.856236 30764 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:06.882342 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:06.856319 30673 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:06.815680 30711 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.867648 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.794288 30817 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:06.871574 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 94862.6us
I20260709 13:11:06.833380 30600 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:06.885241 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.810163 30599 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:06.837328 30791 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:06.889871 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 64647.2us
I20260709 13:11:06.845234 30234 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:06.860404 30830 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:06.893440 27277 raft_consensus.cc:2410] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:06.844813 30591 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:06.839174 30644 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:06.900722 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.882031 30674 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.826133 30374 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.935709 30374 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:06.870204 30786 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:06.940249 30802 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:06.941256 30606 consensus_meta.cc:287] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.869s	user 0.008s	sys 0.000s
I20260709 13:11:06.941437 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.949113 27277 raft_consensus.cc:2410] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:06.883044 30688 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:06.849711 30704 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:11:06.917261 27269 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:06.914651 26476 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:06.824282 30808 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:06.921607 27278 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:06.925302 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2874) took 1045 ms. Trace:
I20260709 13:11:06.905382 30722 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:06.923529 30813 log.cc:927] Time spent T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:11:06.925977 30795 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:06.922030 30234 raft_consensus.cc:697] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:06.905637 30600 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:06.927976 30829 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:11:06.928344 30819 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.377s	user 0.000s	sys 0.002s
I20260709 13:11:06.930766 30796 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:06.931514 30740 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:06.915850 30791 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:06.943282 30616 consensus_meta.cc:287] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.004s	user 0.002s	sys 0.010s
W20260709 13:11:06.947017 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 129780us
I20260709 13:11:06.882299 30764 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.950702 27270 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:06.954196 30374 raft_consensus.cc:2764] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:06.942487 30606 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:06.918907 30660 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:06.951731 26577 rpcz_store.cc:276] 0709 13:11:05.880337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.880497 (+   160us) service_pool.cc:224] Handling call
0709 13:11:06.922400 (+1041903us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54002aadd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:06.925249 (+  2849us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332104576}
I20260709 13:11:06.924654 30695 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:06.969758 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:06.960762 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:06.963439 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:06.979991 27278 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:06.981016 26583 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:11:06.952438 27272 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:11:06.956352 30704 consensus_queue.cc:1243] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:06.978300 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.960683 26506 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
W20260709 13:11:06.962682 30718 consensus_meta.cc:287] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.003s
I20260709 13:11:06.986828 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:06.987898 27272 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:06.969164 30764 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:06.975283 30662 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:06.992766 30830 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:06.993152 30824 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:11:06.993858 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:06.994702 27270 raft_consensus.cc:2410] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:06.992674 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:06.992269 30795 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:06.996421 30795 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:06.996531 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:06.996870 30795 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.997109 26577 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:06.999562 30674 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:06.977094 30811 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:07.003463 30808 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:06.992383 30784 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:07.010890 30606 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:07.012612 30549 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.013023 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:07.013931 30810 log.cc:927] Time spent T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:11:07.014436 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:07.015761 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:07.016299 30791 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:07.016984 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 663) took 1447 ms. Trace:
I20260709 13:11:07.017659 30599 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:07.017370 27273 rpcz_store.cc:276] 0709 13:11:05.569633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.575132 (+  5499us) service_pool.cc:224] Handling call
0709 13:11:05.676117 (+100985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.740700 (+ 64583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.740852 (+   152us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.788374 (+ 47522us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.511971 (+723597us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:06.512043 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.512140 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.016745 (+504605us) raft_consensus.cc:1685] finished
0709 13:11:07.016765 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.016904 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25717,"raft.queue_time_us":200777,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":51889,"thread_start_us":628188,"threads_started":1,"wal-append.queue_time_us":670763}
I20260709 13:11:07.016443 26579 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:07.019502 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 948) took 1605 ms. Trace:
I20260709 13:11:06.973040 30721 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:07.024410 30834 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.098s	user 0.001s	sys 0.002s
I20260709 13:11:07.026535 30234 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.019912 27276 rpcz_store.cc:276] 0709 13:11:05.414094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.414220 (+   126us) service_pool.cc:224] Handling call
0709 13:11:05.452132 (+ 37912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.494530 (+ 42398us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:05.494569 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.516460 (+ 21891us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.462385 (+945925us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:06.462432 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.462498 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.019296 (+556798us) raft_consensus.cc:1685] finished
0709 13:11:07.019314 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.019447 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30194,"raft.queue_time_us":18730,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":25015,"thread_start_us":756002,"threads_started":1,"wal-append.queue_time_us":942414}
W20260709 13:11:07.028666 30602 consensus_meta.cc:287] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.001s	user 0.010s	sys 0.000s
I20260709 13:11:06.968773 30616 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:07.030764 30676 consensus_meta.cc:287] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.071s	user 0.012s	sys 0.000s
I20260709 13:11:07.031071 30616 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:07.031162 30676 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.032274 26510 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:07.033836 26501 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:07.035646 30843 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.036263 30843 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.036981 30549 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:07.037909 30677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46406 (request call id 922) took 4823 ms. Trace:
I20260709 13:11:07.038539 30843 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:07.029099 30602 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.039712 27271 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:07.040184 26581 raft_consensus.cc:2393] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:07.025812 30600 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:07.041074 30602 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:07.041122 27271 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:07.041615 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:07.038321 30677 rpcz_store.cc:276] 0709 13:11:02.231158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.231589 (+   431us) service_pool.cc:224] Handling call
0709 13:11:02.512030 (+280441us) ts_tablet_manager.cc:934] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
0709 13:11:05.462517 (+2950487us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:06.745518 (+1283001us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:06.775648 (+ 30130us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:06.999898 (+224250us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:07.000244 (+   346us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:07.037685 (+ 37441us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:07.037803 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":321599,"tablet-copy.queue_time_us":107375,"thread_start_us":457098,"threads_started":2}
I20260709 13:11:07.042881 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:07.043166 30677 tablet_copy_client.cc:806] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:07.043857 30677 tablet_copy_client.cc:670] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:07.043773 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:07.025691 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:07.035531 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:07.046393 26577 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 7.
I20260709 13:11:07.046581 26510 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:07.048889 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:07.049850 26502 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:07.053714 26476 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:07.055006 26476 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:07.056335 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:07.057288 26579 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:11:07.058416 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 88750.8us
I20260709 13:11:07.059648 27278 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:07.060581 27273 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:11:07.060886 27273 pending_rounds.cc:85] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 8
I20260709 13:11:07.061084 27273 pending_rounds.cc:107] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:11:07.061286 27273 raft_consensus.cc:2889] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:07.062731 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:07.063968 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:07.066180 26579 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:07.066470 26474 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:07.071090 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:07.054739 30616 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:07.058043 30374 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:07.074658 30374 raft_consensus.cc:697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:07.075690 30374 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.054847 30674 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:11:07.051108 30695 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.081215 30695 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.082197 30704 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.082461 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:07.052657 30721 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:07.082778 30704 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.083902 27271 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:07.084558 26577 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:07.059453 30811 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:07.063062 30662 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:07.099165 30695 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:07.089468 30685 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.100181 30712 raft_consensus.cc:3055] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:07.099777 30786 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.101527 26579 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:07.104216 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:07.113186 26510 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:07.108770 26577 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:07.110435 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:11:07.112402 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 46063.8us
I20260709 13:11:07.114077 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:07.114706 27278 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:07.115311 26581 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:11:07.102166 30674 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:07.134635 30711 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.135617 27277 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:07.136510 27272 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:07.137729 30786 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:07.139153 30676 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:07.081326 30787 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:07.109863 30712 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:07.441094 30764 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:09.326606 30764 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:07.144345 30795 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:08.540009 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080038bc80 after lost signal to thread 25398
W20260709 13:11:09.644793 26439 debug-util.cc:398] Leaking SignalData structure 0x7b0800382de0 after lost signal to thread 26442
W20260709 13:11:08.940603 26504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2376) took 1841 ms (client timeout 1551 ms). Trace:
I20260709 13:11:09.319160 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2801) took 2508 ms. Trace:
W20260709 13:11:09.645180 26504 rpcz_store.cc:269] 0709 13:11:07.098730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.940325 (+1841595us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:08.940493 (+   168us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:11:09.645855 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:09.646265 26504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2375) took 2547 ms (client timeout 1868 ms). Trace:
I20260709 13:11:09.331700 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:09.332788 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2797) took 2709 ms. Trace:
W20260709 13:11:09.646857 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 2.84981e+06us
W20260709 13:11:09.647511 26622 leader_election.cc:336] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.771s (SENT)
I20260709 13:11:09.647208 26509 rpcz_store.cc:276] 0709 13:11:06.623952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.624202 (+   250us) service_pool.cc:224] Handling call
0709 13:11:06.657037 (+ 32835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.715712 (+ 58675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.715757 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.328571 (+2612814us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b2c000014c8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882b222a11 00007f882b232372 00007f882c964a01 00007f882c92943a 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2
0709 13:11:09.328868 (+   297us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.332353 (+  3485us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:09.332393 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.332469 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.332514 (+    45us) raft_consensus.cc:1685] finished
0709 13:11:09.332528 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.332732 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35780,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":24420,"spinlock_wait_cycles":6330624,"thread_start_us":3145,"threads_started":1,"wal-append.queue_time_us":886}
W20260709 13:11:09.649250 26509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2374) took 2551 ms (client timeout 1881 ms). Trace:
I20260709 13:11:07.117313 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:09.210489 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:09.145310 26580 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
I20260709 13:11:09.087347 26581 pending_rounds.cc:85] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 6
I20260709 13:11:09.657353 26581 pending_rounds.cc:107] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:11:08.841277 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2884) took 2602 ms. Trace:
I20260709 13:11:09.658711 26583 rpcz_store.cc:276] 0709 13:11:06.239328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.242467 (+  3139us) service_pool.cc:224] Handling call
0709 13:11:06.242851 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.983225 (+740374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.840924 (+1857699us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b5400100754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:08.841198 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697021824}
I20260709 13:11:09.365394 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:09.337117 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:09.660976 26584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 743) took 3207 ms (client timeout 2954 ms). Trace:
I20260709 13:11:09.335850 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2163) took 3417 ms. Trace:
W20260709 13:11:09.302109 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.627190 30862 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.629519 30863 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:09.634298 30864 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:10.952031 30862 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:10.952170 30863 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:09.648564 26622 leader_election.cc:336] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.777s (SENT)
W20260709 13:11:09.649960 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.379774 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2166) took 3455 ms. Trace:
I20260709 13:11:09.941653 30866 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.972491 30866 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:10.972167 26656 rpcz_store.cc:276] 0709 13:11:05.924127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.252486 (+328359us) service_pool.cc:224] Handling call
0709 13:11:06.256087 (+  3601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.257454 (+  1367us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:06.472896 (+215442us) log.cc:844] Serialized 14 byte log entry
0709 13:11:06.646860 (+173964us) log.cc:844] Serialized 14 byte log entry
0709 13:11:09.000522 (+2353662us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b180039a8a0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882980a2a6 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1
0709 13:11:09.002001 (+  1479us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b180039a8a0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:09.379173 (+377172us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b180039a8a0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f882c921060 00007f882c933716 00007f882c944287 00007f882c944208
0709 13:11:09.379352 (+   179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:09.379428 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:09.379492 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.379570 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.379712 (+   142us) inbound_call.cc:177] Queueing success response
0709 13:11:09.575456 (+195744us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
Metrics: {"mutex_wait_us":4320449,"prepare.queue_time_us":67826,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":4194747,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":47431,"spinlock_wait_cycles":229339904,"thread_start_us":363974,"threads_started":2,"wal-append.queue_time_us":183009}
I20260709 13:11:10.974370 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:10.974828 26656 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:10.975127 30866 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:10.281873 26654 rpcz_store.cc:276] 0709 13:11:05.918764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.150284 (+231520us) service_pool.cc:224] Handling call
0709 13:11:06.150564 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.829238 (+678674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.335592 (+2506354us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54001f5c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:09.335779 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999499136}
I20260709 13:11:10.975895 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:10.976467 26656 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:11:10.714937 30869 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:10.977027 30869 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:10.977288 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:10.978870 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:10.979241 30869 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:10.723742 30870 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:10.724488 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 3.94324e+06us
I20260709 13:11:10.727389 30871 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:10.979907 30870 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:10.980118 30871 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:10.980981 26625 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:10.981993 30871 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:10.729163 30872 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.982681 30872 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:10.983657 30804 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:10.984071 30804 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.984418 30804 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:10.984830 30872 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:10.730897 30873 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:10.985531 30873 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:10.987326 30654 consensus_queue.cc:1059] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:10.987718 30873 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:10.734504 30874 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.988370 30545 raft_consensus.cc:3055] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:10.988807 30545 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:10.988493 30874 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:10.970764 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.744514 30875 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.043476 30782 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.043613 30875 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.044476 30884 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:10.545339 25400 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0980 after lost signal to thread 26548
W20260709 13:11:09.653548 26439 debug-util.cc:398] Leaking SignalData structure 0x7b0800044040 after lost signal to thread 26534
W20260709 13:11:09.552433 26473 connection.cc:256] RPC call timeout handler was delayed by -1.3591021089998776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
I20260709 13:11:09.453744 26474 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:11.122483 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 4.00458e+06us
I20260709 13:11:11.122882 26401 catalog_manager.cc:5697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 5, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 5 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.123974 26474 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.124931 30872 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:09.632215 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2795) took 3046 ms. Trace:
W20260709 13:11:10.765357 26502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2802) took 3944 ms (client timeout 1955 ms). Trace:
W20260709 13:11:09.519979 26503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2366) took 2681 ms (client timeout 1816 ms). Trace:
W20260709 13:11:09.646661 26504 rpcz_store.cc:269] 0709 13:11:07.098437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.646101 (+2547664us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:09.646209 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:11:09.645375 26505 rpcz_store.cc:276] 0709 13:11:06.811075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.811380 (+   305us) service_pool.cc:224] Handling call
0709 13:11:06.832048 (+ 20668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.847879 (+ 15831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.847932 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.857963 (+ 10031us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.953464 (+ 95501us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:06.953498 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.953541 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.318903 (+2365362us) raft_consensus.cc:1685] finished
0709 13:11:09.318927 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.319096 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7024,"raft.queue_time_us":24470,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":95145,"threads_started":1,"wal-append.queue_time_us":143409,"wal-append.run_cpu_time_us":13447,"wal-append.run_wall_time_us":2285731}
W20260709 13:11:08.900544 26506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2367) took 2051 ms (client timeout 1786 ms). Trace:
W20260709 13:11:11.134742 26505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2377) took 4035 ms (client timeout 2009 ms). Trace:
W20260709 13:11:11.135035 26505 rpcz_store.cc:269] 0709 13:11:07.099021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.134577 (+4035556us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:11.134684 (+   107us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:11:11.134792 26506 rpcz_store.cc:269] 0709 13:11:06.849475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.900262 (+2050787us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:08.900445 (+   183us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:11:09.136898 26548 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.622s (SENT) [suppressed 6 similar messages]
W20260709 13:11:10.417475 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba6c0 after lost signal to thread 25395
W20260709 13:11:09.654142 26579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 754) took 2546 ms (client timeout 1862 ms). Trace:
I20260709 13:11:09.657668 26581 raft_consensus.cc:2889] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.150470 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 751) took 4247 ms. Trace:
I20260709 13:11:11.150822 26581 rpcz_store.cc:276] 0709 13:11:06.902683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.090149 (+187466us) service_pool.cc:224] Handling call
0709 13:11:07.110325 (+ 20176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.150143 (+4039818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.150404 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:09.624415 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:11.153326 26585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 2058) took 1825 ms (client timeout 1771 ms). Trace:
I20260709 13:11:09.533986 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2882) took 3295 ms. Trace:
W20260709 13:11:09.661386 26584 rpcz_store.cc:269] 0709 13:11:06.453237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.365067 (+2911830us) service_pool.cc:224] Handling call
0709 13:11:09.660903 (+295836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:10.952307 30864 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:09.642647 30865 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:10.954517 30863 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:10.954506 30862 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:10.966056 26549 leader_election.cc:336] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.544s (SENT)
I20260709 13:11:10.676435 30867 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.155659 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 189644us
W20260709 13:11:11.156237 26549 leader_election.cc:336] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.551s (SENT)
W20260709 13:11:11.156889 26549 leader_election.cc:336] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.624s (SENT)
I20260709 13:11:11.157027 30864 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:10.880362 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 861) took 4495 ms. Trace:
I20260709 13:11:10.990866 30874 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:09.253674 27243 connection.cc:256] RPC call timeout handler was delayed by -1.8344873009998537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
I20260709 13:11:11.159157 30865 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:10.962942 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.160770 26657 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:11.161995 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:10.976212 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.163293 26654 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 6.
I20260709 13:11:11.164005 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:11.164893 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:09.612505 27272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 673) took 2560 ms. Trace:
W20260709 13:11:09.341282 27269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 996) took 2685 ms (client timeout 1738 ms). Trace:
I20260709 13:11:09.307978 27270 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:09.307394 27274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 989) took 2811 ms (client timeout 1510 ms). Trace:
I20260709 13:11:11.169725 27270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 951) took 4424 ms. Trace:
W20260709 13:11:11.169682 27274 rpcz_store.cc:269] 0709 13:11:06.496330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.502035 (+  5705us) service_pool.cc:224] Handling call
0709 13:11:09.307158 (+2805123us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b5400720e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:09.307313 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149283072}
I20260709 13:11:11.170176 27270 rpcz_store.cc:276] 0709 13:11:06.745186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.995304 (+250118us) service_pool.cc:224] Handling call
0709 13:11:09.307742 (+2312438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.168022 (+1860280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.169498 (+  1476us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b5400720e50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:11.169680 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5317427584}
W20260709 13:11:09.004608 27277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 955) took 2133 ms (client timeout 2131 ms). Trace:
W20260709 13:11:09.271649 27278 consensus_meta.cc:287] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 2.156s	user 0.014s	sys 0.006s
I20260709 13:11:09.310977 30374 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:09.332579 30168 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:10.995796 30545 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.179304 30545 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.179359 30168 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:11.180037 30168 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:10.969388 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 1.32076e+06us
I20260709 13:11:08.956768 30562 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:09.119462 30600 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.186053 30600 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:08.822770 30602 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.188198 30168 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.188997 30602 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.190949 30168 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:11.191581 30602 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:09.630259 30629 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:11.193351 30629 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:10.884383 30645 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:08.912497 30653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.812s	user 0.006s	sys 0.020s
W20260709 13:11:11.199752 30653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.100s	user 0.011s	sys 0.020s
I20260709 13:11:09.213817 30660 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.203106 26659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 2002) took 5339 ms (client timeout 2247 ms). Trace:
I20260709 13:11:11.203251 30660 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:11.203503 26659 rpcz_store.cc:269] 0709 13:11:05.864627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.864864 (+   237us) service_pool.cc:224] Handling call
0709 13:11:11.202863 (+5337999us) spinlock_profiling.cc:243] Waited 5.26 s on lock 0x7b5400103bd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:11.203011 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12087911808}
I20260709 13:11:11.204909 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.205293 30660 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:09.310566 30662 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:09.568043 30676 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.172716 30673 raft_consensus.cc:3055] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:07.112512 30685 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:08.837467 30599 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:09.181315 30644 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.210284 30599 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:09.310307 30688 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:11.210873 30644 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:09.288329 30711 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:09.355363 30704 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:09.322995 30712 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:10.958096 30719 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:09.240204 30720 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:09.160280 30742 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.222398 30742 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.224444 30742 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:09.170226 30758 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.888782 30763 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:10.982010 30870 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:09.278015 30721 consensus_meta.cc:287] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 2.194s	user 0.013s	sys 0.015s
I20260709 13:11:09.644665 30795 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:09.392642 30796 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:08.902926 30784 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.245052 30787 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:09.604212 30792 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.231459 30712 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.231959 30792 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:09.302292 30807 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 2.565s	user 0.015s	sys 0.000s
I20260709 13:11:08.858883 30814 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:09.193964 30817 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:09.354889 30821 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 2.617s	user 0.000s	sys 0.016s
I20260709 13:11:09.551653 30788 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:11.237869 30792 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:11.238359 30788 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.240495 30866 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.240793 30788 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:09.163945 30825 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.935369 30827 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 2.161s	user 0.010s	sys 0.010s
I20260709 13:11:11.242241 30825 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:09.575862 30833 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 2.823s	user 0.010s	sys 0.010s
W20260709 13:11:08.926049 30828 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 2.173s	user 0.006s	sys 0.005s
I20260709 13:11:11.245826 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 860) took 5035 ms. Trace:
W20260709 13:11:09.082442 30845 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.930s	user 0.002s	sys 0.007s
I20260709 13:11:11.246856 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 859) took 5294 ms. Trace:
W20260709 13:11:08.905709 30850 log.cc:927] Time spent T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 1.747s	user 0.023s	sys 0.028s
I20260709 13:11:11.044103 30782 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.247448 26658 rpcz_store.cc:276] 0709 13:11:05.952920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.299156 (+346236us) service_pool.cc:224] Handling call
0709 13:11:06.299520 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.306955 (+  7435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.306985 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.309656 (+  2671us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.590474 (+280818us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:06.590567 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.590663 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.925399 (+2334736us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:11.246534 (+2321135us) raft_consensus.cc:1685] finished
0709 13:11:11.246562 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.246793 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3418,"raft.queue_time_us":7584,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":28531,"spinlock_wait_cycles":20177792,"thread_start_us":220268,"threads_started":1,"wal-append.queue_time_us":350872}
I20260709 13:11:11.249558 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.249827 30782 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:11.045181 30884 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.250823 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.251928 30884 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:11.045994 30875 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:11.047578 30885 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:11.048714 25400 kernel_stack_watchdog.cc:198] Thread 26548 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 260ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:11:11.253167 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:10.756362 30876 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:11.088169 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:11.255575 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.256435 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:11.088369 30804 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:11.090694 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08003ebc40 after lost signal to thread 26535
I20260709 13:11:11.257678 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:11.259016 26439 debug-util.cc:398] Leaking SignalData structure 0x7b0800394be0 after lost signal to thread 26609
W20260709 13:11:11.259414 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080011ece0 after lost signal to thread 26610
I20260709 13:11:11.257632 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:11.094448 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 111108us
I20260709 13:11:11.261288 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.262684 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:11.263320 26658 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:11.107777 30609 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:11.265870 30609 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.268178 30609 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:11.115278 26473 connection.cc:256] RPC call timeout handler was delayed by -1.0999021089999133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
I20260709 13:11:11.124883 26401 catalog_manager.cc:5697] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 6 to 8, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 8 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.128175 26501 rpcz_store.cc:276] 0709 13:11:06.586311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.586451 (+   140us) service_pool.cc:224] Handling call
0709 13:11:06.618782 (+ 32331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.034239 (+415457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.631856 (+2597617us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54003525d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:09.632136 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953638784}
I20260709 13:11:11.274381 26401 catalog_manager.cc:5697] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 10, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 10 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:11.129603 26474 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:11.274413 26658 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
W20260709 13:11:11.276757 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 147262us
I20260709 13:11:11.126010 30872 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:11.130347 26502 rpcz_store.cc:269] 0709 13:11:06.821269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.823876 (+  2607us) service_pool.cc:224] Handling call
0709 13:11:10.765095 (+3941219us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400353ed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:10.765248 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363534592}
W20260709 13:11:11.133358 26504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2373) took 4036 ms (client timeout 1936 ms). Trace:
W20260709 13:11:11.131901 26503 rpcz_store.cc:269] 0709 13:11:06.838750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.519726 (+2680976us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:09.519897 (+   171us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:11:09.569224 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2796) took 2976 ms. Trace:
I20260709 13:11:11.136335 26505 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:09.651831 26509 rpcz_store.cc:269] 0709 13:11:07.098117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.649079 (+2550962us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:09.649190 (+   111us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:11:11.140157 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0c20 after lost signal to thread 25398
W20260709 13:11:11.141693 26579 rpcz_store.cc:269] 0709 13:11:07.107263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.117022 (+  9759us) service_pool.cc:224] Handling call
0709 13:11:09.653935 (+2536913us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:11.148577 26404 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48166 (request call id 196) took 27417 ms (client timeout 15000 ms). Trace:
I20260709 13:11:11.152171 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2365) took 4329 ms. Trace:
W20260709 13:11:11.153702 26585 rpcz_store.cc:269] 0709 13:11:09.328023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.624155 (+296132us) service_pool.cc:224] Handling call
0709 13:11:11.153257 (+1529102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:11.154220 26578 rpcz_store.cc:276] 0709 13:11:06.238652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.241686 (+  3034us) service_pool.cc:224] Handling call
0709 13:11:06.242245 (+   559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.551945 (+309700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.533726 (+2981781us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54000203d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:09.533918 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686587776}
I20260709 13:11:11.155800 30867 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:11.157421 26549 leader_election.cc:336] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.699s (SENT)
I20260709 13:11:10.881471 26652 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:11.158156 26651 rpcz_store.cc:276] 0709 13:11:06.384549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.817309 (+432760us) service_pool.cc:224] Handling call
0709 13:11:06.817685 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.817921 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:06.841990 (+ 24069us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.879927 (+4037937us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.880009 (+    82us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:10.880067 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.880142 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.880293 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4046063,"prepare.queue_time_us":23890,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":4116596,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84}
W20260709 13:11:11.159359 27243 connection.cc:256] RPC call timeout handler was delayed by -1.6526873010000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 13:11:10.967227 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2032) took 4642 ms. Trace:
I20260709 13:11:11.159466 30864 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:11.162248 30865 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:11.165526 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.166220 27272 rpcz_store.cc:276] 0709 13:11:07.051821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.051974 (+   153us) service_pool.cc:224] Handling call
0709 13:11:07.065540 (+ 13566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.137100 (+ 71560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.612210 (+2475110us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b54005aafd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:09.612430 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161429248}
W20260709 13:11:11.166819 27269 rpcz_store.cc:269] 0709 13:11:06.656081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.701419 (+ 45338us) service_pool.cc:224] Handling call
0709 13:11:09.340994 (+2639575us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400845dd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:09.341205 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300354304}
W20260709 13:11:11.171564 27277 rpcz_store.cc:269] 0709 13:11:06.870987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.955263 (+ 84276us) service_pool.cc:224] Handling call
0709 13:11:09.004309 (+2049046us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400668d54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:09.004489 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357847808}
I20260709 13:11:11.173437 27278 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:11.188233 30600 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:11.201122 30629 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:11.206107 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:11.206625 26622 leader_election.cc:336] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.929s (SENT)
I20260709 13:11:11.207424 30676 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.208818 30673 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:10.728827 30687 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:11.210826 30685 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:11.212353 30599 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:11.213320 30644 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:11.217365 30719 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.225471 30758 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.227238 30721 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.229538 30796 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.230158 30784 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.233377 26510 raft_consensus.cc:2393] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:11.235934 30814 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:11.236505 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2354) took 5819 ms. Trace:
I20260709 13:11:11.241170 30866 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.244766 30825 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:11.245225 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 858) took 5458 ms. Trace:
I20260709 13:11:11.246260 26650 rpcz_store.cc:276] 0709 13:11:06.210403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.302506 (+ 92103us) service_pool.cc:224] Handling call
0709 13:11:06.328692 (+ 26186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.329104 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.329143 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.329609 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.430474 (+100865us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b4800240258. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8831852aa1 00007f8831849b37 00007f88318499ca 00007f883194126f 00007f8831940f37 00007f883195555c 00007f8831955508 00007f8831955488 00007f8831955443 00007f88319546ec 00007f883087ea96
0709 13:11:06.558830 (+128356us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:06.559086 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.559390 (+   304us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.934658 (+2375268us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:11.245624 (+2310966us) raft_consensus.cc:1685] finished
0709 13:11:11.245647 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.245772 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6006,"raft.run_cpu_time_us":899,"raft.run_wall_time_us":91686,"spinlock_wait_cycles":41524736,"thread_start_us":224638,"threads_started":1,"wal-append.queue_time_us":444129}
I20260709 13:11:11.258858 26656 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:11.277300 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:11.148559 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 2.01154e+06us
I20260709 13:11:11.276386 26401 catalog_manager.cc:5697] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 8, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 8 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.277590 26474 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.372494 30545 consensus_queue.cc:1059] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:11:11.377655 30545 raft_consensus.cc:3055] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:11.377336 26401 catalog_manager.cc:5697] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 7, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 7 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:11.378005 26622 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.378710 30875 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:11.379132 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 172533us
I20260709 13:11:11.378826 26401 catalog_manager.cc:5697] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:11.379477 30645 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:11.379835 26510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2378) took 4280 ms (client timeout 1531 ms). Trace:
W20260709 13:11:11.379990 26622 leader_election.cc:336] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.971s (SENT)
I20260709 13:11:11.378140 30545 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:11.380237 26401 catalog_manager.cc:5697] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 9, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 9 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:11.381055 26622 leader_election.cc:336] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 1.980s (SENT)
I20260709 13:11:11.380999 30545 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:11.370787 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.382306 30545 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.355895 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:11.382193 30673 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.383422 30673 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:11.373349 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 100984us
I20260709 13:11:11.384727 26502 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:11.316172 27241 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:11.386313 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2369) took 4413 ms. Trace:
W20260709 13:11:11.386749 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 70684.9us
I20260709 13:11:11.387146 30695 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:11.387473 30719 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:11.389708 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.390148 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.388381 26653 rpcz_store.cc:276] 0709 13:11:06.325283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.797858 (+472575us) service_pool.cc:224] Handling call
0709 13:11:06.818789 (+ 20931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.883051 (+4064262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.883082 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.883603 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.888527 (+  4924us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:10.901795 (+ 13268us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.966937 (+ 65142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.967011 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.967058 (+    47us) raft_consensus.cc:1685] finished
0709 13:11:10.967069 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.967176 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4117851,"prepare.queue_time_us":2881,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":4194131,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":17463,"threads_started":2,"wal-append.queue_time_us":4922}
I20260709 13:11:11.391218 30676 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:11.391764 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.392733 30782 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:11.393015 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.387805 30695 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:11.393307 30782 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.394220 30695 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.395416 30782 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:11.397087 30645 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:11.397745 30645 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.398247 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:11.399049 26656 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.399809 30645 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:11.400084 30758 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:11.400693 27274 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:11:11.401036 27274 pending_rounds.cc:85] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 9
I20260709 13:11:11.401261 27274 pending_rounds.cc:107] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:11:11.401508 27274 raft_consensus.cc:2889] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.278297 30876 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:11.402233 30866 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:11.403119 30864 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:11.369820 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2900 after lost signal to thread 26683
W20260709 13:11:11.404269 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080039a580 after lost signal to thread 26684
I20260709 13:11:11.377465 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:11.403749 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:11.405043 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08001fd7e0 after lost signal to thread 26442
I20260709 13:11:11.405177 26659 raft_consensus.cc:2410] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:11.384728 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:11.406241 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:11.406816 30645 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.407088 26659 raft_consensus.cc:2410] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:11.407514 26578 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:11.407302 26508 rpcz_store.cc:276] 0709 13:11:06.618212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.632950 (+ 14738us) service_pool.cc:224] Handling call
0709 13:11:06.633404 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.793309 (+159905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.568895 (+2775586us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54001743d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:09.569152 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366009728}
I20260709 13:11:11.408094 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.408214 26576 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:11.285825 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:11.408751 30782 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.408983 27271 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:11.386363 26473 connection.cc:256] RPC call timeout handler was delayed by -1.061858311999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:11:11.409363 30782 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:11.409541 26504 rpcz_store.cc:269] 0709 13:11:07.096577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.133161 (+4036584us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:11.133290 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:11:11.407357 30645 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.285018 27275 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:11.412259 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:11.377931 27243 connection.cc:256] RPC call timeout handler was delayed by -1.3124873009999192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
I20260709 13:11:11.413029 27275 raft_consensus.cc:2410] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:11.413616 30721 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:11.413888 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2364) took 4602 ms. Trace:
I20260709 13:11:11.397159 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:11.414367 26505 rpcz_store.cc:276] 0709 13:11:06.811854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.135837 (+4323983us) service_pool.cc:224] Handling call
0709 13:11:11.136164 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.413668 (+277504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.413838 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:11.393064 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.415663 26505 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:11.415971 26658 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:11.416247 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2371) took 4442 ms. Trace:
I20260709 13:11:11.416618 26505 rpcz_store.cc:276] 0709 13:11:06.973900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.415179 (+4441279us) service_pool.cc:224] Handling call
0709 13:11:11.415491 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.416040 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.416203 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:11.377596 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 100085us
I20260709 13:11:11.418033 26507 rpcz_store.cc:276] 0709 13:11:05.417292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.505221 (+ 87929us) service_pool.cc:224] Handling call
0709 13:11:05.522330 (+ 17109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.569283 (+ 46953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.569316 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.574968 (+  5652us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.386692 (+811724us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:06.386755 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.386859 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.301772 (+2914913us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:11.236161 (+1934389us) raft_consensus.cc:1685] finished
0709 13:11:11.236182 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.236418 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":519,"raft.queue_time_us":222,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7528,"spinlock_wait_cycles":20092160,"thread_start_us":680664,"threads_started":1,"wal-append.queue_time_us":956533}
I20260709 13:11:11.419210 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.419659 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.419961 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.420653 26577 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:11.419304 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:11.380272 26510 rpcz_store.cc:269] 0709 13:11:07.099325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.116735 (+ 17410us) service_pool.cc:224] Handling call
0709 13:11:11.379584 (+4262849us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54003539d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:11.379734 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3647572736}
I20260709 13:11:11.421700 26576 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
W20260709 13:11:11.412770 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 255353us
I20260709 13:11:11.281229 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:11.422701 26549 leader_election.cc:336] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.786s (SENT)
I20260709 13:11:11.283344 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:11:11.423523 26549 leader_election.cc:336] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.816s (SENT)
W20260709 13:11:11.423537 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:11.422096 26548 connection.cc:256] RPC call timeout handler was delayed by -1.8146936329999335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:11:11.424935 26578 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:11.425244 26657 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:11.284207 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:11.426932 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:11.427809 26548 connection.cc:256] RPC call timeout handler was delayed by -2.1862836199998128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2534s for a response
I20260709 13:11:11.428573 30825 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.429041 30825 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.406843 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:11.430187 27272 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:11.253250 30885 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.432977 26584 raft_consensus.cc:2410] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:11:11.435225 30629 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.435738 30629 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:11.436837 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 941b69cce0d24bb9a4f60558447429c4: Illegal state: Replica b9c3761688a64982ae1c4aeb758e09ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:11.439409 30654 consensus_queue.cc:1059] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:11.440588 30654 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:11.398202 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.440992 30654 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:11.441638 26650 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:11.441900 30654 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.442883 30654 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:11.445739 27273 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:11.407003 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:11.447511 26652 raft_consensus.cc:2410] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:11.424625 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.410800 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:11.450613 26654 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:11.416898 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:11.419965 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:11.461642 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 51111us
I20260709 13:11:11.462793 30676 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:11.463186 26503 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:11.463769 30645 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:11.463883 30872 raft_consensus.cc:3055] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:11.285435 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:11.464507 30872 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:11.465039 27276 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 13: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:11.465317 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.465421 30872 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.466005 30804 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:11.466109 26576 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:11.402802 26506 rpcz_store.cc:276] 0709 13:11:06.822275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.135846 (+4313571us) service_pool.cc:224] Handling call
0709 13:11:11.136271 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.136687 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:11.138835 (+  2148us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.140582 (+  1747us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.140738 (+   156us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.141262 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:11:11.141415 (+   153us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:11.141451 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.141533 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.151898 (+ 10365us) raft_consensus.cc:1685] finished
0709 13:11:11.151921 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.152113 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2311,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":1074,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":243,"spinlock_wait_cycles":107776,"thread_start_us":2705,"threads_started":2,"wal-append.queue_time_us":10504}
I20260709 13:11:11.467960 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.468876 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:11.469707 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2be0 after lost signal to thread 27302
I20260709 13:11:11.469983 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.470211 30867 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:11.470773 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:11.470904 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 52283.2us
I20260709 13:11:11.471692 30782 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:11.403668 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.472191 26474 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.472339 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.404286 26655 rpcz_store.cc:276] 0709 13:11:05.786354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.817965 (+ 31611us) service_pool.cc:224] Handling call
0709 13:11:05.860205 (+ 42240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.074876 (+214671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.074909 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.088628 (+ 13719us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.408199 (+319571us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:06.408258 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.408350 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.354337 (+2945987us) spinlock_profiling.cc:243] Waited 8.75 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:11.244709 (+1890372us) raft_consensus.cc:1685] finished
0709 13:11:11.244733 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.245131 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34155,"raft.queue_time_us":151528,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":21964,"spinlock_wait_cycles":20135296,"thread_start_us":430444,"threads_started":2,"wal-append.queue_time_us":482325}
I20260709 13:11:11.474370 30864 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:11.475561 26531 debug-util.cc:398] Leaking SignalData structure 0x7b0800238580 after lost signal to thread 26534
W20260709 13:11:11.475873 26531 debug-util.cc:398] Leaking SignalData structure 0x7b0800238480 after lost signal to thread 26535
W20260709 13:11:11.476222 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 95208.7us
W20260709 13:11:11.476956 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0100 after lost signal to thread 26609
I20260709 13:11:11.476794 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:11.477237 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5320 after lost signal to thread 26610
W20260709 13:11:11.477541 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08001d54c0 after lost signal to thread 26624
W20260709 13:11:11.477777 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08000a96c0 after lost signal to thread 26625
W20260709 13:11:11.478050 26622 leader_election.cc:336] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 2.111s (SENT)
I20260709 13:11:11.478335 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.479882 30869 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:11.480639 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.481107 30885 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:11.481207 26577 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:11.500402 30872 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:11.495837 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.563738 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:11.564828 26579 raft_consensus.cc:2393] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:11.470448 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08003054e0 after lost signal to thread 30686
I20260709 13:11:11.565682 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:11.566298 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080031bea0 after lost signal to thread 30748
W20260709 13:11:11.566627 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08003bea40 after lost signal to thread 30762
I20260709 13:11:11.464087 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2372) took 4471 ms. Trace:
W20260709 13:11:11.566933 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8c00 after lost signal to thread 30768
W20260709 13:11:11.567276 26439 debug-util.cc:398] Leaking SignalData structure 0x7b0800343fe0 after lost signal to thread 30770
I20260709 13:11:11.566955 26503 rpcz_store.cc:276] 0709 13:11:06.992328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.417312 (+4424984us) service_pool.cc:224] Handling call
0709 13:11:11.417617 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.463620 (+ 46003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.464033 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:11.567741 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080024a540 after lost signal to thread 30775
I20260709 13:11:11.489717 26401 catalog_manager.cc:5697] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:11.510597 27278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 676) took 4444 ms (client timeout 1699 ms). Trace:
I20260709 13:11:11.554553 27271 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
W20260709 13:11:11.568847 27278 rpcz_store.cc:269] 0709 13:11:07.065429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.097747 (+ 32318us) service_pool.cc:224] Handling call
0709 13:11:11.509006 (+4411259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:11.488581 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 54210.8us
I20260709 13:11:11.514902 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.495362 30825 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:11.491736 30796 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.571645 26508 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:11.572808 30796 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:11.573511 26580 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:11.576556 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.577147 26580 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:11.486835 30629 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:11.494906 30784 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:11.521538 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 104014us
W20260709 13:11:11.527419 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 47374.8us
W20260709 13:11:11.478550 26531 debug-util.cc:398] Leaking SignalData structure 0x7b080013b1e0 after lost signal to thread 26651
W20260709 13:11:11.580330 26531 debug-util.cc:398] Leaking SignalData structure 0x7b080013b140 after lost signal to thread 26653
W20260709 13:11:11.581404 26531 debug-util.cc:398] Leaking SignalData structure 0x7b0800411140 after lost signal to thread 26683
W20260709 13:11:11.581790 26531 debug-util.cc:398] Leaking SignalData structure 0x7b0800411100 after lost signal to thread 26684
W20260709 13:11:11.583038 26531 debug-util.cc:398] Leaking SignalData structure 0x7b0800324a80 after lost signal to thread 27302
W20260709 13:11:11.583528 26531 debug-util.cc:398] Leaking SignalData structure 0x7b080033dbc0 after lost signal to thread 30645
W20260709 13:11:11.583966 26531 debug-util.cc:398] Leaking SignalData structure 0x7b08002b48c0 after lost signal to thread 30686
W20260709 13:11:11.584896 26531 debug-util.cc:398] Leaking SignalData structure 0x7b080023e200 after lost signal to thread 30804
W20260709 13:11:11.388041 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.549484 27276 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:11:11.549409 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:11.550140 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:11.586895 27274 raft_consensus.cc:2410] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:11.550444 26473 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:11.550644 27273 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:11.550889 30869 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:11.518597 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.551177 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:11.491503 27275 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
I20260709 13:11:11.551601 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.596422 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.552155 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:11.551601 30719 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.553157 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.553494 26576 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:11.553692 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.598536 26584 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:11.554340 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.490465 26650 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:11.554178 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.386879 26502 rpcz_store.cc:276] 0709 13:11:06.973116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.384033 (+4410917us) service_pool.cc:224] Handling call
0709 13:11:11.384378 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.385976 (+  1598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.386196 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:11.554469 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.555214 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.556463 30878 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.558569 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.601486 26504 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:11.559690 26656 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:11.559506 30814 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.561698 26654 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:11.491151 30609 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:11:11.405325 26404 rpcz_store.cc:269] 0709 13:10:43.731609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.731936 (+   327us) service_pool.cc:224] Handling call
0709 13:11:11.148409 (+27416473us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:06.121349 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:06.377644 (+256295us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:06.390723 (+ 13079us) write_op.cc:435] Acquired schema lock
0709 13:11:06.393779 (+  3056us) tablet.cc:662] Decoding operations
0709 13:11:06.442612 (+ 48833us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:06.442695 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:06.442720 (+    25us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:11:06.444184 (+  1464us) tablet.cc:701] Row locks acquired
0709 13:11:06.444233 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:11:06.444400 (+   167us) write_op.cc:270] Start()
0709 13:11:06.444557 (+   157us) write_op.cc:276] Timestamp: P: 1783602666444338 usec, L: 0
0709 13:11:06.444583 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:06.445425 (+   842us) log.cc:844] Serialized 5944 byte log entry
0709 13:11:07.019139 (+573714us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:07.153432 (+134293us) op_driver.cc:464] REPLICATION: finished
0709 13:11:09.026402 (+1872970us) write_op.cc:301] APPLY: starting
0709 13:11:09.026508 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:09.042178 (+ 15670us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:09.042226 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:09.051808 (+  9582us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:09.052193 (+   385us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:11:09.052243 (+    50us) write_op.cc:312] APPLY: finished
0709 13:11:09.052720 (+   477us) log.cc:844] Serialized 139 byte log entry
0709 13:11:09.052930 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:09.053103 (+   173us) write_op.cc:454] Released schema lock
0709 13:11:09.053178 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:09.053821 (+   643us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:09.053861 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12801901,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":1872529,"apply.run_cpu_time_us":22686,"apply.run_wall_time_us":27403,"cfile_cache_hit":58,"cfile_cache_hit_bytes":60639,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":1,"lbm_read_time_us":1092,"lbm_reads_lt_1ms":8,"num_ops":15,"prepare.queue_time_us":273048,"prepare.run_cpu_time_us":15227,"prepare.run_wall_time_us":621219,"raft.queue_time_us":117458,"raft.run_cpu_time_us":113137,"raft.run_wall_time_us":418257,"replication_time_us":708467,"spinlock_wait_cycles":29599488,"thread_start_us":732628,"threads_started":4,"wal-append.queue_time_us":417710,"wal-append.run_cpu_time_us":57739,"wal-append.run_wall_time_us":3309744}]]}
I20260709 13:11:11.602005 27241 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:11:11.568018 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08003ad480 after lost signal to thread 30776
W20260709 13:11:11.621016 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080028d580 after lost signal to thread 30779
W20260709 13:11:11.621290 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080035ae40 after lost signal to thread 30781
W20260709 13:11:11.621676 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08000b40a0 after lost signal to thread 30790
I20260709 13:11:11.590513 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.597414 27272 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:11.622186 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080013b820 after lost signal to thread 30802
W20260709 13:11:11.622471 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080038e260 after lost signal to thread 30805
W20260709 13:11:11.622952 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08002f15c0 after lost signal to thread 30822
I20260709 13:11:11.617908 30814 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:11.586045 27276 pending_rounds.cc:85] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 8
I20260709 13:11:11.625937 27276 pending_rounds.cc:107] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:11:11.493403 30804 consensus_queue.cc:1059] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:11:11.558782 27277 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:11.630769 26508 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:11:11.606088 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.606671 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.606791 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:11.632472 26577 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:11.607393 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 562) took 4777 ms. Trace:
W20260709 13:11:11.632767 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.607347 30742 consensus_queue.cc:1059] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:11.607774 30719 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:11.608042 30876 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:11.608351 26583 raft_consensus.cc:2393] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:11.608927 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:11.607817 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 134386us
I20260709 13:11:11.640863 26474 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.610231 30878 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.602217 30644 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:11:11.610225 26510 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:11.598737 30673 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:11:11.612174 27270 raft_consensus.cc:2393] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:11.598480 30645 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:11:11.607409 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.614624 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.615907 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.618428 26401 catalog_manager.cc:5697] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:11.623323 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08002490e0 after lost signal to thread 30830
I20260709 13:11:11.597656 26473 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:11.657394 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08001c8fa0 after lost signal to thread 30831
W20260709 13:11:11.657809 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08003880c0 after lost signal to thread 30841
W20260709 13:11:11.657868 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 60322.9us
I20260709 13:11:11.656750 26502 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:11.624114 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.598178 30676 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:11.624167 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.626210 27276 raft_consensus.cc:2889] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.626876 27243 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.628702 30901 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.605476 30869 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:11.631273 27241 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:11:11.634665 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.671612 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:11.671898 26622 connection.cc:256] RPC call timeout handler was delayed by -5.1245469810000941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 13:11:11.672328 26622 connection.cc:256] RPC call timeout handler was delayed by -5.1020469810000577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 13:11:11.672724 26622 connection.cc:256] RPC call timeout handler was delayed by -5.01933444600013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:11:11.673316 26622 connection.cc:256] RPC call timeout handler was delayed by -4.2943728390000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
W20260709 13:11:11.673732 26622 connection.cc:256] RPC call timeout handler was delayed by -4.2097728389999247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:11:11.674144 26622 connection.cc:256] RPC call timeout handler was delayed by -4.186746980999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3003s for a response
I20260709 13:11:11.630312 30602 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:11:11.634341 30864 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:11.637766 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.633101 26501 rpcz_store.cc:276] 0709 13:11:06.829981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.273888 (+4443907us) service_pool.cc:224] Handling call
0709 13:11:11.274323 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.274703 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.274735 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.275308 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:11:11.555082 (+279774us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:11.555129 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.555216 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.556943 (+  1727us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b1800341d40. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:11.595567 (+ 38624us) raft_consensus.cc:1685] finished
0709 13:11:11.595592 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.607329 (+ 11737us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3247,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":162,"spinlock_wait_cycles":4733312,"thread_start_us":238269,"threads_started":1,"wal-append.queue_time_us":275233}
I20260709 13:11:11.670874 26401 catalog_manager.cc:5697] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 7, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 7 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:11.602339 30796 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:11:11.612454 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:11.598603 30867 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:11:11.624045 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:11.645514 30875 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:11.662001 26509 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:11.667160 26504 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:11.667186 26505 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:11.668556 27269 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
W20260709 13:11:11.680833 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 54052.5us
I20260709 13:11:11.682200 27243 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:11.670096 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 57370.1us
I20260709 13:11:11.672240 26508 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:11.603101 30721 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:11:11.675751 26622 connection.cc:256] RPC call timeout handler was delayed by -4.0918728389999615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 13:11:11.685293 26622 connection.cc:256] RPC call timeout handler was delayed by -4.0918728389999615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 13:11:11.685700 26622 connection.cc:256] RPC call timeout handler was delayed by -3.9343728389999342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 13:11:11.686043 26622 connection.cc:256] RPC call timeout handler was delayed by -3.9136728389999007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:11:11.686393 26622 connection.cc:256] RPC call timeout handler was delayed by -3.8965728390001004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:11:11.642783 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:11.677127 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.624506 30600 consensus_queue.cc:1059] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:11:11.686682 26622 connection.cc:256] RPC call timeout handler was delayed by -3.895672839000099s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
W20260709 13:11:11.689059 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 57856.2us
W20260709 13:11:11.689356 26622 connection.cc:256] RPC call timeout handler was delayed by -3.854272839000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 13:11:11.689793 26622 connection.cc:256] RPC call timeout handler was delayed by -3.6985728390000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 13:11:11.634202 30817 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:11:11.690335 26622 connection.cc:256] RPC call timeout handler was delayed by -3.6733728389999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 13:11:11.690766 26622 connection.cc:256] RPC call timeout handler was delayed by -2.1298728389999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.39180000000000004s for a response
W20260709 13:11:11.691115 26622 connection.cc:256] RPC call timeout handler was delayed by -2.1298728389999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.39180000000000004s for a response
W20260709 13:11:11.691488 26622 connection.cc:256] RPC call timeout handler was delayed by -1.5403728389999287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.45730000000000004s for a response
I20260709 13:11:11.691751 27272 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:11.692075 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:11.685714 30758 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:11:11.692909 30685 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:11.692981 30712 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:11.693522 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.713253 26507 raft_consensus.cc:2393] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:11.685402 30866 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:11.707497 30685 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.695837 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.714524 30685 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:11.715407 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.717108 26622 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.697273 27243 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.670806 30676 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.646018 30695 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:11:11.703794 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 61075.5us
I20260709 13:11:11.670670 30825 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:11:11.673875 30788 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:11.709815 26401 catalog_manager.cc:5697] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.705174 30792 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:11.679867 30864 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.722898 26622 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.723752 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.752190 26506 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:11.705717 30545 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:11.706372 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.717788 30885 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:11.746131 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 48965.5us
I20260709 13:11:11.747874 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:11.772495 26502 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:11.741780 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.753042 26581 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:11.754138 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.694831 30804 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:11:11.690582 30720 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:11:11.773664 26507 raft_consensus.cc:2410] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:11.777156 26401 catalog_manager.cc:5697] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 3 to 7, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 7 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.771900 27243 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:11.774089 26501 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
W20260709 13:11:11.778507 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.742524 30676 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:11.785607 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:11.742789 30645 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:11.793241 27275 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:11.786602 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:11.794728 27273 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:11.788615 30872 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:11.789016 30902 raft_consensus.cc:3055] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:11.772289 30545 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.790500 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:11.791334 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:11.810194 27274 raft_consensus.cc:2410] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:11:11.792304 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 105080us
I20260709 13:11:11.793479 27272 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:11.744988 30884 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:11.740803 30712 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:11.817165 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:11.819391 27276 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 7: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:11.812842 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:11.815306 27277 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:11.817802 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:11.753120 30861 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:11.755554 30864 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.821497 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:11.775279 30721 raft_consensus.cc:3055] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:11.811305 30902 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:11.825513 27270 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:11.823405 26401 catalog_manager.cc:5697] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 8, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 8 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.804772 30719 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:11.806181 30866 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:11.815521 30545 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:11.854442 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08001300c0 after lost signal to thread 25395
I20260709 13:11:11.771391 30602 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:11:11.862885 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:11.871037 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6460 after lost signal to thread 25398
I20260709 13:11:11.828715 30721 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:11.876294 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800305b60 after lost signal to thread 26442
I20260709 13:11:11.876591 26507 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:11.872017 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.876899 26401 catalog_manager.cc:5697] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.875074 30902 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:11.856382 30866 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.851146 30875 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:11.879700 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8740 after lost signal to thread 26506
W20260709 13:11:11.895422 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec520 after lost signal to thread 26534
W20260709 13:11:11.895766 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec560 after lost signal to thread 26535
W20260709 13:11:11.896157 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800252a00 after lost signal to thread 26548
W20260709 13:11:11.896214 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 154539us
I20260709 13:11:11.898402 26474 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:11.898522 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 257027us
W20260709 13:11:11.897276 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd5e0 after lost signal to thread 26609
W20260709 13:11:11.899397 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd840 after lost signal to thread 26610
I20260709 13:11:11.899523 26549 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:11.900348 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6d20 after lost signal to thread 26651
W20260709 13:11:11.900725 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5220 after lost signal to thread 26653
W20260709 13:11:11.901048 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800247e80 after lost signal to thread 26656
W20260709 13:11:11.901326 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 178512us
W20260709 13:11:11.901805 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4ea0 after lost signal to thread 26683
W20260709 13:11:11.902259 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800375500 after lost signal to thread 26684
I20260709 13:11:11.884282 30866 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:11.903476 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2181) took 1013 ms. Trace:
I20260709 13:11:11.906548 26474 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:11.910683 26651 rpcz_store.cc:276] 0709 13:11:10.882174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.472653 (+590479us) service_pool.cc:224] Handling call
0709 13:11:11.473083 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.473282 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:11.729046 (+255764us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.893615 (+164569us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.893887 (+   272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:11.893936 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:11.893985 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.894061 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.895405 (+  1344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88877,"prepare.queue_time_us":129043,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":84,"raft.queue_time_us":333,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8727,"spinlock_wait_cycles":3221760,"thread_start_us":324003,"threads_started":2}
W20260709 13:11:11.902729 26680 debug-util.cc:398] Leaking SignalData structure 0x7b080032ff00 after lost signal to thread 27243
W20260709 13:11:11.914701 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3000 after lost signal to thread 27269
W20260709 13:11:11.914959 26680 debug-util.cc:398] Leaking SignalData structure 0x7b080033cf40 after lost signal to thread 27270
W20260709 13:11:11.915217 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800371920 after lost signal to thread 27274
W20260709 13:11:11.915467 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08000cdf40 after lost signal to thread 27277
I20260709 13:11:11.902366 26622 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.904422 26509 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:11.921485 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2e00 after lost signal to thread 27278
I20260709 13:11:11.908093 30867 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:11.924559 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.924962 26474 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:11.925426 26507 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
W20260709 13:11:11.929047 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 77246.3us
I20260709 13:11:11.906502 30902 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:11.934019 26680 debug-util.cc:398] Leaking SignalData structure 0x7b080018cd00 after lost signal to thread 27302
W20260709 13:11:11.934413 26680 debug-util.cc:398] Leaking SignalData structure 0x7b080034e340 after lost signal to thread 30168
W20260709 13:11:11.934671 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003fc580 after lost signal to thread 30374
W20260709 13:11:11.935045 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002a73e0 after lost signal to thread 30562
W20260709 13:11:11.935302 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3820 after lost signal to thread 30599
W20260709 13:11:11.935523 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1000 after lost signal to thread 30600
W20260709 13:11:11.935770 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002efca0 after lost signal to thread 30602
W20260709 13:11:11.936013 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800259200 after lost signal to thread 30644
W20260709 13:11:11.936221 26680 debug-util.cc:398] Leaking SignalData structure 0x7b080035be00 after lost signal to thread 30645
W20260709 13:11:11.936436 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800330d40 after lost signal to thread 30653
W20260709 13:11:11.936651 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003aaf40 after lost signal to thread 30660
W20260709 13:11:11.936812 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0140 after lost signal to thread 30662
W20260709 13:11:11.936939 26680 debug-util.cc:398] Leaking SignalData structure 0x7b080003e0a0 after lost signal to thread 30673
W20260709 13:11:11.937081 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca660 after lost signal to thread 30685
W20260709 13:11:11.937206 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003da680 after lost signal to thread 30686
I20260709 13:11:11.918910 30788 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:11.937664 26401 catalog_manager.cc:5697] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 3 to 6, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 6 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:11.943759 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800395f40 after lost signal to thread 30688
W20260709 13:11:11.944144 26680 debug-util.cc:398] Leaking SignalData structure 0x7b080035aec0 after lost signal to thread 30704
I20260709 13:11:11.940217 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:11.944444 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800204f80 after lost signal to thread 30711
I20260709 13:11:11.944717 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:11.944726 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003a79a0 after lost signal to thread 30712
I20260709 13:11:11.921267 30602 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:11:11.999276 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec020 after lost signal to thread 25395
W20260709 13:11:11.946101 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8140 after lost signal to thread 30719
W20260709 13:11:12.077155 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3760 after lost signal to thread 30720
I20260709 13:11:12.030552 26401 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:12.030972 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.931645 30875 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:12.038025 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:11.934852 30912 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:11.905157 30908 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 13:11:11.921998 30742 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:11:11.903311 30712 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:11.942502 30654 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.135s
I20260709 13:11:12.030387 30885 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:12.038949 30867 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:12.077155 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800087ce0 after lost signal to thread 25398
I20260709 13:11:12.077945 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:11.937911 30804 consensus_queue.cc:1059] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.181s
I20260709 13:11:12.136039 26651 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:12.080507 26509 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
W20260709 13:11:12.133363 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 197703us
W20260709 13:11:12.134109 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 185855us
I20260709 13:11:11.938184 30792 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.182s
I20260709 13:11:11.931283 30721 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:12.115701 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 169020us
W20260709 13:11:12.142954 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0340 after lost signal to thread 26439
W20260709 13:11:12.077512 26680 debug-util.cc:398] Leaking SignalData structure 0x7b080031e520 after lost signal to thread 30721
W20260709 13:11:12.153745 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000cce40 after lost signal to thread 26442
I20260709 13:11:12.155114 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:12.124657 26401 catalog_manager.cc:5697] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 9, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 9 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:12.156818 26680 debug-util.cc:398] Leaking SignalData structure 0x7b080003b260 after lost signal to thread 30742
W20260709 13:11:12.158865 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08004054e0 after lost signal to thread 30758
W20260709 13:11:12.159915 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5d00 after lost signal to thread 30763
W20260709 13:11:12.160377 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa380 after lost signal to thread 30784
W20260709 13:11:12.160754 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800217900 after lost signal to thread 30787
W20260709 13:11:12.161198 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7040 after lost signal to thread 30796
W20260709 13:11:12.159479 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080008f400 after lost signal to thread 26473
W20260709 13:11:12.161796 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000abda0 after lost signal to thread 26474
W20260709 13:11:12.162750 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9a60 after lost signal to thread 26501
W20260709 13:11:12.163177 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000a2f80 after lost signal to thread 26503
W20260709 13:11:12.163913 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0320 after lost signal to thread 26504
W20260709 13:11:12.164296 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800057ee0 after lost signal to thread 26505
W20260709 13:11:12.163501 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003ef6c0 after lost signal to thread 30804
W20260709 13:11:12.170727 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd9e0 after lost signal to thread 30807
W20260709 13:11:12.171200 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000a2620 after lost signal to thread 26506
W20260709 13:11:12.206378 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9bc0 after lost signal to thread 26508
W20260709 13:11:12.206663 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000acc40 after lost signal to thread 26509
I20260709 13:11:12.177610 26401 catalog_manager.cc:5697] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:12.207238 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000abc40 after lost signal to thread 26534
I20260709 13:11:12.030316 30645 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:11:12.037468 30609 consensus_queue.cc:1059] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:11:12.080071 30817 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.131418 30875 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:12.224208 26401 catalog_manager.cc:5697] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:12.191860 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.226329 26507 raft_consensus.cc:2410] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 9 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:11:12.202185 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 262055us
W20260709 13:11:12.177248 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800395480 after lost signal to thread 30814
W20260709 13:11:12.227156 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003561c0 after lost signal to thread 30817
W20260709 13:11:12.227416 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800402c80 after lost signal to thread 30821
W20260709 13:11:12.222796 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080005f0e0 after lost signal to thread 26535
W20260709 13:11:12.227818 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000cce20 after lost signal to thread 26548
W20260709 13:11:12.227625 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae320 after lost signal to thread 30825
W20260709 13:11:12.229187 26680 debug-util.cc:398] Leaking SignalData structure 0x7b080033fa80 after lost signal to thread 30827
W20260709 13:11:12.229446 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800246460 after lost signal to thread 30828
W20260709 13:11:12.229756 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800403140 after lost signal to thread 30845
W20260709 13:11:12.230012 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003b90e0 after lost signal to thread 30850
W20260709 13:11:12.228545 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080020adc0 after lost signal to thread 26578
W20260709 13:11:12.233438 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080037be60 after lost signal to thread 26579
W20260709 13:11:12.233758 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd4c0 after lost signal to thread 26581
I20260709 13:11:12.233632 26401 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 8, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 8 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:11:12.234284 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08002598a0 after lost signal to thread 26584
W20260709 13:11:12.237918 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080037bce0 after lost signal to thread 26585
W20260709 13:11:12.238587 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad980 after lost signal to thread 26609
W20260709 13:11:12.238890 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080029d980 after lost signal to thread 26610
W20260709 13:11:12.240193 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800394240 after lost signal to thread 26683
W20260709 13:11:12.240518 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003c76c0 after lost signal to thread 26684
W20260709 13:11:12.240947 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7660 after lost signal to thread 27243
W20260709 13:11:12.242754 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003fbd80 after lost signal to thread 27269
W20260709 13:11:12.243065 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800322be0 after lost signal to thread 27270
W20260709 13:11:12.243822 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 89933.8us
W20260709 13:11:12.246448 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8ac0 after lost signal to thread 27272
I20260709 13:11:12.076282 30913 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.197s
I20260709 13:11:12.247148 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.254073 26501 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
W20260709 13:11:12.248358 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003be780 after lost signal to thread 27274
W20260709 13:11:12.259163 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4620 after lost signal to thread 27277
W20260709 13:11:12.261385 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003970a0 after lost signal to thread 27278
I20260709 13:11:12.225349 30784 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:12.222396 30914 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:12.262077 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003eee20 after lost signal to thread 27302
I20260709 13:11:12.199896 30721 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.240971 30742 consensus_queue.cc:1243] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer b9c3761688a64982ae1c4aeb758e09ef log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:12.256599 30907 consensus_queue.cc:1059] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:11:12.272264 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:12.273532 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.284915 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003e40a0 after lost signal to thread 30168
W20260709 13:11:12.285545 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800335440 after lost signal to thread 30374
W20260709 13:11:12.286055 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800255c60 after lost signal to thread 30562
I20260709 13:11:12.286352 26654 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:11:12.286458 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec8c0 after lost signal to thread 30599
W20260709 13:11:12.287075 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800307f20 after lost signal to thread 30600
I20260709 13:11:12.272773 26653 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:12.276019 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.277226 26658 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:12.274590 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.296627 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:12.273550 30906 log.cc:927] Time spent T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.393s	user 0.000s	sys 0.000s
W20260709 13:11:12.272970 30905 log.cc:927] Time spent T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.379s	user 0.000s	sys 0.000s
I20260709 13:11:12.227607 30817 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.188071 30788 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:12.299984 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 58725.5us
I20260709 13:11:12.288182 26657 raft_consensus.cc:2410] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:12.303778 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:12.287883 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080026c8a0 after lost signal to thread 30602
I20260709 13:11:12.301617 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:12.289366 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:12.304364 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080030a800 after lost signal to thread 30629
I20260709 13:11:12.290935 26501 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
W20260709 13:11:12.305677 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800332d20 after lost signal to thread 30644
W20260709 13:11:12.307080 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080030a480 after lost signal to thread 30653
W20260709 13:11:12.308436 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7f00 after lost signal to thread 30660
I20260709 13:11:12.288723 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:12.308794 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003696e0 after lost signal to thread 30662
W20260709 13:11:12.310205 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7ea0 after lost signal to thread 30673
W20260709 13:11:12.308241 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 59158.9us
I20260709 13:11:12.287791 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:12.314971 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800347600 after lost signal to thread 30676
W20260709 13:11:12.315471 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800174880 after lost signal to thread 30685
W20260709 13:11:12.315747 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08002ade80 after lost signal to thread 30686
W20260709 13:11:12.315975 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003e11c0 after lost signal to thread 30687
I20260709 13:11:12.315862 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:12.315295 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:12.316233 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080000f740 after lost signal to thread 30688
W20260709 13:11:12.316536 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08000be380 after lost signal to thread 30704
W20260709 13:11:12.316772 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800411740 after lost signal to thread 30711
W20260709 13:11:12.316992 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2860 after lost signal to thread 30712
W20260709 13:11:12.317245 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1080 after lost signal to thread 30720
I20260709 13:11:12.291829 27241 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:11:12.317476 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003f36a0 after lost signal to thread 30721
W20260709 13:11:12.318089 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003d85a0 after lost signal to thread 30742
W20260709 13:11:12.318305 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003c70e0 after lost signal to thread 30758
W20260709 13:11:12.318524 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08002b1660 after lost signal to thread 30763
I20260709 13:11:12.317428 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:12.319522 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:12.320480 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:12.321327 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:12.321875 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3720 after lost signal to thread 30784
I20260709 13:11:12.321446 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:12.322167 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800325380 after lost signal to thread 30787
W20260709 13:11:12.322628 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080033adc0 after lost signal to thread 30788
I20260709 13:11:12.324726 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.325743 30916 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:12.322470 26476 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:12.307194 30654 raft_consensus.cc:3055] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:12.330875 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:12.331401 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:12.334786 26654 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:12.335732 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:12.336316 26654 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
W20260709 13:11:12.326866 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0ae0 after lost signal to thread 30792
I20260709 13:11:12.326233 30867 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:12.333096 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:12.336959 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0080 after lost signal to thread 30795
I20260709 13:11:12.322650 26659 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
W20260709 13:11:12.337244 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080028afe0 after lost signal to thread 30796
W20260709 13:11:12.337520 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003ff680 after lost signal to thread 30807
W20260709 13:11:12.337785 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080020d780 after lost signal to thread 30814
W20260709 13:11:12.337983 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800307f40 after lost signal to thread 30817
W20260709 13:11:12.338184 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003f10c0 after lost signal to thread 30821
I20260709 13:11:12.332279 26476 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:12.338393 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800346e40 after lost signal to thread 30825
W20260709 13:11:12.339848 26606 debug-util.cc:398] Leaking SignalData structure 0x7b080033cea0 after lost signal to thread 30827
W20260709 13:11:12.340085 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0600 after lost signal to thread 30828
W20260709 13:11:12.340376 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08002a77a0 after lost signal to thread 30833
I20260709 13:11:12.340237 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:12.340638 26606 debug-util.cc:398] Leaking SignalData structure 0x7b0800302ea0 after lost signal to thread 30845
W20260709 13:11:12.340929 26606 debug-util.cc:398] Leaking SignalData structure 0x7b08002653a0 after lost signal to thread 30850
I20260709 13:11:12.342118 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:12.329198 30792 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:12.287657 30929 consensus_queue.cc:1059] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:11:12.343834 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:12.345338 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43819us
I20260709 13:11:12.348665 26657 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:12.349589 26548 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:12.349902 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.350543 26507 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:12.330672 30784 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:12.351454 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.354195 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:12.355192 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.356040 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.360848 26503 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:12.356316 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.348135 30792 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.334381 30654 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:12.358479 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:12.369218 27272 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:11:12.360415 26501 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:12.344556 30645 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:12.363760 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:12.364835 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:12.357838 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:12.339362 30867 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.359179 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:12.366410 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:12.367666 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:12.453658 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:12.409052 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:12.356977 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.457885 26508 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 7.
I20260709 13:11:12.458504 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:12.458840 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.459117 27275 raft_consensus.cc:2376] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8. Re-sending same reply.
I20260709 13:11:12.460008 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.461095 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:12.460026 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:12.462853 27275 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:12.338397 30885 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:12.466017 30876 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:12.408922 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:12.466876 30885 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:12.467461 30876 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:12.346810 30917 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:12.467935 30876 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:12.468859 30876 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.409888 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:12.470700 26501 raft_consensus.cc:2393] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 12: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:12.471102 30933 raft_consensus.cc:3055] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:12.471504 30933 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:12.359398 30825 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:12.473129 30825 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:12.473683 30825 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:12.442551 30913 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:11:12.431231 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:12.431763 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:12.479244 27270 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:11:12.434080 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.434859 26474 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:12.351305 30907 consensus_queue.cc:1243] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:12.360049 30784 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.437381 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:12.438110 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:12.363191 30925 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:12.309103 30875 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.369212 30792 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:12.439632 30939 raft_consensus.cc:3055] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:12.326572 30934 consensus_queue.cc:1059] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
W20260709 13:11:12.441663 30911 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:11:12.453167 27277 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.368028 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:12.454945 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:12.455507 27273 raft_consensus.cc:2410] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:12.452436 30645 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:11:12.410081 30915 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
I20260709 13:11:12.454223 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:12.456445 26504 raft_consensus.cc:2393] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 13: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:12.444509 27240 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:12.409175 30685 consensus_meta.cc:287] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.001s
I20260709 13:11:12.362629 26579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:11:12.472308 30933 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:12.503516 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 68690.2us
W20260709 13:11:12.504334 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.362401 30742 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:11:12.517988 27271 raft_consensus.cc:2376] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9. Re-sending same reply.
I20260709 13:11:12.516283 26503 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.409483 30937 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:12.485020 26653 raft_consensus.cc:2410] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:11:12.525292 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:12.481463 30814 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.851s	user 0.006s	sys 0.004s
W20260709 13:11:12.499821 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 167636us
I20260709 13:11:12.534456 26650 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:12.456157 30867 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:12.520380 30676 consensus_meta.cc:287] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.705s	user 0.003s	sys 0.009s
W20260709 13:11:12.540171 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 85291.8us
I20260709 13:11:12.570863 26579 raft_consensus.cc:606] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:12.570655 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 428471us
W20260709 13:11:12.570647 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 126254us
I20260709 13:11:12.514568 30917 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:12.522753 30784 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.575249 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:12.581984 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:12.582122 27240 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:12.492940 30878 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:12.577936 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.522238 30925 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.528743 30804 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.490659 30817 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:12.541244 30719 consensus_meta.cc:287] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.004s
I20260709 13:11:12.590284 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:12.572289 30937 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.539959 30939 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:12.597524 30878 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:11:12.598134 30545 consensus_meta.cc:287] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.719s	user 0.006s	sys 0.006s
I20260709 13:11:12.634531 27277 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:12.580735 30653 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:12.640743 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:12.589608 30930 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:12.667798 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:12.603724 30925 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:12.675325 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:12.694108 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 112050us
I20260709 13:11:12.695942 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:12.639113 30933 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:12.609058 30719 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:12.645661 30915 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:12.594244 30676 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.540891 30654 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.608314 30937 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:12.707700 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.576427 30685 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.646783 30653 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:12.647066 30545 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.722158 30677 tablet_copy_client.cc:538] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:12.742331 30685 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:12.745806 30676 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:12.744606 26509 raft_consensus.cc:2368] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 12. Current term is 13.
I20260709 13:11:12.747237 30653 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.748550 30653 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.747264 27272 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:12.723485 30916 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:11:12.658299 30825 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:12.784652 30902 consensus_meta.cc:287] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.842s	user 0.009s	sys 0.000s
I20260709 13:11:12.714076 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:12.791977 26651 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:12.608125 30804 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.711162 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:12.807271 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.821305 30654 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.639256 30645 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.901422 30645 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:12.901782 30685 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:12.706709 30878 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:12.824664 26659 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:12.903450 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:12.905011 30864 consensus_meta.cc:287] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.056s	user 0.008s	sys 0.003s
I20260709 13:11:12.905432 30864 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.910727 26501 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:12.914150 30866 consensus_meta.cc:287] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.994s	user 0.008s	sys 0.003s
I20260709 13:11:12.914996 30956 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:12.914736 30866 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.915639 30956 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.793148 30939 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.918435 30956 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:12.919010 30939 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:12.842597 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 267429us
I20260709 13:11:12.855350 30600 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:12.924309 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 249071us
I20260709 13:11:12.927294 26548 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:12.933748 26654 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
W20260709 13:11:12.856947 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 266413us
I20260709 13:11:12.776939 30792 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:12.869921 26503 raft_consensus.cc:2410] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:11:12.894446 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.898255 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 187170us
I20260709 13:11:12.928601 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:12.856202 30920 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:12.938345 26474 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:12.942543 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:13.062021 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 119593us
I20260709 13:11:13.062973 27240 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:13.064393 27240 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.066120 27240 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.067571 27240 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:12.961071 26548 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:12.923914 30864 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:12.986209 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:13.008618 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 7672ae1d65b4497686627cb041189424: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:13.053391 30867 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.054627 30792 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:12.926245 30644 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:13.055879 26503 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:11:13.082437 26503 pending_rounds.cc:85] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 9
I20260709 13:11:13.082824 26503 pending_rounds.cc:107] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:11:13.083220 26503 raft_consensus.cc:2889] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:12.936631 30907 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:13.068939 26650 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.070842 27240 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:13.074345 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:13.006311 30866 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:12.972362 30935 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:11:13.061174 30902 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:13.090865 30902 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.091116 26581 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:13.091480 30902 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.077839 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:13.078745 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:13.081359 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:13.079955 30687 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:13.081595 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:13.080116 30817 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:13.075284 30685 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:13.056550 26508 raft_consensus.cc:2368] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12.
I20260709 13:11:12.942679 30865 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:13.074898 30957 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:13.081974 30956 raft_consensus.cc:2764] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:11:13.091719 30926 raft_consensus.cc:3055] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:13.098702 30926 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:13.093823 30817 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.100127 30817 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.101712 30937 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.075448 30673 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.094004 26583 raft_consensus.cc:2393] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 8: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:13.094079 26584 raft_consensus.cc:2393] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:13.077275 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 139035us
W20260709 13:11:13.094678 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.106469 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.106866 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:13.104306 30937 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:13.114738 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43978.1us
I20260709 13:11:13.092572 26578 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:13.117089 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:13.117542 26507 raft_consensus.cc:2393] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:13.086310 30907 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.121155 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:13.121505 30907 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:13.096807 30903 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.223s	user 0.003s	sys 0.011s
I20260709 13:11:13.123500 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:13.093492 30687 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.128078 26578 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:13.085243 30920 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:13.129983 30920 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.099656 30926 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.093961 30545 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:13.130406 30920 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.130898 30926 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.129164 30864 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:13.132123 30925 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.124770 26474 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.126086 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:13.094194 30644 raft_consensus.cc:697] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:13.099618 30902 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.134425 30925 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:13.140372 27273 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: [8.11-8.11]
I20260709 13:11:13.134330 30644 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.151623 26585 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:13.135396 30902 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:13.135763 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:13.135824 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:13.135421 30935 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:13.136417 30864 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:13.137302 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:13.156508 27274 raft_consensus.cc:2393] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:11:13.139743 30910 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.967s	user 0.000s	sys 0.013s
I20260709 13:11:13.140369 26502 raft_consensus.cc:2368] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9.
I20260709 13:11:13.159260 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:13.141353 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:13.135448 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:13.160557 27272 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:13.142108 26473 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:13.143639 30817 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.145355 30867 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.146332 27271 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:11:13.146895 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:13.147537 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:13.122658 30685 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:13.168695 26474 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.170452 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:13.156678 30804 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:13.139787 30677 tablet_bootstrap.cc:492] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:11:13.189958 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:13.115760 30784 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.183549 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:13.184257 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:13.189714 30685 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.203706 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:13.152348 30687 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.171636 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:13.183277 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:13.190860 27243 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.208315 27243 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.191757 30925 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:13.209756 30925 raft_consensus.cc:697] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:13.211020 30925 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.194738 26584 raft_consensus.cc:2410] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:13.199384 27274 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:13.156977 30956 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:13.218374 30956 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:13.218997 30956 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:11:13.220216 30869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.016s	sys 0.032s
W20260709 13:11:13.220791 30869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.016s	sys 0.032s
I20260709 13:11:13.220093 30956 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.202194 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:13.153395 30954 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:13.222872 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:13.224089 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:13.224714 26504 raft_consensus.cc:3060] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.226861 30695 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:13.227722 30695 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:13.230013 27243 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.236670 30763 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:13.238593 27243 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.246975 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:13.247349 27269 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:13.247586 27272 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.189879 30876 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:13.252503 26505 raft_consensus.cc:1217] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Deduplicated request from leader. Original: 5.7->[8.8-11.9]   Dedup: 8.8->[11.9-11.9]
I20260709 13:11:13.252902 26576 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:13.255339 26505 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: [8.8-11.9]
I20260709 13:11:13.245725 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.261087 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.199802 30856 raft_consensus.cc:3055] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:13.264699 30856 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:13.265194 30784 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.205839 30867 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.246646 30902 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.263274 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 2077) took 1704 ms. Trace:
I20260709 13:11:13.246580 30685 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.263427 30865 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.263726 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2902) took 1681 ms. Trace:
I20260709 13:11:13.192276 30944 consensus_queue.cc:1059] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:11:13.258183 30935 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:13.246853 30660 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.270658 26577 rpcz_store.cc:276] 0709 13:11:11.558420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.640229 (+ 81809us) service_pool.cc:224] Handling call
0709 13:11:11.660064 (+ 19835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.660347 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.660375 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.660788 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:11:11.883996 (+223208us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:11.884052 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.884393 (+   341us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.139207 (+1254814us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:13.262853 (+123646us) raft_consensus.cc:1685] finished
0709 13:11:13.262875 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.263159 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59668,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":22201,"spinlock_wait_cycles":62822656,"thread_start_us":171189,"threads_started":1,"wal-append.queue_time_us":395724}
I20260709 13:11:13.273365 27272 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:13.279134 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:13.273466 26580 rpcz_store.cc:276] 0709 13:11:11.578477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.634743 (+ 56266us) service_pool.cc:224] Handling call
0709 13:11:11.636254 (+  1511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.636518 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.636548 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.637043 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:11:11.721644 (+ 84601us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:11.721678 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.721767 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.096497 (+1374730us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b24002b99b8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f88296c29c4 00007f88296c0acb 00007f882987bdc9 00007f882987ba55 00007f882987b09d 00007f882c4ad10e 00007f882c4c488c 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221
0709 13:11:13.254786 (+158289us) raft_consensus.cc:1685] finished
0709 13:11:13.254803 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.259704 (+  4901us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3718912,"thread_start_us":84221,"threads_started":1,"wal-append.queue_time_us":159366}
W20260709 13:11:13.327278 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.319411 26504 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:13.273787 30784 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:13.273978 30865 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:13.268013 30867 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.280092 30763 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:13.355876 26504 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:13.364718 26650 raft_consensus.cc:2468] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:13.366575 27241 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:13.273574 30902 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.369239 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:13.265609 30856 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.280766 30660 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.384915 30920 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.372751 30784 raft_consensus.cc:2804] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:13.377315 30782 raft_consensus.cc:3055] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:13.389287 30856 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.397749 30907 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:13.402207 30962 log.cc:927] Time spent T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:13.387501 30930 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:13.412525 26582 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:13.419868 30967 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 13:11:13.420589 30902 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.387346 30944 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.423623 30660 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.408304 30782 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:13.432934 30907 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:13.433931 26579 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:13.427076 30784 raft_consensus.cc:697] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:13.436784 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2386) took 1083 ms. Trace:
I20260709 13:11:13.465075 26502 rpcz_store.cc:276] 0709 13:11:12.353817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.353960 (+   143us) service_pool.cc:224] Handling call
0709 13:11:13.436604 (+1082644us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54003539d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:13.436730 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793537280}
W20260709 13:11:13.465777 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.437219 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2396) took 1002 ms. Trace:
W20260709 13:11:13.466241 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.466693 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.466325 26508 rpcz_store.cc:276] 0709 13:11:12.434752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.460892 (+ 26140us) service_pool.cc:224] Handling call
0709 13:11:13.436935 (+976043us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54001847d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:13.437137 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214620544}
I20260709 13:11:13.437630 30817 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:13.440990 26503 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:13.441632 30867 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.442502 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:13.443252 30944 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:13.450856 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 868875us
I20260709 13:11:13.473488 26622 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.448458 30930 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.453627 30825 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.454563 30947 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:13.458461 30920 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.459486 30673 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:13.462845 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.488605 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:13.484347 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2392) took 1116 ms. Trace:
I20260709 13:11:13.490034 26507 rpcz_store.cc:276] 0709 13:11:12.367578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.367745 (+   167us) service_pool.cc:224] Handling call
0709 13:11:13.484103 (+1116358us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54000b4fd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:13.484274 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329887488}
I20260709 13:11:13.489599 26625 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:13.491027 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:13.491196 30784 consensus_queue.cc:237] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.492125 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2033) took 1209 ms. Trace:
I20260709 13:11:13.491915 26655 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:13.481763 30782 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.492377 30654 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:13.493036 30654 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.493134 30782 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:13.493625 30654 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.495455 30912 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:11:13.497341 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.467785 30913 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.498709 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.492549 26656 rpcz_store.cc:276] 0709 13:11:12.283123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.283904 (+   781us) service_pool.cc:224] Handling call
0709 13:11:12.284277 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.284635 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.284673 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.285148 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.338777 (+ 53629us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:13.457525 (+1118748us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b18003bde80. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882c4d14bc 00007f882981f48b 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f8829839455 00007f88303213c7 00007f882c9339a7 00007f882c9430bf
0709 13:11:13.464105 (+  6580us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.475188 (+ 11083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.475278 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.475333 (+    55us) raft_consensus.cc:1685] finished
0709 13:11:13.491943 (+ 16610us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.492075 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58760,"prepare.queue_time_us":254999,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3791,"raft.queue_time_us":70776,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":10270,"spinlock_wait_cycles":9985280,"thread_start_us":297024,"threads_started":2,"wal-append.queue_time_us":196249}
I20260709 13:11:13.505353 30926 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:13.505410 30719 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:13.506536 30930 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:13.475054 30932 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:13.508419 30928 raft_consensus.cc:3055] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:13.508880 30928 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:13.509680 30885 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:13.510090 30885 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.510440 30885 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:13.503988 26622 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.508092 30932 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.478008 30867 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.516496 26622 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.459658 30865 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.518646 26655 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:13.491979 30944 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:13.520792 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.523844 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.526901 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:13.527144 26474 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:13.529480 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:13.531507 30940 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:13.532075 30940 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.532589 30940 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.534932 30976 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.535274 30875 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.535720 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 575) took 1381 ms. Trace:
I20260709 13:11:13.535548 30976 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.535881 30875 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.536155 26509 rpcz_store.cc:276] 0709 13:11:12.154538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.154754 (+   216us) service_pool.cc:224] Handling call
0709 13:11:13.535517 (+1380763us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b540027e7d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:13.535658 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348707712}
I20260709 13:11:13.513744 30913 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.538120 30976 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.538691 30976 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.539189 30976 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.539965 30913 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.540233 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:13.540941 26653 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:13.528824 30928 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.528920 30719 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.541796 30928 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:13.542062 30719 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.541358 30976 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:13.544564 30673 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.545111 30673 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.526619 30947 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:13.546166 30947 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.546521 30947 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.547267 30673 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:13.549199 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.549320 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:13.487984 30687 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.566450 30599 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:13.566915 30599 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:13.567878 30599 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.569288 30599 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:13.531067 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.570489 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2208) took 1112 ms. Trace:
I20260709 13:11:13.572352 26651 rpcz_store.cc:276] 0709 13:11:12.458764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.524976 (+ 66212us) service_pool.cc:224] Handling call
0709 13:11:13.570216 (+1045240us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400106b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:13.570375 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509137792}
I20260709 13:11:13.573729 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:13.574440 26651 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:11:13.571365 30602 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:13.576428 27241 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:13.526901 30926 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:13.583950 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 52997.2us
I20260709 13:11:13.514428 30685 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.561434 30944 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:13.587965 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.593645 26622 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.526074 30867 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.578524 30719 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:13.585206 30712 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:13.602470 30712 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.603006 30712 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.586673 30926 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.595871 30929 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.606045 30875 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.606130 30926 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.601251 27278 raft_consensus.cc:2368] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:13.601393 30931 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:13.608021 30931 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.608474 30931 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:13.612061 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 651072us
I20260709 13:11:13.613112 26548 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:13.602555 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.619031 26548 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:13.620784 26548 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:13.576928 30602 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:13.624287 26548 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:13.596544 30944 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:13.633173 30919 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:13.636234 30919 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.636595 30919 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.639046 30867 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.629379 30920 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:13.631716 30825 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:13.641191 30602 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.642454 30602 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.645087 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.631542 30945 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:13.676494 26622 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.667717 26548 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:13.690899 30884 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:13.696430 30796 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:13.696844 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2050) took 1266 ms. Trace:
I20260709 13:11:13.698244 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:13.697290 26659 rpcz_store.cc:276] 0709 13:11:12.430437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.904284 (+473847us) service_pool.cc:224] Handling call
0709 13:11:12.904584 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.465186 (+560602us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:13.471518 (+  6332us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.625821 (+154303us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.626037 (+   216us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.626573 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.626727 (+   154us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:13.626928 (+   201us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.630487 (+  3559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.630586 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.696648 (+ 66062us) raft_consensus.cc:1685] finished
0709 13:11:13.696668 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.696788 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":590193,"prepare.queue_time_us":140179,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":103,"raft.queue_time_us":592992,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":12552,"spinlock_wait_cycles":24155776,"thread_start_us":88635,"threads_started":1,"wal-append.queue_time_us":207196}
I20260709 13:11:13.700157 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 887) took 1081 ms. Trace:
I20260709 13:11:13.631691 30926 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.700702 26548 leader_election.cc:400] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9.
I20260709 13:11:13.701267 26548 leader_election.cc:403] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:11:13.701912 30884 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:13.702421 30685 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.705011 26622 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.705902 30945 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.700464 26659 rpcz_store.cc:276] 0709 13:11:12.619136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.699333 (+1080197us) service_pool.cc:224] Handling call
0709 13:11:13.699652 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.699833 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.699862 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:13.699905 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:13.699940 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.700000 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.700103 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:13.675098 30938 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:13.721998 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2215) took 1256 ms. Trace:
I20260709 13:11:13.728638 26548 leader_election.cc:400] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12.
I20260709 13:11:13.728647 26654 rpcz_store.cc:276] 0709 13:11:12.495607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.201854 (+706247us) service_pool.cc:224] Handling call
0709 13:11:13.202183 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.470490 (+268307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.470550 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.471097 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.586010 (+114913us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:13.586070 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.586168 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.721624 (+135456us) raft_consensus.cc:1685] finished
0709 13:11:13.721663 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.721901 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267897,"raft.queue_time_us":268200,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"thread_start_us":114485,"threads_started":1,"wal-append.queue_time_us":175338}
I20260709 13:11:13.731256 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:13.729514 26548 leader_election.cc:403] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:11:13.740998 26654 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:13.743726 26548 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:13.744968 30902 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.745153 30920 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.751318 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:13.751917 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.751998 26509 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:13.752952 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.752983 30902 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12.
I20260709 13:11:13.754129 26548 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:13.755661 30902 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:13.754961 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:13.755399 26548 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:13.759712 26509 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:13.761283 26506 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.763800 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:13.764835 26508 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:13.766044 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:13.770882 26502 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:13.779899 30902 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:13.785277 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:13.786563 26659 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.800086 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:13.802901 26548 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:13.801250 26506 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:13.808565 30902 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:13.809317 30869 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:13.729732 30884 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:13.810062 30884 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:13.810020 30869 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.810616 30884 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.811499 30940 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.812302 30869 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.813730 30908 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:13.814206 30987 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:11:13.816375 30928 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:13.816926 30928 raft_consensus.cc:697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:13.817327 30712 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.817824 30928 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.821859 26658 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:13.822270 30825 raft_consensus.cc:3055] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:13.822808 30825 raft_consensus.cc:740] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:13.823745 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2210) took 1362 ms. Trace:
I20260709 13:11:13.824172 26658 rpcz_store.cc:276] 0709 13:11:12.462166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.952019 (+489853us) service_pool.cc:224] Handling call
0709 13:11:13.821688 (+869669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.822709 (+  1021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.823553 (+   844us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54001d51d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:13.823686 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1999184256}
W20260709 13:11:13.815510 30998 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:13.825456 26548 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:13.827020 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.830224 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:13.821775 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 2042) took 1518 ms. Trace:
I20260709 13:11:13.828083 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:13.821916 30677 tablet_bootstrap.cc:700] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent opening tablet: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:11:13.826129 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2214) took 1361 ms. Trace:
I20260709 13:11:13.831974 26652 rpcz_store.cc:276] 0709 13:11:12.303586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.315640 (+ 12054us) service_pool.cc:224] Handling call
0709 13:11:13.821550 (+1505910us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54001d51d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:13.821712 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877942144}
I20260709 13:11:13.835999 26583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ecc61d0190444bea318620b6a278926"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:11:13.836848 26583 raft_consensus.cc:606] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:13.837853 26583 raft_consensus.cc:614] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:13.839488 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:13.834136 26657 rpcz_store.cc:276] 0709 13:11:12.464906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.073000 (+608094us) service_pool.cc:224] Handling call
0709 13:11:13.073280 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.465762 (+392482us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:13.534970 (+ 69208us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b180010b2e0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f8829839455 00007f88303213c7 00007f882c9339a7 00007f882c9430bf 00007f882c943038
0709 13:11:13.670065 (+135095us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.740438 (+ 70373us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.790381 (+ 49943us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.790577 (+   196us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.791051 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.791179 (+   128us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:13.791220 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.807929 (+ 16709us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.825912 (+ 17983us) raft_consensus.cc:1685] finished
0709 13:11:13.825937 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.826076 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":427897,"prepare.queue_time_us":15348,"raft.queue_time_us":444461,"raft.run_cpu_time_us":470,"raft.run_wall_time_us":92743,"spinlock_wait_cycles":23179904,"thread_start_us":144545,"threads_started":2,"wal-append.queue_time_us":47578}
W20260709 13:11:13.852221 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 133298us
I20260709 13:11:13.789280 30945 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9.
I20260709 13:11:13.844278 26548 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:13.846624 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:13.828840 30912 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:13.844815 26659 raft_consensus.cc:2410] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:11:13.858806 26548 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:13.840518 30902 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:13.909806 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.882769 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.909933 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:13.911330 27274 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:13.840857 30908 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:11:13.921537 27240 leader_election.cc:336] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 2.103s (SENT)
I20260709 13:11:13.922861 27272 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:13.936020 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 77334.2us
I20260709 13:11:13.843802 30865 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:13.939044 27276 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:13.844015 30940 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:13.846854 30817 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:13.877065 30720 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:13.939872 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:13.949714 27277 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.853340 30644 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:13.942904 27269 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:13.952432 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 99302us
I20260709 13:11:13.790510 30944 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:13.934680 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.889755 30687 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.973973 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:13.946815 30907 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:13.948537 30720 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.980221 27272 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:13.980870 30926 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:13.982081 30991 log.cc:927] Time spent T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:11:13.954062 30712 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:13.937371 30919 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.983980 27275 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:13.832587 30825 consensus_queue.cc:260] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:13.984889 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:13.952399 30644 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.000664 26657 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.002033 30644 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:13.868891 30885 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:13.997510 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 62972.3us
I20260709 13:11:14.004706 27240 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:13.988897 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:14.007124 27240 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:14.009938 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:14.010515 27277 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:13.997198 30720 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:14.014701 27274 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:14.011889 30856 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:14.012027 30712 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:13.998174 30865 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:14.018528 27270 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:13.998646 30907 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:14.013042 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:14.023571 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 79917.3us
I20260709 13:11:13.997144 30817 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.003046 30687 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:14.029062 27272 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:14.028167 27277 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:14.028800 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:14.036983 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.038702 26549 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:14.028750 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:14.039913 27269 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:14.032431 26548 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:14.031442 30865 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:14.051661 30947 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
W20260709 13:11:14.095995 30986 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.567s	user 0.004s	sys 0.000s
I20260709 13:11:14.098539 30919 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:14.112320 31004 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:14.112864 31003 consensus_queue.cc:1059] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:14.113590 30907 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:14.060650 30654 consensus_meta.cc:287] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.002s
I20260709 13:11:14.052611 30908 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:14.042868 30817 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:14.129351 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 83818.4us
I20260709 13:11:14.139338 30885 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:14.129220 31004 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:14.140586 31004 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.142665 30902 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:14.139400 30865 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:14.145685 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:14.144430 26548 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:14.136523 30929 consensus_meta.cc:287] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.530s	user 0.003s	sys 0.007s
I20260709 13:11:14.119282 30947 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.157064 30908 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:14.159682 31001 log.cc:927] Time spent T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:11:14.161077 30602 consensus_meta.cc:287] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
I20260709 13:11:14.163760 30817 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:14.132256 30919 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:11:14.165146 30902 raft_consensus.cc:3055] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:14.150556 30920 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:14.129648 30654 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.167722 30654 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:14.168398 26651 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:14.171479 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:14.157614 31003 raft_consensus.cc:3055] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:14.172899 31003 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:14.151997 30720 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.173758 31003 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.165596 30902 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:14.146822 31006 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:14.177695 31006 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:14.178206 31006 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:14.177062 31003 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.178257 30902 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.186245 30902 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:14.194182 30931 consensus_meta.cc:287] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.000s
I20260709 13:11:14.194667 30931 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.195187 30947 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:14.195896 26658 raft_consensus.cc:1240] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:14.196691 30931 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:14.196770 30884 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.176865 30720 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:14.183763 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2906) took 1110 ms. Trace:
I20260709 13:11:14.200460 26579 rpcz_store.cc:276] 0709 13:11:13.073460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.076571 (+  3111us) service_pool.cc:224] Handling call
0709 13:11:13.076871 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.463937 (+387066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.183471 (+719534us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54001c34d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:14.183681 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820318080}
W20260709 13:11:14.201350 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 56998.2us
I20260709 13:11:14.202198 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:14.158222 30929 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:14.213544 27271 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:14.213851 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:14.219635 26510 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:14.212401 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:14.220937 26507 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:14.223001 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 184418us
I20260709 13:11:14.223863 26549 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:14.208508 30912 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:14.228390 30912 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:14.207944 30884 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:14.231345 26510 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:14.231770 26657 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:14.232437 26549 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:14.232960 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:14.233731 26657 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:14.235558 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.236310 26579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:11:14.237008 26579 raft_consensus.cc:606] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:14.237464 26579 raft_consensus.cc:614] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:14.209365 30602 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:14.199153 30644 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:14.245283 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.238283 31005 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:14.247141 31013 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.251000 30644 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:14.251379 30602 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:14.252979 30932 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:14.236903 30599 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:14.256736 26657 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
W20260709 13:11:14.257205 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 345918us
I20260709 13:11:14.263532 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:14.264878 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:14.265444 26508 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:14.266393 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:14.268345 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:14.268916 26502 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:14.260517 26507 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:14.268822 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:14.265762 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:14.270720 26473 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:14.261538 30960 consensus_queue.cc:1059] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:11:14.273474 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:14.259227 31005 raft_consensus.cc:697] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:14.274513 30944 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:14.261904 30599 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:14.301102 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:14.277953 31010 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:14.309940 26579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:11:14.274752 30867 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:14.308616 26502 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:14.318492 26657 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:14.260668 31013 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.324258 26473 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:14.312915 30599 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:14.327023 27272 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:14.278188 30876 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:11:14.275190 31012 consensus_queue.cc:1059] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:11:14.333027 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:14.334437 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.331843 26473 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:14.335188 26655 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:14.336279 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.328872 30960 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:11:14.338155 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:14.340523 26655 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:14.342439 26655 raft_consensus.cc:1240] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:14.343756 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 973) took 1208 ms. Trace:
I20260709 13:11:14.344146 27278 rpcz_store.cc:276] 0709 13:11:13.135233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.135504 (+   271us) service_pool.cc:224] Handling call
0709 13:11:14.343597 (+1208093us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54003fe8d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:14.343704 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030382976}
I20260709 13:11:14.344322 26655 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:14.345175 26657 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:14.345732 31005 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.346370 26655 raft_consensus.cc:1217] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[6.4-10.6]   Dedup: 8.5->[10.6-10.6]
I20260709 13:11:14.346901 26655 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [6.4-10.6]
I20260709 13:11:14.354782 31013 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:14.364018 30872 raft_consensus.cc:3055] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:14.364609 30872 raft_consensus.cc:740] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:14.365365 30956 raft_consensus.cc:3055] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:14.365963 30956 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:14.367080 30956 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.11, Last appended by leader: 11, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.369192 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2401) took 1933 ms. Trace:
I20260709 13:11:14.369844 26501 rpcz_store.cc:276] 0709 13:11:12.436228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.912851 (+476623us) service_pool.cc:224] Handling call
0709 13:11:12.913209 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.922792 (+  9583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.922837 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.924515 (+  1678us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.260183 (+335668us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:13.260239 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.260332 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.367740 (+1107408us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b2400148d18. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f88296c29c4 00007f88296c0acb 00007f882987bdc9 00007f882987ba55 00007f882987afb0 00007f882c4f1488 00007f882c4f1be8 00007f882c4c9398 00007f882c4c476a 00007f882c4c3bb6
0709 13:11:14.368806 (+  1066us) raft_consensus.cc:1685] finished
0709 13:11:14.368834 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.369115 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":26489216,"thread_start_us":198690,"threads_started":1,"wal-append.queue_time_us":428034}
I20260709 13:11:14.328316 30602 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.374953 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.375569 26655 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:14.376451 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.377749 26578 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:14.379696 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.380378 26657 raft_consensus.cc:2393] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:14.380939 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 885) took 1839 ms. Trace:
I20260709 13:11:14.382313 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:14.382591 26474 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:14.381291 26650 rpcz_store.cc:276] 0709 13:11:12.541932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.378699 (+836767us) service_pool.cc:224] Handling call
0709 13:11:13.379018 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.379205 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:13.404030 (+ 24825us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.572602 (+168572us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b180045dc60. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c923a 00007f882c933a2a
0709 13:11:14.380605 (+808003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.380663 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:14.380710 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.380780 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.380891 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":535296,"prepare.queue_time_us":24476,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":3085,"spinlock_wait_cycles":12877568,"thread_start_us":272347,"threads_started":1,"wal-append.queue_time_us":440485}
W20260709 13:11:14.381466 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.385586 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.386592 26582 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:14.387668 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.388464 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.379117 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.331383 30867 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:14.394845 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.395977 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.397743 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.353050 30912 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.403759 31026 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:14.397177 30872 consensus_queue.cc:260] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.410323 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.410869 30872 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.412017 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.413583 30926 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:11:14.413657 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 424900us
I20260709 13:11:14.414510 30926 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.414784 27241 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:14.419939 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.420755 26657 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:14.422564 26655 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:14.425199 26650 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:14.425721 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.427259 27241 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:14.380374 31006 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.430609 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.431409 26650 raft_consensus.cc:2410] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:14.432345 26655 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:14.407121 30956 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:14.434463 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.435038 26657 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:14.438720 27241 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:14.441071 31012 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:14.432524 26650 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:14.445248 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:14.442412 31012 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:14.416152 30867 raft_consensus.cc:697] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:11:14.445698 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 184384us
I20260709 13:11:14.424100 30878 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:14.449326 26579 raft_consensus.cc:606] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:14.452983 26579 raft_consensus.cc:614] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:14.460585 26508 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:14.430112 31019 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.415058 30926 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.444128 30932 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:14.476895 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:14.473296 26549 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:14.481873 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 150084us
I20260709 13:11:14.470818 31019 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.449132 30884 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:11:14.472561 30653 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:11:14.540585 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 67407.9us
I20260709 13:11:14.474001 30917 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:14.465482 30719 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:11:14.473219 31023 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:14.570783 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.475175 30947 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:11:14.536283 31029 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.479296 30932 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.475807 31012 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:11:14.559391 30917 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:14.611655 31029 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.611023 31006 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:14.589483 30885 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.591663 31020 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:14.625447 30878 raft_consensus.cc:697] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:14.558988 31030 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:11:14.622608 30917 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.623883 30940 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:14.628726 30876 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:11:14.720878 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 9b26ae30d0734e338bc81b8d9f963b67: Illegal state: Replica af1b5d6d444447b7a580afb4aff33320 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:14.630400 30885 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.654515 30884 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:14.778525 30884 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:14.778760 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.780157 26650 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:14.778669 30885 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:14.781854 30885 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.782298 30878 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.782891 30885 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.785446 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:14.786355 26581 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:14.786623 26576 raft_consensus.cc:2368] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8.
I20260709 13:11:14.785439 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.788707 26583 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:11:14.734498 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 351843us
I20260709 13:11:14.740203 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2051) took 1272 ms. Trace:
I20260709 13:11:14.790230 26654 rpcz_store.cc:276] 0709 13:11:13.467355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.014978 (+547623us) service_pool.cc:224] Handling call
0709 13:11:14.015301 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.413494 (+398193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.413523 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.429905 (+ 16382us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.547457 (+117552us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:14.547515 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.548517 (+  1002us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.739257 (+190740us) raft_consensus.cc:1685] finished
0709 13:11:14.739451 (+   194us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.739825 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":397826,"raft.queue_time_us":398714,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":80,"thread_start_us":79709,"threads_started":1,"wal-append.queue_time_us":140538}
W20260709 13:11:14.740425 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 194604us
W20260709 13:11:14.744308 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.754544 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 890) took 1647 ms. Trace:
I20260709 13:11:14.590207 30867 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.791905 26583 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:14.799010 26625 leader_election.cc:400] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8.
I20260709 13:11:14.799568 26625 leader_election.cc:403] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:14.746789 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 269879us
I20260709 13:11:14.795166 26652 rpcz_store.cc:276] 0709 13:11:13.107331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.834373 (+727042us) service_pool.cc:224] Handling call
0709 13:11:13.834721 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.379588 (+544867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.379617 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.380066 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.443677 (+ 63611us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:14.443730 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.443808 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.753744 (+309936us) raft_consensus.cc:1685] finished
0709 13:11:14.753790 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.754319 (+   529us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":564554,"raft.queue_time_us":546603,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":12548,"thread_start_us":63215,"threads_started":1,"wal-append.queue_time_us":160538}
I20260709 13:11:14.804963 27241 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:14.808672 30673 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.810015 30602 consensus_queue.cc:1059] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:14.810199 30673 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.794440 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:14.813222 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:14.814072 26581 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:14.814569 30869 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:14.815623 30719 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.818436 27277 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:14.668751 30926 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:14.652796 30931 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:11:14.667407 30932 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:14.665225 31019 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:14.882642 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.570201 31023 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.883558 30908 raft_consensus.cc:3055] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:14.884256 30908 raft_consensus.cc:740] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:14.873853 30861 consensus_queue.cc:1059] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:11:14.886691 31023 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:14.667645 31026 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:14.664076 31029 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:14.670258 31031 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:14.896912 31031 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:14.780611 30884 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.898361 30884 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:14.898649 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2402) took 1939 ms. Trace:
I20260709 13:11:14.898950 26585 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:11:14.899537 26585 pending_rounds.cc:85] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 8
I20260709 13:11:14.899991 26585 pending_rounds.cc:107] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:11:14.900290 26585 raft_consensus.cc:2889] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:14.818434 26580 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:14.903061 26548 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:14.821146 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:14.905112 27270 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:14.823125 30673 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:14.832118 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:14.908310 27277 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:14.845105 30940 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:14.848100 31030 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:14.910163 31030 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.910595 31030 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:14.645255 30912 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:14.857553 30885 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:14.881248 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:14.881796 26583 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:14.887084 31041 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:11:14.905432 31003 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:11:14.914506 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 46620.9us
I20260709 13:11:14.899072 26505 rpcz_store.cc:276] 0709 13:11:12.958765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.087765 (+129000us) service_pool.cc:224] Handling call
0709 13:11:13.088169 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:13.258932 (+170763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.897889 (+1638957us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540008cd54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:14.898393 (+   504us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377493376}
I20260709 13:11:14.917121 30932 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:14.910615 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2218) took 2131 ms. Trace:
I20260709 13:11:14.918020 30932 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.918459 26658 rpcz_store.cc:276] 0709 13:11:12.779333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.825146 (+1045813us) service_pool.cc:224] Handling call
0709 13:11:13.825448 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.196470 (+371022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.910189 (+713719us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54001f6154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:14.910460 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851242368}
I20260709 13:11:14.920840 30932 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:14.921911 30944 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:14.885882 30908 consensus_queue.cc:260] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:14.931135 26578 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
W20260709 13:11:14.934911 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.946600 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 71098.8us
I20260709 13:11:14.948426 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:14.949308 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.949698 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:14.950515 26583 raft_consensus.cc:2410] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:14.950420 27278 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:14.949327 26579 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:14.952340 30908 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:14.950273 26548 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:14.957298 26625 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:14.965240 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:14.939442 31003 raft_consensus.cc:697] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:14.967532 27278 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:14.971102 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2217) took 2291 ms. Trace:
W20260709 13:11:14.967106 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 372908us
I20260709 13:11:14.975903 30856 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.976214 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:14.977509 26653 raft_consensus.cc:2410] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:14.977949 31037 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:14.976765 30856 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:14.971524 26651 rpcz_store.cc:276] 0709 13:11:12.618327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.581622 (+963295us) service_pool.cc:224] Handling call
0709 13:11:13.583088 (+  1466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.168805 (+585717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.909137 (+740332us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400120a54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:14.909470 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345590144}
I20260709 13:11:14.967710 30932 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:15.009507 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:11:15.012562 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.012774 26652 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:11:15.017076 30956 consensus_meta.cc:287] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.571s	user 0.017s	sys 0.002s
W20260709 13:11:14.911542 31040 consensus_queue.cc:1175] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ef2886777a8f45e69e213b02a22ecec7" responder_term: 14 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: [13.8-13.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:15.020314 30960 raft_consensus.cc:3055] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:15.020879 30960 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:15.022436 27270 raft_consensus.cc:2393] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:15.026897 30960 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.028999 30960 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.028519 31031 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.030006 31031 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:15.034834 31015 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.722s	user 0.000s	sys 0.001s
I20260709 13:11:15.034744 30912 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.032708 30999 log.cc:927] Time spent T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.035s	user 0.002s	sys 0.000s
I20260709 13:11:15.037379 30677 tablet_bootstrap.cc:492] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:11:15.042357 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:15.042948 27277 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:15.010046 30932 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:15.040509 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 586) took 1789 ms. Trace:
I20260709 13:11:15.045759 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:15.046633 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.042380 30885 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.046504 30932 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:15.063341 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:15.072585 30856 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.022579 31003 consensus_queue.cc:237] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.080948 26505 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:15.090174 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 80946.3us
I20260709 13:11:15.090734 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:15.091264 27277 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:15.065475 30957 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:15.086876 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:15.094790 27270 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:15.101317 30976 raft_consensus.cc:2764] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:15.045305 26504 rpcz_store.cc:276] 0709 13:11:13.141864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.357501 (+215637us) service_pool.cc:224] Handling call
0709 13:11:13.357815 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.358024 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:13.376579 (+ 18555us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.521642 (+1145063us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b18003c29e0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882c4d14bc 00007f882981f48b 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c923a
0709 13:11:14.862420 (+340778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.877966 (+ 15546us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:14.893040 (+ 15074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.916125 (+ 23085us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.931156 (+ 15031us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16175,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":105868,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4654,"spinlock_wait_cycles":2561792,"thread_start_us":336140,"threads_started":2,"wal-append.queue_time_us":141795,"wal-append.run_cpu_time_us":1520,"wal-append.run_wall_time_us":1085994}
I20260709 13:11:15.104609 31017 raft_consensus.cc:3055] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:15.104816 26582 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.702s	user 0.014s	sys 0.007s
I20260709 13:11:15.105207 31017 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:15.105453 26582 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:15.103777 31019 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.101435 26579 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:15.106786 31019 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.106676 31017 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.107982 31017 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:15.108042 30872 consensus_meta.cc:287] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.627s	user 0.012s	sys 0.017s
I20260709 13:11:15.108681 26625 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:15.108942 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:15.109766 27276 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:11:15.109892 30940 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.110611 30940 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.113027 30940 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:15.108003 30677 tablet_bootstrap.cc:492] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
W20260709 13:11:15.104894 31049 log.cc:927] Time spent T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
I20260709 13:11:15.114575 30902 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:15.117293 30677 ts_tablet_manager.cc:1403] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 1.978s	user 0.058s	sys 0.021s
I20260709 13:11:15.117688 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:15.118582 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:15.113548 30599 consensus_meta.cc:287] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.780s	user 0.001s	sys 0.019s
I20260709 13:11:15.134788 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.087329 30912 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.123780 30902 raft_consensus.cc:697] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:15.142308 26585 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:15.143549 31043 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:15.144467 31043 consensus_queue.cc:1243] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:11:15.146031 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.147492 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:15.148366 26656 raft_consensus.cc:2410] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:15.148228 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.149163 31053 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:11:15.150228 31053 consensus_queue.cc:1243] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer b1f40e8672c549d3b4be7862ac07b7e2 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:15.127383 27240 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:15.135221 30940 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:15.161171 26579 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:15.166021 30940 raft_consensus.cc:697] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:15.167251 30940 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.168768 26579 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:15.160600 30912 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:15.136770 30957 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.173512 30976 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:15.173883 30957 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:15.174283 30976 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:15.174841 30917 consensus_meta.cc:287] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.003s
I20260709 13:11:15.175387 30917 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.180171 30917 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.181043 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:15.181191 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:15.184928 26502 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:15.188776 30653 raft_consensus.cc:3055] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:15.160616 31048 log.cc:927] Time spent T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:11:15.177634 30932 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:15.189764 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 145322us
I20260709 13:11:15.191604 26622 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:15.192643 26659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 894) took 1489 ms (client timeout 1672 ms). Trace:
I20260709 13:11:15.191704 30932 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:15.129400 30885 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.152629 26474 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:15.201102 26655 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:15.195267 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.197582 26582 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:15.193328 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:15.198047 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.189277 30653 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:15.206220 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:15.193112 26659 rpcz_store.cc:269] 0709 13:11:13.703335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.730949 (+ 27614us) service_pool.cc:224] Handling call
0709 13:11:15.192203 (+1461254us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b5400140854. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:15.192410 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125550848}
W20260709 13:11:15.234051 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.228859 26583 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:15.234182 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:15.237888 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.193620 30932 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:11:15.202715 31054 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:11:15.163208 30825 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.198809 31019 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:15.256273 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:15.256656 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:15.256939 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:15.258198 26473 leader_election.cc:336] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Timed out: RequestConsensusVote RPC to 127.24.204.196:45899 timed out after 2.204s (SENT)
I20260709 13:11:15.265333 26473 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:15.266148 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 115134us
I20260709 13:11:15.234860 30976 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.198493 30719 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8.
I20260709 13:11:15.135793 30599 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.260851 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.261183 30817 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:15.256294 26577 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:15.262074 26653 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.262234 26658 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:15.277760 30865 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.260854 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:15.282473 30939 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:11:15.282934 26507 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:15.270179 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:15.242254 31043 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:11:15.272507 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet e29f1967e75645cbb7842e14e0404518: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:15.274289 30944 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:15.274444 30912 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:15.272588 26504 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:15.277307 26503 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:15.283018 26580 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:15.207185 30864 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.282644 30865 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.296947 26582 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
W20260709 13:11:15.303059 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.297124 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:15.307415 26659 raft_consensus.cc:2410] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:11:15.199633 30902 consensus_queue.cc:237] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.311825 30872 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:15.314636 26576 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:15.288012 30944 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.304554 30939 consensus_queue.cc:1243] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:15.323064 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:15.325618 26505 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:15.297411 31053 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:11:15.328764 30944 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:15.329916 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 79198.9us
I20260709 13:11:15.331657 26657 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.333998 26658 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:11:15.334445 26658 pending_rounds.cc:85] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 7
I20260709 13:11:15.334738 26658 pending_rounds.cc:107] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:11:15.335022 26658 raft_consensus.cc:2889] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.336309 30865 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.313815 30917 consensus_queue.cc:1059] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:11:15.342253 30677 raft_consensus.cc:359] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.343582 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:15.346019 31026 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:15.348096 26650 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:15.349500 26650 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:15.350482 30885 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:15.352108 26650 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:15.353814 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:15.354684 26659 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:15.355826 26659 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:15.355487 30600 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:15.357290 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:15.357988 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:15.358691 26504 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:15.359565 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:15.360356 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.360769 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:15.361227 26583 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:15.361999 30945 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:15.362540 30945 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.362948 30945 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.365916 26508 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 12. Ops: [10.10-10.10]
I20260709 13:11:15.366400 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:15.367214 26507 raft_consensus.cc:2368] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8.
I20260709 13:11:15.367056 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:15.368121 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:15.368388 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:15.343616 30677 raft_consensus.cc:740] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: NON_PARTICIPANT
I20260709 13:11:15.370024 30677 consensus_queue.cc:260] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.370721 26510 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:15.372629 30677 ts_tablet_manager.cc:1434] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.255s	user 0.010s	sys 0.000s
I20260709 13:11:15.372884 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:15.373148 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.286065 31043 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:15.385305 26658 raft_consensus.cc:1240] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:15.406891 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.376564 26580 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:15.369293 26508 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:15.407598 26653 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:15.423918 26657 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
W20260709 13:11:15.426065 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 67637.8us
W20260709 13:11:15.402892 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 209658us
I20260709 13:11:15.427057 26625 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:15.428359 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:15.406378 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:15.377179 26654 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
W20260709 13:11:15.421798 27241 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.672s (SENT) [suppressed 54 similar messages]
I20260709 13:11:15.324822 30929 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:11:15.442250 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 460253us
I20260709 13:11:15.449580 26509 raft_consensus.cc:2410] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:11:15.431634 26654 pending_rounds.cc:85] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 8
I20260709 13:11:15.450421 26654 pending_rounds.cc:107] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:11:15.450713 26654 raft_consensus.cc:2889] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.451030 26625 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:15.377354 30976 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:15.431306 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:15.459208 26508 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:15.449467 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:15.463609 26625 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:15.406046 30917 raft_consensus.cc:3055] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:15.465790 26507 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:15.466390 30654 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:11:15.468585 27240 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:15.469878 30908 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.469801 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.470893 30901 consensus_queue.cc:1059] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:15.471735 30920 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:11:15.473184 31047 log.cc:927] Time spent T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:11:15.473881 26579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:11:15.474200 26657 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:15.475577 30599 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.477330 31053 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:15.449473 30929 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:11:15.490384 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.490805 31037 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:15.325994 30864 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.491592 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:15.492130 30644 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.518323 30644 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.520978 30644 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:15.492681 30919 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.484980 30917 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:15.521747 30919 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.522612 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:15.522599 30917 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.523842 30917 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.498667 26582 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:15.530552 30876 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.404910 31030 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.531147 30876 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.532955 31030 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.502759 26580 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:15.534421 26579 raft_consensus.cc:606] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:15.534883 26579 raft_consensus.cc:614] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:15.535012 30864 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:15.535898 31060 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:15.536551 31060 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:15.537626 31060 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:15.541245 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.509690 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:15.506745 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 78457.1us
I20260709 13:11:15.533269 30876 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.510497 31053 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.515507 30929 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.524019 30919 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:15.526717 30654 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.559471 26474 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:15.562717 31026 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:15.547358 31053 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.526116 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:15.496210 26656 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:15.529778 31037 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.572063 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:15.573158 31037 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.543442 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:15.512084 26650 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:15.503829 31040 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:11:15.566905 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.474231 31043 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.570596 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:15.580674 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 158890us
I20260709 13:11:15.569059 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.581229 26576 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.573711 31026 raft_consensus.cc:697] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:15.574023 30654 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:15.576032 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 107623us
I20260709 13:11:15.576422 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:15.584751 26651 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:15.576272 30653 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.455727 30885 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:15.560269 30876 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.586750 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.581715 26577 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:15.524525 30865 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:15.569857 30929 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:15.563303 30872 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:11:15.604223 30926 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:15.566264 30908 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.606220 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:15.563544 31017 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:11:15.566622 30960 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:11:15.583570 30944 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.588404 30885 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:15.616680 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 82909.6us
I20260709 13:11:15.612998 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:15.600157 30901 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.614279 27243 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:15.619091 30653 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:15.620944 26653 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:11:15.623270 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:15.588397 31040 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:15.624459 30867 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:15.624253 31026 consensus_queue.cc:237] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.607318 30926 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.581619 30956 consensus_queue.cc:1059] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:11:15.627537 26506 raft_consensus.cc:1240] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 12. Ops: []
I20260709 13:11:15.614967 31043 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.624293 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:15.644105 26508 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:15.622604 30864 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.621647 30885 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:15.643945 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:15.673218 26576 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:15.617846 31037 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:11:15.648042 26658 raft_consensus.cc:1240] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:15.621934 30945 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.654345 27270 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:15.654947 30864 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.632583 30939 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:15.632570 30926 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:15.632829 30901 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:15.662784 31059 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
I20260709 13:11:15.664510 27274 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:15.609189 30876 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.665385 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:15.710479 27272 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:15.710582 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:15.711417 30876 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:15.711864 26655 raft_consensus.cc:2410] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:15.714073 30920 consensus_queue.cc:1059] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:15.714428 30908 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.715055 30908 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:15.715502 30644 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:15.716081 31003 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:15.716508 31003 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:15.717146 30901 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:15.717584 30644 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:15.717886 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.718608 26578 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 14: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:15.666843 27277 raft_consensus.cc:1217] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-9.9]   Dedup: 7.8->[9.9-9.9]
I20260709 13:11:15.719908 27277 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: [6.7-9.9]
I20260709 13:11:15.666568 30654 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:15.723127 27241 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:15.724216 31017 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:15.724656 31017 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.725050 31017 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.630614 26650 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:15.630045 30865 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:15.730453 30865 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.730847 30865 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:15.736172 26653 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:15.738152 30719 raft_consensus.cc:3055] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:15.738740 30719 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:15.739872 30719 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.741765 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:15.742177 30924 raft_consensus.cc:3055] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:15.677233 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:15.676887 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:15.677014 30919 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:11:15.683755 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 60051.5us
I20260709 13:11:15.686900 26651 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:11:15.698519 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.716034 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:15.750852 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.742726 30924 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:15.700098 30945 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:15.741394 30719 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.754849 26653 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:15.678761 30939 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.832858 30939 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.680624 27243 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:15.701542 30947 raft_consensus.cc:3055] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:15.706311 30934 raft_consensus.cc:3055] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:15.706888 30944 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.707738 30864 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.717412 31003 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.742329 26658 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.633780 30940 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:15.668285 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 48071.7us
W20260709 13:11:15.747308 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 73666.6us
W20260709 13:11:15.788225 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.851147 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.751338 31030 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:15.800565 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:15.801798 30924 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.754462 31017 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.802995 31040 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.805706 31053 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.716634 30908 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:11:15.828274 26657 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 13:11:15.829903 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 152725us
I20260709 13:11:15.862284 26657 pending_rounds.cc:85] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 7
I20260709 13:11:15.830624 30918 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:15.753197 30654 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:15.836627 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 157159us
I20260709 13:11:15.855531 30940 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.830749 30885 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:15.837014 31028 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.693s	user 0.005s	sys 0.000s
I20260709 13:11:15.849434 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:15.874290 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:15.837507 30947 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:15.840490 30934 raft_consensus.cc:740] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:15.835834 26585 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:15.829280 30865 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.868387 30918 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.876137 30629 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:11:15.876194 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:15.879210 30940 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.880378 26659 raft_consensus.cc:2410] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:11:15.862684 26657 pending_rounds.cc:107] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:11:15.900184 26657 raft_consensus.cc:2889] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.901695 31039 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.896649 30918 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:15.902454 31039 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.904781 31039 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:15.905967 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 105541us
I20260709 13:11:15.898350 30908 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:15.910727 30908 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:15.889523 30599 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.911644 30599 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.913800 26654 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:11:15.914095 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:15.915019 30929 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:15.915176 30885 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:15.880584 30944 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:15.902040 30934 consensus_queue.cc:260] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.915594 26622 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:15.894412 30924 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:15.916034 30947 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:15.924502 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.925010 31017 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:15.867276 30864 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.930882 30600 consensus_queue.cc:1059] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:15.934357 30908 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:15.935266 30919 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:15.937304 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:15.901702 30685 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:15.950712 31053 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:15.955849 26502 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.889937 27240 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:15.957312 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:15.954205 26658 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:15.952296 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:15.961898 30685 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:15.963760 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:15.964363 30685 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:15.968539 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 100980us
I20260709 13:11:15.969666 31031 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:15.970513 31031 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:15.971760 31031 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.972838 31019 consensus_queue.cc:1059] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:15.979805 30901 consensus_queue.cc:1059] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:15.980185 31019 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:15.982339 31019 raft_consensus.cc:3055] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:15.982760 31019 raft_consensus.cc:740] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:15.986928 26502 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:15.861650 30926 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:15.989531 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:15.994160 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 278609us
W20260709 13:11:16.008731 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.985706 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:16.017482 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 102019us
W20260709 13:11:16.012897 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 74467us
I20260709 13:11:15.980945 30901 raft_consensus.cc:3055] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:16.016335 26506 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:15.974399 30719 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.009531 26501 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:15.995291 30934 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.005378 30885 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:15.984005 31019 consensus_queue.cc:260] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.024693 30901 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:16.015321 30902 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:16.044803 30960 raft_consensus.cc:3055] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:16.041144 30940 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.046761 30925 raft_consensus.cc:2764] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:15.960445 30864 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:16.048549 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.053049 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:16.025687 30947 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.074203 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:16.076640 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 210156us
W20260709 13:11:16.077719 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 45977us
I20260709 13:11:16.054873 30960 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:16.082090 26476 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:16.036017 30719 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.090533 26549 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:16.090131 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.070438 30902 raft_consensus.cc:697] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:16.093070 27277 raft_consensus.cc:2410] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:11:16.076082 30825 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:16.057632 30600 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:11:16.087934 30920 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:16.061223 30644 consensus_queue.cc:1059] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:11:16.085585 30885 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:16.108274 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:16.130797 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 54513.6us
I20260709 13:11:16.092260 31030 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:16.095381 30654 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.134020 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.097851 31039 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.098582 30825 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:16.140820 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 56298.4us
I20260709 13:11:16.143565 31040 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.143675 30960 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.144289 31040 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.144920 30960 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:16.114349 30901 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.146589 31040 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:16.147537 31039 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.149655 31075 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:16.150413 31075 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:16.150934 30901 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:16.103370 30865 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:16.109434 30920 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.155218 30920 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:16.158357 31071 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:11:16.158551 30719 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:16.161895 30654 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.164870 30654 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:16.166643 30940 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:16.167980 31030 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.173166 30926 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:16.135056 31017 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.174446 31017 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.175261 31039 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:16.177030 31017 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:16.184033 26476 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:16.203329 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:16.188410 30945 raft_consensus.cc:3055] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:16.139647 30825 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.194958 30925 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:16.178879 30864 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:16.177263 30885 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.222698 26476 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:16.224619 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.224831 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.225338 27277 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:16.225737 27270 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:16.185403 31037 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:11:16.226560 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:16.227136 27272 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.227692 31078 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:16.228307 31078 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.230504 31078 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:16.218446 30902 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.222160 31017 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.238756 31017 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.210274 31053 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:16.207610 30917 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:16.248075 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.244761 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:16.247069 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:16.250222 26584 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:16.242247 27272 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:16.250696 26579 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:16.211766 30945 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:16.245958 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.251097 26622 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:16.245151 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:16.244752 30944 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:16.254078 27243 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:16.256121 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:16.260186 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:16.265242 30712 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:16.265435 30940 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:16.265928 30940 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.262923 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:16.266291 30940 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:16.266930 30719 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:16.267469 30719 raft_consensus.cc:697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:16.267925 27277 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:16.268395 30719 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.270077 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.270804 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:16.271013 27272 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:16.271675 26657 raft_consensus.cc:2410] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:16.272038 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:16.272305 31040 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:16.272698 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:16.272992 31040 consensus_queue.cc:1243] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer b1f40e8672c549d3b4be7862ac07b7e2 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:16.273694 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:16.274297 26578 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:11:16.275913 27272 pending_rounds.cc:85] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 5
I20260709 13:11:16.275746 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:16.276414 27270 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:16.277913 27272 pending_rounds.cc:107] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:11:16.278236 27272 raft_consensus.cc:2889] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:16.248255 31053 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.248204 30917 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.286231 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:16.221125 30939 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.293816 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.260983 30926 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:16.294075 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 81711.4us
I20260709 13:11:16.294811 27277 raft_consensus.cc:2410] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:16.296973 27274 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:16.289456 30917 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:16.299372 30945 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.300838 30945 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.289204 31053 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:16.303778 31017 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:16.318210 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.322687 26476 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:16.331506 26651 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:11:16.340039 27277 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:16.345464 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:16.346199 26658 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:16.353871 27270 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:16.365813 30937 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.365871 30918 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.366698 30937 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.368974 30934 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:16.369410 30937 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:16.369745 30934 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.372555 30934 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:16.373271 31026 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:16.373837 31026 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:16.374292 31026 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.306442 30926 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:16.379854 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.381502 26658 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:16.383023 26584 raft_consensus.cc:2468] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:16.393512 26622 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:16.406821 27270 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:11:16.409247 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 266626us
I20260709 13:11:16.410564 26549 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:16.378715 30876 consensus_queue.cc:1059] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 13:11:16.428215 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.385762 30926 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:16.432916 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2231) took 1234 ms. Trace:
I20260709 13:11:16.398290 30960 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.338932 31037 consensus_queue.cc:1059] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:11:16.433456 26656 rpcz_store.cc:276] 0709 13:11:15.198865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.233987 (+ 35122us) service_pool.cc:224] Handling call
0709 13:11:16.432683 (+1198696us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54002da854. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:16.432836 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45882624}
I20260709 13:11:16.410375 30599 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:16.427176 30654 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:16.460346 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.465066 27270 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:16.397408 30825 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.476328 30960 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.441876 30937 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:11:16.490175 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 152283us
I20260709 13:11:16.437577 30944 consensus_queue.cc:1059] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:11:16.493714 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:16.446370 30885 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:16.495182 27278 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:16.492684 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:16.487787 31066 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.591s	user 0.005s	sys 0.000s
I20260709 13:11:16.500494 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.498076 27274 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
W20260709 13:11:16.507495 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.502183 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 111343us
I20260709 13:11:16.509306 27277 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:16.513550 26622 leader_election.cc:400] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 7. Current term is 8.
I20260709 13:11:16.475919 31085 consensus_queue.cc:1059] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:11:16.492174 30876 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.532658 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.484458 30934 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:11:16.484817 30599 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:11:16.537575 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.545303 27270 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:11:16.566879 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 53527.1us
I20260709 13:11:16.546382 27276 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
W20260709 13:11:16.571704 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 134580us
W20260709 13:11:16.575219 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 63716.9us
I20260709 13:11:16.577744 26474 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:16.532215 30944 raft_consensus.cc:3055] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:16.616931 30944 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:16.618067 30944 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.620445 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.621188 27269 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:16.621300 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.621655 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.622087 27273 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:16.622399 27272 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 11: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:16.622166 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.622867 31102 raft_consensus.cc:3055] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:16.623292 31102 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:16.623397 27272 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:16.619475 30944 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:16.624423 31102 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.573339 30876 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.601279 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2437) took 1158 ms. Trace:
I20260709 13:11:16.641960 27278 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:16.641893 26504 rpcz_store.cc:276] 0709 13:11:15.443052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.443219 (+   167us) service_pool.cc:224] Handling call
0709 13:11:15.443589 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.489549 (+ 45960us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:15.492517 (+  2968us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.493129 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.613510 (+120381us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:15.613551 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.615163 (+  1612us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.440139 (+824976us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b2400148c88. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f88296c29c4 00007f88296c0acb 00007f882987bdc9 00007f882987ba55 00007f882987b09d 00007f882c4ad10e 00007f882c4c488c 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221
0709 13:11:16.600836 (+160697us) raft_consensus.cc:1685] finished
0709 13:11:16.600864 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.601193 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23132,"raft.queue_time_us":23409,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":24916352,"thread_start_us":119828,"threads_started":1,"wal-append.queue_time_us":381834}
I20260709 13:11:16.602584 30922 raft_consensus.cc:3055] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:16.609807 30825 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:16.580035 30939 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:16.624579 26622 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:16.532698 31053 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.598189 30960 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:16.594239 31084 log.cc:927] Time spent T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:16.637799 31102 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.637967 30940 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.622277 27277 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:11:16.684955 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.573240 30937 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.588235 30919 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:16.584987 31085 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:11:16.649477 31003 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:16.671995 30920 consensus_meta.cc:287] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.516s	user 0.014s	sys 0.000s
W20260709 13:11:16.608723 30947 consensus_meta.cc:287] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
W20260709 13:11:16.645277 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.623304 27273 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
W20260709 13:11:16.605340 30924 consensus_meta.cc:287] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.001s
I20260709 13:11:16.644351 30600 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:16.676615 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.693922 27276 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
W20260709 13:11:16.679878 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.680857 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99646.2us
W20260709 13:11:16.687417 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 153778us
I20260709 13:11:16.643262 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:16.653658 30922 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:16.692958 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.701253 26650 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:11:16.701639 26650 pending_rounds.cc:85] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 8
W20260709 13:11:16.701826 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.701838 26650 pending_rounds.cc:107] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:11:16.702358 26650 raft_consensus.cc:2889] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:16.698294 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:16.704722 26658 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:16.699316 27243 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:16.703949 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:16.718649 26504 raft_consensus.cc:1275] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:16.693006 27273 pending_rounds.cc:85] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 9
I20260709 13:11:16.721364 27273 pending_rounds.cc:107] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:11:16.721717 27273 raft_consensus.cc:2889] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:16.722132 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:16.722957 26652 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:11:16.690790 31019 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.724637 26651 raft_consensus.cc:2393] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:16.724705 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:16.727351 26656 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:16.727502 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:16.727574 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:16.654628 30917 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.728248 26505 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
W20260709 13:11:16.730835 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.675657 31026 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.733220 26502 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:16.733508 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:16.728353 26508 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:16.727854 26507 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:16.742262 26501 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:16.686915 30919 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:16.735687 26506 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:16.726999 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:16.707309 30885 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.738384 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:16.738965 26585 raft_consensus.cc:1240] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:16.695003 30939 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:16.739566 31097 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:16.739774 30960 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:16.741043 26509 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:16.740887 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:16.739507 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:16.767493 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:16.768117 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:16.768201 26508 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:16.768939 26580 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:16.770337 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:16.771102 26583 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:16.767580 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:16.760299 26504 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:16.740949 31037 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.791648 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 87765.1us
I20260709 13:11:16.792577 26576 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:16.792989 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:16.786886 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 87651.9us
I20260709 13:11:16.786424 26507 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:16.740732 30934 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.782766 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:16.700870 30937 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.789536 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:16.693941 30920 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.741446 31030 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.794731 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:16.719146 31087 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:11:16.797236 26508 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:16.706815 30600 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.796761 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:16.804733 26502 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:16.758842 30599 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:16.767751 30947 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.815145 26585 raft_consensus.cc:2368] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10.
I20260709 13:11:16.860419 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:16.863189 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 285684us
I20260709 13:11:16.865278 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:16.866118 26577 raft_consensus.cc:3060] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:16.800149 31085 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:16.867379 26578 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 14: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:16.873749 26584 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:16.801673 31097 raft_consensus.cc:697] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:16.876192 30919 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:16.879585 31092 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:11:16.879679 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:16.881258 31091 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:11:16.812346 30956 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.811493 30654 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.797397 30960 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.874826 31078 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:16.914150 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:16.899734 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:16.804126 30934 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.858772 30924 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:11:16.913573 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-941b69cce0d24bb9a4f60558447429c4 received from {username='slave'} at 127.0.0.1:55308
I20260709 13:11:16.811619 30902 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:11:16.947644 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-941b69cce0d24bb9a4f60558447429c4 on tablet 941b69cce0d24bb9a4f60558447429c4 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:16.917953 26584 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:16.928278 31053 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:16.876773 31085 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.933907 30956 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:16.954313 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.811363 31030 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.910890 30654 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:16.945552 30876 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:16.862697 30947 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.995692 30947 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:16.995817 30922 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:16.997044 30922 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.913553 31097 consensus_queue.cc:237] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:17.004745 30918 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.039865 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2249) took 1382 ms. Trace:
I20260709 13:11:17.040302 26650 rpcz_store.cc:276] 0709 13:11:15.657915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.729869 (+ 71954us) service_pool.cc:224] Handling call
0709 13:11:15.730173 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.718915 (+988742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.039584 (+320669us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b540039b7d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:17.039798 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218018688}
I20260709 13:11:17.041544 31096 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:17.042521 31096 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:17.043498 31096 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:17.054766 31095 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.282s	user 0.004s	sys 0.000s
I20260709 13:11:17.071355 30919 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:17.092478 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.093976 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:17.094712 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 230629us
I20260709 13:11:17.095960 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:17.094056 27243 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:17.122150 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 544513us
W20260709 13:11:17.123097 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 320880us
I20260709 13:11:17.124449 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:17.126977 26651 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:17.128623 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:17.129308 26504 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:17.130046 26657 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:17.133193 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:17.129776 27243 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:16.778447 30885 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.136439 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:17.135321 26584 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:17.146634 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:16.858582 30599 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:17.105870 30947 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.139788 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:17.139632 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43805.6us
I20260709 13:11:17.152311 26585 raft_consensus.cc:2368] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14.
I20260709 13:11:17.149590 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:17.142290 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.150301 26658 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:11:17.124420 30956 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.192122 26658 pending_rounds.cc:85] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 7
I20260709 13:11:17.193693 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:17.194152 26658 pending_rounds.cc:107] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:11:17.137750 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:17.134450 31096 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:17.139232 31087 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:17.194718 26658 raft_consensus.cc:2889] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:17.126549 30940 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.143232 31076 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:17.191843 26584 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:17.195013 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:17.201472 26652 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:11:17.213770 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 76073.7us
I20260709 13:11:17.194568 26501 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:17.214689 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:17.203356 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:17.091903 31037 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:17.157481 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:17.220371 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:17.224531 26502 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 14: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:17.213814 26651 raft_consensus.cc:2393] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:17.153321 31031 raft_consensus.cc:2804] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:17.202694 27270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.028s	sys 0.032s
I20260709 13:11:17.139369 30920 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:17.155871 31053 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:17.223673 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:17.232677 27270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.028s	sys 0.032s
W20260709 13:11:17.228462 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.248385 26507 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:17.229384 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:17.140571 31078 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.255530 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:17.258189 26506 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:17.259042 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.242928 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:17.260190 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:17.260782 26502 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:17.212754 31087 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.249887 26580 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 14: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:17.241381 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.193344 30644 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:17.249663 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:17.255947 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:17.437233 27278 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:17.199182 31017 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:17.436643 27273 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:17.136657 30901 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:11:17.262001 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:17.295625 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.414170 26584 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:17.143038 30945 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:11:17.139209 31088 consensus_queue.cc:1059] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:11:17.225337 31039 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.229987 30600 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:17.156180 31040 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:17.140426 30902 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:11:17.225548 31116 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.464566 31116 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.465682 30644 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:17.467476 31116 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.246881 30876 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:17.467962 30644 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:17.468407 30876 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:17.389680 31087 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:17.469890 30654 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.210186 30947 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.470546 30654 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:17.471045 30876 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:17.444886 26503 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:17.472597 30947 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.253682 31026 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:17.496116 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:17.451068 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:17.454440 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 205377us
I20260709 13:11:17.263270 31115 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:17.253885 30719 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:17.463522 31040 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:17.415938 30960 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.478906 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:17.264191 30934 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:17.486240 27272 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:17.491015 26625 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:17.493072 26577 consensus_meta.cc:287] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.001s
I20260709 13:11:17.580001 26577 raft_consensus.cc:2468] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:17.580801 26578 raft_consensus.cc:1240] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 13:11:17.495303 27278 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:17.497403 26503 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:17.390296 31101 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:17.583245 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 84197.1us
W20260709 13:11:17.455132 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 306091us
W20260709 13:11:17.584441 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 93527.4us
I20260709 13:11:17.499224 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:17.585412 26625 leader_election.cc:400] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14.
I20260709 13:11:17.585847 26658 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:17.431948 30940 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.503050 26655 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:17.586148 26625 leader_election.cc:403] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:17.511759 26659 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:17.514416 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 311123us
I20260709 13:11:17.499794 26576 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:17.501996 31115 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.245322 31076 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.516624 26507 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:17.391144 31078 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.583153 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:17.437948 31085 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.549001 26502 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:17.590948 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:17.575737 26501 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:17.596675 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:17.498767 30939 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:17.592118 26625 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:17.598981 26622 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:17.500451 31031 raft_consensus.cc:697] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:17.624356 26503 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 14: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:17.625504 26476 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:17.577574 30945 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.583781 30685 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:17.496224 31039 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:17.642241 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 75047.8us
I20260709 13:11:17.655252 26473 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:17.590108 30600 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.641062 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 44605.8us
I20260709 13:11:17.660537 26473 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:17.635447 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:17.661090 26658 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:17.595881 31075 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:17.601766 30947 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:11:17.626091 30926 consensus_meta.cc:287] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 1.191s	user 0.010s	sys 0.008s
W20260709 13:11:17.618052 30944 consensus_meta.cc:287] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.993s	user 0.013s	sys 0.005s
W20260709 13:11:17.679075 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.531858 30719 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.662928 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:17.625798 30654 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:17.617830 31088 raft_consensus.cc:3055] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:17.636076 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:17.601361 31115 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:17.674619 31026 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:17.680152 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 81275.2us
I20260709 13:11:17.598291 30934 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:11:17.685087 26501 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:17.686029 26503 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:17.692826 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:17.663467 30825 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:17.659433 31053 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:17.694806 26502 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:17.630465 30937 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:17.686658 30939 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.693399 26507 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:17.683887 31116 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:17.599740 30940 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.701411 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:17.690747 31026 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.710186 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:17.678825 31085 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:17.737088 31026 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:17.737315 31085 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:17.594244 31101 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:17.737912 31122 log.cc:927] Time spent T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 13:11:17.680529 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 55102.9us
I20260709 13:11:17.684221 30925 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:17.697492 26505 raft_consensus.cc:2410] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:11:17.726218 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:17.740595 26655 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:17.689867 31088 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:17.741967 31088 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.743053 31039 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:17.743494 31088 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:17.744004 31040 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:17.744596 31040 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.739583 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 993) took 1120 ms. Trace:
I20260709 13:11:17.745702 27275 rpcz_store.cc:276] 0709 13:11:16.619312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.623394 (+  4082us) service_pool.cc:224] Handling call
0709 13:11:16.623775 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:16.687101 (+ 63326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.687135 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:16.908628 (+221493us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b2c00012928. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882b222a11 00007f882b232372 00007f882c964a01 00007f882c92943a 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2
0709 13:11:16.909331 (+   703us) log.cc:844] Serialized 52 byte log entry
0709 13:11:17.137462 (+228131us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:17.137522 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.138378 (+   856us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.739133 (+600755us) raft_consensus.cc:1685] finished
0709 13:11:17.739154 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.739388 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28462,"raft.queue_time_us":55128,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":6948,"spinlock_wait_cycles":14592384,"thread_start_us":225698,"threads_started":1,"wal-append.queue_time_us":337809}
I20260709 13:11:17.747025 26476 leader_election.cc:400] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10.
I20260709 13:11:17.747383 26476 leader_election.cc:403] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:11:17.748610 26476 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:17.737942 31085 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:17.751502 30917 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:17.752334 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 91885.1us
I20260709 13:11:17.670121 30945 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:17.706310 30599 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:17.759505 31114 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:11:17.759893 31017 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:17.718928 31053 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.674427 30600 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:17.762799 26655 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:17.763350 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:17.760334 31078 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:17.766845 26473 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:17.782603 26504 consensus_meta.cc:287] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.643s	user 0.005s	sys 0.005s
I20260709 13:11:17.687243 30926 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.762084 30937 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:17.745128 31040 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:17.825168 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 69994.2us
W20260709 13:11:17.830157 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 137031us
I20260709 13:11:17.835410 26504 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:17.836371 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:17.831292 26551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.000s	sys 0.012s
W20260709 13:11:17.837610 26551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.000s	sys 0.012s
W20260709 13:11:17.833796 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 70552.9us
I20260709 13:11:17.838264 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:17.710978 30644 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:11:17.755304 30885 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.840039 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:17.861282 31127 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.861944 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.862196 31127 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.866448 30901 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:17.867213 30901 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.869304 30599 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:17.870096 30599 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.872974 30599 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.875593 30901 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.878721 30937 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:17.880146 30937 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:17.882321 31127 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:17.882992 31127 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.883565 31127 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:17.886373 31127 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:17.749248 30919 consensus_meta.cc:287] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.677s	user 0.005s	sys 0.007s
I20260709 13:11:17.808835 31053 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:17.766333 31017 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:17.838443 30864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.004s	sys 0.016s
I20260709 13:11:17.809185 30939 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.895433 26654 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:11:17.896091 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.898752 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 58773.7us
I20260709 13:11:17.900701 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:17.847971 30908 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.006s	sys 0.005s
I20260709 13:11:17.726824 31119 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 13:11:17.765093 31097 consensus_queue.cc:1059] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
W20260709 13:11:17.912386 26583 consensus_meta.cc:287] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.132s	user 0.011s	sys 0.004s
I20260709 13:11:17.890692 30947 raft_consensus.cc:697] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:17.843420 31103 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10.
I20260709 13:11:17.891144 31098 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:17.915577 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:17.827675 30876 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:11:17.941200 26583 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
W20260709 13:11:17.907775 30864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.004s	sys 0.016s
W20260709 13:11:17.940517 27243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.010s	sys 0.040s
W20260709 13:11:17.978165 27243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.013s	sys 0.050s
I20260709 13:11:17.905555 31037 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.002353 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:18.001865 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36136 (request call id 2109) took 1247 ms. Trace:
W20260709 13:11:18.004849 26506 consensus_meta.cc:287] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
I20260709 13:11:18.005339 26506 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
W20260709 13:11:17.940932 31096 consensus_meta.cc:287] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.003s
I20260709 13:11:18.003741 26583 rpcz_store.cc:276] 0709 13:11:16.741445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.741822 (+   377us) service_pool.cc:224] Handling call
0709 13:11:17.989012 (+1247190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:17.916062 30908 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.006s	sys 0.005s
I20260709 13:11:18.017946 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:17.944248 31116 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:18.018754 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:17.842535 31031 consensus_queue.cc:237] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.000061 30918 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:18.021423 27273 consensus_meta.cc:287] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
I20260709 13:11:18.028133 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:18.030064 27273 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:18.032130 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:17.931392 31132 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.035099 30719 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:18.019055 31037 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.034901 31112 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:18.071578 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.033840 31120 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:11:18.034523 30940 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:18.034267 31135 log.cc:927] Time spent T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:11:18.033185 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:18.006973 30917 consensus_queue.cc:1059] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:11:18.092273 26507 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:11:18.188345 26507 pending_rounds.cc:85] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 6
I20260709 13:11:18.188687 26507 pending_rounds.cc:107] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:11:18.189059 26507 raft_consensus.cc:2889] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.020592 31076 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.198540 26501 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:18.094815 31096 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.172819 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:18.026459 30885 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:18.039516 26502 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:11:18.187650 31019 consensus_meta.cc:287] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.452s	user 0.015s	sys 0.005s
W20260709 13:11:18.193193 31121 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.497s	user 0.001s	sys 0.000s
I20260709 13:11:18.225440 26503 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:18.219056 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 452210us
I20260709 13:11:18.038980 30876 raft_consensus.cc:3055] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:18.235389 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2260) took 1114 ms. Trace:
I20260709 13:11:17.928323 30939 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.237346 26581 raft_consensus.cc:2410] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:18.241526 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:18.324714 26502 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:18.325031 26506 raft_consensus.cc:2368] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14.
I20260709 13:11:18.039361 30918 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.322012 26650 rpcz_store.cc:276] 0709 13:11:17.120986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.123403 (+  2417us) service_pool.cc:224] Handling call
0709 13:11:17.123747 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:17.150412 (+ 26665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.150442 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:17.202210 (+ 51768us) log.cc:844] Serialized 52 byte log entry
0709 13:11:17.830507 (+628297us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:17.830662 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.830925 (+   263us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.235115 (+404190us) raft_consensus.cc:1685] finished
0709 13:11:18.235136 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.235319 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5986,"raft.queue_time_us":13750,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":39781,"thread_start_us":440485,"threads_started":1,"wal-append.queue_time_us":730803}
I20260709 13:11:18.181419 31145 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:18.333688 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:18.334151 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 149281us
I20260709 13:11:18.182307 31154 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:18.328060 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 606) took 1188 ms. Trace:
I20260709 13:11:18.336560 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2088) took 1179 ms. Trace:
I20260709 13:11:18.233331 30940 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:18.192632 31037 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.327144 30876 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:18.333427 30644 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.330034 30944 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:18.352044 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2258) took 1652 ms. Trace:
I20260709 13:11:18.314745 31138 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:18.336552 26508 rpcz_store.cc:276] 0709 13:11:17.139429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.139621 (+   192us) service_pool.cc:224] Handling call
0709 13:11:17.153723 (+ 14102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.201194 (+ 47471us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:17.631734 (+430540us) log.cc:844] Serialized 14 byte log entry
0709 13:11:18.327711 (+695977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:18.327773 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:18.327821 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.327902 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.328010 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44225,"prepare.queue_time_us":525546,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":50,"raft.queue_time_us":101220,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":8657,"thread_start_us":1020874,"threads_started":3}
I20260709 13:11:18.361624 31138 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.357679 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 995) took 1396 ms. Trace:
I20260709 13:11:18.307106 30947 consensus_queue.cc:237] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.335467 31145 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.333652 30920 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.337627 26659 rpcz_store.cc:276] 0709 13:11:17.156829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.599903 (+443074us) service_pool.cc:224] Handling call
0709 13:11:17.639032 (+ 39129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.639305 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:17.846532 (+207227us) log.cc:844] Serialized 14 byte log entry
0709 13:11:18.336148 (+489616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:18.336217 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:18.336282 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.336365 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.336497 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111840,"prepare.queue_time_us":103420,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"thread_start_us":539228,"threads_started":3,"wal-append.queue_time_us":469308}
I20260709 13:11:18.359301 26653 rpcz_store.cc:276] 0709 13:11:16.699813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.700261 (+   448us) service_pool.cc:224] Handling call
0709 13:11:16.700559 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.722937 (+ 22378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.722969 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.774292 (+ 51323us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.124086 (+349794us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:17.124125 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.124188 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.351817 (+1227629us) raft_consensus.cc:1685] finished
0709 13:11:18.351840 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.351982 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8894,"raft.queue_time_us":22090,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":8399,"thread_start_us":308883,"threads_started":1,"wal-append.queue_time_us":398926}
I20260709 13:11:18.187106 31116 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.335884 31019 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.371356 26503 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:17.255505 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:18.373035 30922 consensus_meta.cc:287] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.376s	user 0.013s	sys 0.005s
W20260709 13:11:18.374125 31139 log.cc:927] Time spent T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
W20260709 13:11:18.374825 31155 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:11:18.376246 30901 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:18.376398 30654 consensus_meta.cc:287] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.000s
I20260709 13:11:18.329612 31097 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:11:18.241950 31096 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.364054 27271 rpcz_store.cc:276] 0709 13:11:16.620091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.620311 (+   220us) service_pool.cc:224] Handling call
0709 13:11:16.620677 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:16.643893 (+ 23216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.643945 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:16.688269 (+ 44324us) log.cc:844] Serialized 52 byte log entry
0709 13:11:17.193318 (+505049us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:17.193420 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.193490 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.015887 (+822397us) raft_consensus.cc:1685] finished
0709 13:11:18.015915 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.016110 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24485,"raft.queue_time_us":23426,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":19086,"thread_start_us":372913,"threads_started":1,"wal-append.queue_time_us":562651}
I20260709 13:11:18.348488 30600 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.355197 31143 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.235428 31132 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.419795 31116 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:18.420322 31158 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:18.421279 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.364153 30644 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:18.422639 31133 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:11:18.423466 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 2108) took 1685 ms. Trace:
I20260709 13:11:18.356918 31040 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:18.424193 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2263) took 1297 ms. Trace:
I20260709 13:11:18.486032 26652 rpcz_store.cc:276] 0709 13:11:17.127033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.501835 (+374802us) service_pool.cc:224] Handling call
0709 13:11:17.569537 (+ 67702us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.578002 (+  8465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.578048 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.584241 (+  6193us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.830584 (+246343us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:17.831159 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.831830 (+   671us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.423960 (+592130us) raft_consensus.cc:1685] finished
0709 13:11:18.423992 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.424139 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5907,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":5370,"thread_start_us":161586,"threads_started":1,"wal-append.queue_time_us":299936}
I20260709 13:11:18.432017 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.488809 26650 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:18.489689 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.490314 26650 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:18.432422 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:18.406148 30920 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.498147 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:18.501487 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.440250 30901 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.494560 30922 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:11:18.480934 26402 catalog_manager.cc:5697] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:18.506753 31132 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:18.483139 26579 rpcz_store.cc:276] 0709 13:11:16.741071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.753327 (+ 12256us) service_pool.cc:224] Handling call
0709 13:11:16.786651 (+ 33324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:17.140420 (+353769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.140448 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:17.153225 (+ 12777us) log.cc:844] Serialized 52 byte log entry
0709 13:11:17.641907 (+488682us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:17.641959 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.642055 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.423086 (+781031us) raft_consensus.cc:1685] finished
0709 13:11:18.423117 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.423329 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8878,"raft.queue_time_us":11457,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":49113,"thread_start_us":715969,"threads_started":2,"wal-append.queue_time_us":1181814}
I20260709 13:11:18.508172 30644 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:18.478386 31142 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.510077 31142 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.512887 31142 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:18.478802 30876 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.515094 30876 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:18.515662 31125 consensus_queue.cc:1059] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:18.519048 26505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2834) took 1789 ms (client timeout 1504 ms). Trace:
W20260709 13:11:18.519234 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 923784us
W20260709 13:11:18.519490 26505 rpcz_store.cc:269] 0709 13:11:16.729684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.738111 (+  8427us) service_pool.cc:224] Handling call
0709 13:11:18.518804 (+1780693us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54002fbf54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:18.518950 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2163501312}
W20260709 13:11:18.521744 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 133445us
I20260709 13:11:18.524706 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2465) took 1298 ms. Trace:
I20260709 13:11:18.475791 31116 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:18.459932 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.392926 31145 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:18.355477 30940 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.462693 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.463514 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:18.466112 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:18.430073 31026 consensus_meta.cc:287] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.003s
I20260709 13:11:18.422513 31157 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:18.414398 31098 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.421648 30654 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14.
I20260709 13:11:18.424572 31030 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:18.444409 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.488073 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.491148 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:18.551317 26508 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:18.406855 31019 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.554279 26657 raft_consensus.cc:2393] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:18.539839 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:18.543066 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.525110 26509 rpcz_store.cc:276] 0709 13:11:17.226520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.658384 (+431864us) service_pool.cc:224] Handling call
0709 13:11:17.688129 (+ 29745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.688328 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:17.838717 (+150389us) log.cc:844] Serialized 14 byte log entry
0709 13:11:18.339716 (+500999us) log.cc:844] Serialized 14 byte log entry
0709 13:11:18.524366 (+184650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:18.524423 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:18.524472 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.524537 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.524651 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10364,"prepare.queue_time_us":153933,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":78,"raft.queue_time_us":92012,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":17288,"spinlock_wait_cycles":8974208,"thread_start_us":797897,"threads_started":3,"wal-append.queue_time_us":632483}
I20260709 13:11:18.548992 26503 raft_consensus.cc:2410] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:11:18.524346 31115 consensus_meta.cc:287] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.000s
I20260709 13:11:18.563113 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.564193 26652 raft_consensus.cc:2410] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:11:18.467355 31143 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.548830 26659 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:18.556742 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:18.537242 31109 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:11:18.559274 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.569274 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.568305 27270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 716) took 2001 ms. Trace:
I20260709 13:11:18.358678 31154 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:18.542351 31138 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:18.479743 31158 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:18.613168 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 122929us
I20260709 13:11:18.618741 26657 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
W20260709 13:11:18.606208 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 49539.4us
I20260709 13:11:18.541776 31132 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:11:18.559320 30901 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.545737 31040 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:11:18.616436 27270 rpcz_store.cc:276] 0709 13:11:16.567178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.574783 (+  7605us) service_pool.cc:224] Handling call
0709 13:11:16.584322 (+  9539us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:16.626368 (+ 42046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.638248 (+ 11880us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:16.638981 (+   733us) log.cc:844] Serialized 78 byte log entry
0709 13:11:17.248425 (+609444us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:17.417425 (+169000us) log.cc:844] Serialized 14 byte log entry
0709 13:11:18.515297 (+1097872us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b1800476da0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f882c921060 00007f882c933716 00007f882c944287 00007f882c944208
0709 13:11:18.555026 (+ 39729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.555132 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.555191 (+    59us) raft_consensus.cc:1685] finished
0709 13:11:18.568030 (+ 12839us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.568228 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80918,"prepare.queue_time_us":184607,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":9544,"raft.queue_time_us":1144469,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":157,"spinlock_wait_cycles":14297984,"thread_start_us":647361,"threads_started":2,"wal-append.queue_time_us":930382}
I20260709 13:11:18.629110 26549 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:18.624399 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:18.652171 26549 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:18.646430 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.654299 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.655185 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:18.658995 26653 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
W20260709 13:11:18.660914 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.655133 26659 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:18.610793 31125 consensus_queue.cc:1243] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:18.565062 31116 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.666034 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:18.570366 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2261) took 1446 ms. Trace:
I20260709 13:11:18.667351 26656 rpcz_store.cc:276] 0709 13:11:17.124255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.125110 (+   855us) service_pool.cc:224] Handling call
0709 13:11:17.142851 (+ 17741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.198304 (+ 55453us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:17.198343 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.210015 (+ 11672us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.597144 (+387129us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:17.597313 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.597619 (+   306us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.570106 (+972487us) raft_consensus.cc:1685] finished
0709 13:11:18.570133 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.570297 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8994,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":22229,"thread_start_us":181760,"threads_started":1,"wal-append.queue_time_us":735214}
W20260709 13:11:18.650185 31166 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:11:18.619566 30654 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:18.678704 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:18.611027 30939 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:18.683059 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:18.679632 26505 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:18.651134 31138 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:18.678833 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:18.684667 26508 raft_consensus.cc:2393] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:18.682485 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:18.685750 26509 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:18.573724 31164 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:18.686726 31164 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.687223 31164 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:18.573160 31088 consensus_meta.cc:287] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.829s	user 0.010s	sys 0.003s
I20260709 13:11:18.569191 31115 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.569990 31142 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.692268 27278 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:18.693235 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:11:18.678270 31102 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.983s	user 0.011s	sys 0.027s
I20260709 13:11:18.699141 31146 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:18.701576 26504 raft_consensus.cc:2410] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:11:18.701262 31146 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:18.701887 30925 consensus_meta.cc:287] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.962s	user 0.007s	sys 0.005s
I20260709 13:11:18.702104 31109 consensus_queue.cc:1243] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:18.702345 30925 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:18.703419 31146 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:18.704133 31087 consensus_meta.cc:287] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.234s	user 0.010s	sys 0.002s
W20260709 13:11:18.704752 31141 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:11:18.704618 31087 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.705437 31144 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:18.705643 30712 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:18.705861 31111 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:18.706187 30712 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.706427 31111 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.682085 30947 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:18.708365 30712 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.708228 30947 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.708633 31111 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.708892 30712 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.692724 30654 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:18.697096 31031 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:18.692407 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 169001us
I20260709 13:11:18.554730 31026 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.569131 31157 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.682194 30918 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.672885 30644 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:18.714870 27271 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:18.728806 27271 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:18.710984 27272 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:18.730213 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:18.719977 31096 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.790141 31136 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:18.790343 27271 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.791723 27271 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:18.791622 31134 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:11:18.706043 31144 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.794746 31144 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.795560 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.796993 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.797818 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:18.798611 31125 consensus_queue.cc:1048] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:18.798974 31087 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:18.799158 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:18.712280 31156 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:11:18.800346 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:18.800670 31174 log.cc:927] Time spent T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:11:18.714679 31031 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.802098 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.803225 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.803875 27273 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:18.790937 31136 consensus_queue.cc:1243] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:18.554560 31098 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.801457 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.719549 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 721) took 1501 ms. Trace:
W20260709 13:11:18.827404 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 172276us
I20260709 13:11:18.807196 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:18.718113 30901 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:18.719869 30908 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:18.831517 30901 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:18.831615 30908 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:11:18.829607 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.829466 27270 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:11:18.834504 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.835616 27278 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:18.830381 27276 rpcz_store.cc:276] 0709 13:11:17.218246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.218752 (+   506us) service_pool.cc:224] Handling call
0709 13:11:17.265154 (+ 46402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:18.518786 (+1253632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.518829 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:18.519422 (+   593us) log.cc:844] Serialized 52 byte log entry
0709 13:11:18.578832 (+ 59410us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:18.578892 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.578987 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.719354 (+140367us) raft_consensus.cc:1685] finished
0709 13:11:18.719375 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.719496 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1016232,"raft.queue_time_us":1032899,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"thread_start_us":58924,"threads_started":1,"wal-append.queue_time_us":180011}
I20260709 13:11:18.842244 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.842557 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.710340 30947 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:18.709527 31053 consensus_meta.cc:287] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.794s	user 0.005s	sys 0.002s
I20260709 13:11:18.709363 30712 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.852356 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:18.714035 31172 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:11:18.854120 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 46997.7us
W20260709 13:11:18.852916 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 169909us
I20260709 13:11:18.858539 26549 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:18.704159 31163 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:18.719543 30940 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:18.855902 26584 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:18.733839 31030 raft_consensus.cc:2764] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:11:18.720536 31026 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:18.729492 30644 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.860658 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:18.871135 27240 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:18.872184 27240 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:18.861138 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.858594 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:18.861472 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:18.715793 31158 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:18.712143 31116 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.843334 30908 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:18.718382 31154 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.842281 31031 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:18.867652 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.717073 31143 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:18.845271 30901 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:18.727464 31157 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.873060 27273 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:18.698819 31138 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.873199 30947 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:18.877187 27276 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 14: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:18.859737 31163 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.729205 31142 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.834318 31076 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:11:18.890672 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:18.891702 26584 raft_consensus.cc:2393] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:18.885950 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:18.869870 31087 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.892750 26656 raft_consensus.cc:2393] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:18.815188 31164 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.888600 26583 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:11:18.893924 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 87388.2us
I20260709 13:11:18.893798 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.874902 30644 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:18.856788 31053 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.874748 31126 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:18.877264 31125 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:18.710503 30654 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.884783 31144 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:18.904765 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:18.920418 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 2115) took 2114 ms. Trace:
I20260709 13:11:18.920892 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:18.920822 26578 rpcz_store.cc:276] 0709 13:11:16.806024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.013053 (+207029us) service_pool.cc:224] Handling call
0709 13:11:17.580454 (+567401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:17.583889 (+  3435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.920240 (+1336351us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54000203d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:18.920365 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303627648}
I20260709 13:11:18.927592 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:18.928416 26584 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:18.889016 31163 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:18.907195 27271 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:18.905916 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.912693 27273 raft_consensus.cc:2410] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:11:18.936836 26655 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 15: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:18.936668 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:18.936877 27276 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:18.881718 31040 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:11:18.945330 31101 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:18.878700 31172 raft_consensus.cc:697] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:18.884037 31134 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:11:18.931854 31187 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:18.989977 31187 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.990545 31187 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:18.993131 31108 raft_consensus.cc:3055] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:11:18.993863 31003 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 2.301s	user 0.016s	sys 0.007s
I20260709 13:11:18.994583 30600 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.933998 31158 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:18.933876 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:18.995066 30600 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.995509 31158 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:18.995946 31158 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:18.996560 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:18.997165 26578 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:18.997498 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:18.998683 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:18.998522 31172 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.999722 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.001890 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.002530 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 724) took 1776 ms. Trace:
I20260709 13:11:19.003031 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.004132 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.007893 31158 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.886144 31143 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:11:18.940691 26583 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
W20260709 13:11:18.942076 26510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2455) took 2239 ms (client timeout 1801 ms). Trace:
I20260709 13:11:18.941781 31128 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:11:18.900673 31087 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.942924 31175 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:18.937595 26585 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
W20260709 13:11:19.020063 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 205591us
I20260709 13:11:18.905095 27243 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:18.897051 30947 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:18.974471 30685 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:18.985596 30908 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:18.987092 31103 raft_consensus.cc:3055] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:19.027693 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:18.988791 31115 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:18.988588 31163 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:18.949191 31109 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:11:18.993734 31108 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:18.933003 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:18.894666 31019 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.004622 27271 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:18.902441 27278 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:19.003055 27269 rpcz_store.cc:276] 0709 13:11:17.225960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.226107 (+   147us) service_pool.cc:224] Handling call
0709 13:11:17.445466 (+219359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.691740 (+246274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.691787 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.691845 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:17.691902 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.002229 (+1310327us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400817754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:19.002297 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.002452 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527621504}
I20260709 13:11:19.020184 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:19.017740 26510 rpcz_store.cc:269] 0709 13:11:16.702795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.702911 (+   116us) service_pool.cc:224] Handling call
0709 13:11:18.941862 (+2238951us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54000b3bd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:18.941983 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184414464}
I20260709 13:11:19.023339 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:19.024781 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 119793us
I20260709 13:11:19.040078 26658 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:19.040228 26583 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:19.041074 26622 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:19.041983 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:19.018494 31138 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.044032 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:19.024680 31085 consensus_meta.cc:287] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.273s	user 0.006s	sys 0.006s
I20260709 13:11:19.036161 27276 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:19.036578 26580 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 14: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:19.025987 30685 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.047006 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.050622 26658 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:19.051478 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.027797 31103 raft_consensus.cc:740] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:19.053160 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:19.054766 26583 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:19.052100 26658 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:19.055510 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:19.057616 26580 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:19.057874 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:19.058583 26585 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:19.044293 31126 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:19.050388 30939 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:11:19.062633 31176 raft_consensus.cc:2764] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:19.050177 31185 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:19.093686 31168 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.094235 31168 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.094398 30901 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.096400 31168 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.096635 30901 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.097347 26579 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:19.063437 31163 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:19.097779 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 417404us
I20260709 13:11:19.047564 30945 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.068396 26659 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:19.067993 31103 consensus_queue.cc:260] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.070550 30908 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.072176 30947 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.052781 31085 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.077960 31158 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.080976 31159 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:19.082583 26581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 799) took 2844 ms (client timeout 2035 ms). Trace:
I20260709 13:11:19.084502 31087 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:19.084890 31118 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.633s	user 0.003s	sys 0.002s
I20260709 13:11:19.047885 30719 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:19.117934 30719 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.118330 30719 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.118638 31053 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:19.119750 31142 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.122033 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 2107) took 2388 ms. Trace:
I20260709 13:11:19.121982 31159 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.086515 31187 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:19.107859 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 96820.2us
I20260709 13:11:19.112226 30600 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.113039 26576 raft_consensus.cc:2410] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:11:19.115298 31170 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:19.115870 31017 consensus_meta.cc:287] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.185s	user 0.009s	sys 0.003s
W20260709 13:11:19.114181 26581 rpcz_store.cc:269] 0709 13:11:16.238512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.244818 (+  6306us) service_pool.cc:224] Handling call
0709 13:11:19.082320 (+2837502us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54000d8c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:19.082484 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4556914944}
I20260709 13:11:19.115952 31085 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.122691 26582 rpcz_store.cc:276] 0709 13:11:16.733181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.733910 (+   729us) service_pool.cc:224] Handling call
0709 13:11:16.740353 (+  6443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.767340 (+ 26987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.767373 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.767865 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.122724 (+354859us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:17.256018 (+133294us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.591730 (+335712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.591803 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.084213 (+1492410us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:19.121741 (+ 37528us) raft_consensus.cc:1685] finished
0709 13:11:19.121824 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.121949 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16488,"prepare.queue_time_us":585504,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":337465,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":26994,"spinlock_wait_cycles":27871104,"thread_start_us":697644,"threads_started":3,"wal-append.queue_time_us":395837}
I20260709 13:11:19.139047 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.140057 26504 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:19.143383 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.143168 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.143944 26506 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:19.144613 26501 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:19.142890 26473 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:19.125599 31103 raft_consensus.cc:3060] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.147066 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:19.149144 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:19.147858 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 121232us
I20260709 13:11:19.150033 26510 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:19.141710 31168 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:19.149013 31145 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.594s	user 0.005s	sys 0.005s
I20260709 13:11:19.158792 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:19.093248 31108 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:19.154279 26625 connection.cc:256] RPC call timeout handler was delayed by -1.3266322590000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
I20260709 13:11:19.165318 26625 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:19.166365 30939 raft_consensus.cc:2804] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:19.167086 30939 raft_consensus.cc:697] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:19.168273 30939 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.151062 31026 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:19.174813 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.153319 30901 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.137629 31017 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.177799 26653 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:19.181723 31026 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.184166 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.184911 26653 raft_consensus.cc:2393] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:19.186262 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.179615 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:19.156121 31087 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:19.141477 30600 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:11:19.156970 30876 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:19.187381 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.194010 26659 raft_consensus.cc:2393] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:19.146530 31170 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.199558 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.203473 26650 raft_consensus.cc:2393] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:19.207701 26474 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:19.164206 31145 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.213689 31017 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:19.214255 31145 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:19.214824 31161 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:11:19.216051 31026 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:19.216782 31152 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 1.000s	user 0.002s	sys 0.002s
I20260709 13:11:19.218689 26658 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:19.193682 31116 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.165181 31168 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.220961 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.247606 26659 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:19.222934 26650 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:19.248674 31153 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:19.223889 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.249241 26474 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:19.225911 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:19.250839 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 100182us
I20260709 13:11:19.226596 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.240355 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.243398 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.252414 26502 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:19.252753 26505 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.251526 26510 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:19.251856 26476 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:19.257347 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 722) took 2038 ms. Trace:
I20260709 13:11:19.192049 31169 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.188094 30901 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.188287 30644 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.260305 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.265765 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.260921 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.267553 26502 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:19.268507 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.254900 26548 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:19.257714 27277 rpcz_store.cc:276] 0709 13:11:17.218489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.218795 (+   306us) service_pool.cc:224] Handling call
0709 13:11:17.250800 (+ 32005us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.631218 (+380418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.631274 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.671731 (+ 40457us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.865517 (+193786us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:17.865592 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.865695 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.122851 (+1257156us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:19.218961 (+ 96110us) raft_consensus.cc:1685] finished
0709 13:11:19.218986 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.257289 (+ 38303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":228915,"raft.queue_time_us":1250959,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":11706112,"thread_start_us":271424,"threads_started":2,"wal-append.queue_time_us":321134}
I20260709 13:11:19.269351 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.297399 26651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2265) took 2169 ms. Trace:
I20260709 13:11:19.297925 26651 rpcz_store.cc:276] 0709 13:11:17.127514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.513541 (+386027us) service_pool.cc:224] Handling call
0709 13:11:17.584907 (+ 71366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.711038 (+126131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.711072 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.711133 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:17.711188 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.297123 (+1585935us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54001036d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:19.297183 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.297332 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289556224}
I20260709 13:11:19.264779 31099 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:19.270764 31199 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:11:19.202183 30876 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:19.277177 31202 log.cc:927] Time spent T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:11:19.277344 30644 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.278502 31159 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.278769 31112 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.319154 31112 consensus_queue.cc:1243] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:11:19.279219 31196 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:11:19.279297 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.258847 31161 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:19.283849 26506 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
W20260709 13:11:19.286031 31197 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:19.286123 31026 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:19.288281 30901 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.259867 31116 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.351544 31116 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.289530 30719 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:19.273584 31195 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:11:19.290184 31187 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.290036 30685 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.353709 30719 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:19.353703 31165 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.769s	user 0.001s	sys 0.000s
I20260709 13:11:19.354605 30685 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:19.262779 31153 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.355549 31153 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.355495 31026 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.274518 31157 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:19.220742 31096 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:11:19.281059 31169 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.360054 31026 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.360833 31169 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:19.295270 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.362370 31168 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.296550 26510 raft_consensus.cc:2376] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14. Re-sending same reply.
I20260709 13:11:19.364194 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.365327 26510 raft_consensus.cc:2410] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:11:19.300961 31184 log.cc:927] Time spent T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.453s	user 0.001s	sys 0.004s
I20260709 13:11:19.300873 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:19.366153 27277 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.367496 27275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 726) took 1668 ms. Trace:
I20260709 13:11:19.367862 27275 rpcz_store.cc:276] 0709 13:11:17.699311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.747801 (+ 48490us) service_pool.cc:224] Handling call
0709 13:11:17.748209 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:18.584899 (+836690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.584933 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:18.585509 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 13:11:18.685044 (+ 99535us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:18.685100 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.685219 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.294251 (+609032us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:19.367206 (+ 72955us) raft_consensus.cc:1685] finished
0709 13:11:19.367224 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.367428 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":855872,"raft.queue_time_us":871896,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":25016,"spinlock_wait_cycles":4155136,"thread_start_us":6359,"threads_started":1,"wal-append.queue_time_us":191665}
I20260709 13:11:19.295089 30926 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.314522 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.318161 30876 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.374552 26656 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
W20260709 13:11:19.321889 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 67066.3us
I20260709 13:11:19.343160 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.327020 31161 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.376395 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.377135 27277 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:19.382014 26506 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:19.377781 26548 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.382915 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.383208 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.384483 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.343235 31142 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:19.387971 27275 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:19.388273 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.388502 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.399539 26506 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.399674 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.400825 26548 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:19.390700 26505 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:19.403323 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.404099 26510 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.406148 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:19.407567 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.412001 30600 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:19.412804 30600 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:19.378463 30685 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:19.378872 31097 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:19.389959 31161 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.418516 30685 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.390575 30901 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:19.391901 31187 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:19.434991 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.437423 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.445598 26505 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:19.403658 30644 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:19.405987 30908 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:11:19.448122 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 188265us
I20260709 13:11:19.406724 31131 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:19.452360 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.448860 26506 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:19.437094 30934 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:19.454119 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.454937 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.459198 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.459640 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.443697 30901 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.460278 26659 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:19.448113 31187 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.466114 30685 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.467108 31098 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.470961 30934 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:19.448004 30644 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.463858 26548 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.473889 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2255) took 2764 ms. Trace:
I20260709 13:11:19.480700 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.476588 30934 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.481554 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.480827 26654 rpcz_store.cc:276] 0709 13:11:16.698822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.698919 (+    97us) service_pool.cc:224] Handling call
0709 13:11:16.722290 (+ 23371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.910315 (+1188025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.461265 (+1550950us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400106654. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:19.463547 (+  2282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2697338624}
I20260709 13:11:19.483348 26510 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:19.481527 26650 raft_consensus.cc:2393] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:19.458592 30908 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:19.486150 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.471809 30901 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:19.474102 31187 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.487802 26474 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:19.489007 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.489789 26510 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:19.483451 30644 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.472430 30600 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.487340 31172 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:19.485136 31075 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:19.499414 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.500159 26507 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:19.500362 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.501147 26510 raft_consensus.cc:2376] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10. Re-sending same reply.
I20260709 13:11:19.501091 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.502321 26507 raft_consensus.cc:2410] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:11:19.504051 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.505851 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.514468 26507 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:19.516619 30960 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:19.519565 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.520749 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.521358 26507 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:19.522167 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.494153 31205 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:19.510741 31164 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.523022 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.525609 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.523494 26507 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:19.499696 31172 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.530081 26510 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:19.530489 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.532917 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.535857 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.536645 26507 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:11:19.537878 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:19.519500 31075 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:19.529381 31205 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.530860 30719 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:19.531142 30939 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:19.542397 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:19.537914 31206 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:11:19.544323 26510 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:19.544716 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:19.535907 31172 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.546715 27275 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.543723 31098 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:19.551864 31098 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:19.554087 31212 log.cc:927] Time spent T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:11:19.560041 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:19.560683 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:19.561393 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.548099 30939 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.561918 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.562053 26650 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:19.563249 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:19.563611 30939 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:19.564745 31075 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.547075 30719 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.570640 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.571476 26653 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:19.571699 30719 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.575037 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.575795 26656 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:19.564769 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:19.579540 26476 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:19.580585 26476 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:19.543304 31205 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.586793 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.581385 26476 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:19.589465 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.601035 26476 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:19.602027 27270 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:19.604251 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.608855 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.609666 26504 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.614852 26510 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:19.616906 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:19.617838 26656 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.618495 26510 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:19.625959 30876 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:19.626631 30876 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:19.627159 30876 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.639312 30719 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:19.640183 30719 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.542508 30908 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.595729 30960 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:19.644038 30960 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:19.644606 30960 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:19.610947 31206 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:19.651464 30719 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:19.658289 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.658118 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 46392.6us
I20260709 13:11:19.664577 27275 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:19.596890 31103 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:19.624634 31153 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.666476 26622 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:19.680182 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.599447 31098 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.699844 26501 raft_consensus.cc:2368] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10.
I20260709 13:11:19.678936 30719 raft_consensus.cc:2804] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:19.708989 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:19.709976 26658 raft_consensus.cc:3060] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.710743 26656 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:19.712153 26504 raft_consensus.cc:2468] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:19.713814 26510 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:19.715374 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.719708 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.720928 26504 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:19.676731 30644 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.731426 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:19.732442 26656 raft_consensus.cc:2376] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14. Re-sending same reply.
I20260709 13:11:19.739897 26658 raft_consensus.cc:2468] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:19.714632 30719 raft_consensus.cc:697] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:19.744272 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.747905 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.748901 26656 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:19.753868 31153 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.709368 31161 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.759123 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:19.760003 26507 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:19.760346 26656 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.761490 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.762274 26507 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:19.766593 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:19.767242 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.773449 26653 raft_consensus.cc:1217] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[6.4-12.7]   Dedup: 8.5->[10.6-12.7]
I20260709 13:11:19.774093 26653 pending_rounds.cc:85] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 5
I20260709 13:11:19.774350 26653 pending_rounds.cc:107] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:11:19.774601 26653 raft_consensus.cc:2889] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:19.763731 31219 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:19.779829 26656 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:19.783293 30825 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:19.789898 30825 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.791489 30644 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:19.795722 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:19.797222 26656 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.810948 31170 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.812768 26474 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:19.814852 31103 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:19.820488 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.821127 26505 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.824734 26656 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:19.815490 31103 raft_consensus.cc:697] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:19.842139 26505 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
W20260709 13:11:19.861631 31225 log.cc:927] Time spent T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:11:19.866705 31161 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.868673 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:19.869577 26657 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.819985 30719 consensus_queue.cc:237] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.876513 31205 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.881534 26548 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.862865 30934 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:19.891695 26548 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.898336 30934 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.901130 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.902911 26503 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:19.908317 26508 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 11: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:19.911398 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:19.900697 30908 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:19.918220 30920 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:19.919667 31098 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:19.920426 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:19.919845 27273 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:19.899232 31087 raft_consensus.cc:2804] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:19.926637 27241 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:19.916669 31221 log.cc:927] Time spent T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:11:19.930872 26548 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.941748 27241 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:19.941892 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:19.922093 31075 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:19.949491 26657 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:19.951207 26474 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:19.952072 31153 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:19.952188 31017 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:19.952610 31153 raft_consensus.cc:697] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:19.953137 31017 consensus_queue.cc:1243] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:19.953735 31111 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:19.954145 31111 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:19.953863 31153 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.955158 31111 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:19.958740 31111 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.961697 26502 raft_consensus.cc:2376] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11. Re-sending same reply.
I20260709 13:11:19.965826 26473 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:19.966600 31168 raft_consensus.cc:2764] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:11:19.967478 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.968564 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:19.969416 30712 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:19.969826 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:19.972544 26509 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:11:19.972924 26509 pending_rounds.cc:85] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 10
I20260709 13:11:19.973145 26509 pending_rounds.cc:107] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:11:19.973378 26509 raft_consensus.cc:2889] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:19.977859 26501 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:11:19.980813 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.981878 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.982043 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.982652 27269 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:19.982975 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.983517 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.984108 27269 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:19.984910 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.985196 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:19.985893 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:19.986150 31134 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:19.986485 27270 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:19.986558 27240 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:19.923527 30908 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:19.987883 26655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2270) took 1546 ms (client timeout 2036 ms). Trace:
I20260709 13:11:19.982663 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:19.995631 27275 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 11: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:19.988534 26501 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:19.988821 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:19.989679 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47864.8us
I20260709 13:11:19.992776 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:19.997181 26548 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:19.904373 30825 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:19.994305 26655 rpcz_store.cc:269] 0709 13:11:18.441898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.442093 (+   195us) service_pool.cc:224] Handling call
0709 13:11:19.987728 (+1545635us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b5400103bd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:19.987831 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889924992}
I20260709 13:11:19.997176 27270 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.999396 27240 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:19.910852 30876 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.006153 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:19.989641 31076 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:19.988446 30920 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:20.007683 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:20.012710 27240 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:20.013684 27273 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:19.987581 31075 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.902343 31103 consensus_queue.cc:237] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:19.943919 31087 raft_consensus.cc:697] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:20.004951 31126 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:20.016446 27269 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:20.010499 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:19.998314 30908 raft_consensus.cc:3060] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.002257 31125 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:20.030519 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:20.027479 27271 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:19.999282 31134 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:19.998294 31142 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:20.031605 26579 raft_consensus.cc:2393] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:20.017716 30712 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:20.026517 31187 consensus_meta.cc:287] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.004s
I20260709 13:11:20.025228 30920 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.052291 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:20.013063 30685 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:20.076587 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.076968 26584 raft_consensus.cc:1275] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:20.038398 30825 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:20.018934 31240 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:20.064455 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.029917 31075 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:20.114903 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 58738.2us
I20260709 13:11:20.078055 26578 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:20.037493 31229 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:11:20.121476 26473 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:20.116291 31136 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.043835 30876 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:20.079180 31228 log.cc:927] Time spent T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:11:20.133044 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 87812.7us
I20260709 13:11:20.029026 31126 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:20.124665 26580 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:20.126700 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.126806 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:20.126813 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:20.122656 31176 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:11:20.135425 26655 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.131901 27270 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:20.038177 30934 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:20.077387 30920 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.064740 31142 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.077689 30685 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.139050 26473 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:20.159546 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.157609 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.158622 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.163993 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.107753 31205 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.063081 30712 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:20.141899 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:20.166504 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.131155 30944 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.041792 30960 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.137687 31157 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.076855 31187 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.137382 31109 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:20.138218 31126 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.137684 31136 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:20.154671 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 157553us
W20260709 13:11:20.169773 31231 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:11:20.181491 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.184188 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:20.175392 30685 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:20.175567 30712 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:20.176946 31170 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:20.205190 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.183301 31142 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:20.201122 31131 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:20.164516 31087 consensus_queue.cc:237] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.205248 31170 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.181368 31102 consensus_queue.cc:1059] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:11:20.179450 30876 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:11:20.185505 30934 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:11:20.229274 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.186957 30825 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:11:20.231503 26577 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:20.182729 30908 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:20.232206 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45626us
W20260709 13:11:20.232717 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.183153 31157 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.247082 31075 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.227721 31131 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:20.258222 31131 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:20.259996 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.262166 30960 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.265045 30908 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.238130 31103 raft_consensus.cc:3055] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:20.266530 31103 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:20.267474 31103 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:20.268006 26576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 810) took 2266 ms (client timeout 2521 ms). Trace:
I20260709 13:11:20.268723 31103 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:20.271451 31157 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:20.250924 26584 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:20.229909 31170 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:20.252305 31172 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.000s
I20260709 13:11:20.277237 31172 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.277765 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:20.279362 31172 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.280723 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:20.281937 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:20.282454 31136 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:20.282585 30901 consensus_meta.cc:287] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.790s	user 0.013s	sys 0.000s
I20260709 13:11:20.282676 26657 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:11:20.268466 26576 rpcz_store.cc:269] 0709 13:11:18.001927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.002073 (+   146us) service_pool.cc:224] Handling call
0709 13:11:20.267819 (+2265746us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003d1654. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:20.267952 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2551530368}
I20260709 13:11:20.283603 26580 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:20.253980 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.283814 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:20.254859 31187 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.254865 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:20.274031 26655 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:20.275085 27243 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.287014 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.287314 26501 raft_consensus.cc:2368] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14.
I20260709 13:11:20.287763 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:20.288532 26506 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:20.283071 30901 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.290081 27240 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:20.290993 31136 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:20.291374 31136 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.291596 31037 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.290110 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:20.298017 26577 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:20.299435 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:20.291779 31136 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.303059 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:20.305189 30712 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.308211 31040 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:20.308830 31040 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:20.308938 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:20.309479 31040 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:20.310578 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:20.312209 30712 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.313042 27241 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:20.319092 26622 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:20.321609 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:20.323799 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:20.328909 31076 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:20.335246 31234 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:20.335091 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:20.336648 31234 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.337719 26622 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:20.338572 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:20.341477 26625 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.342943 26622 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:20.343263 26625 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.349126 31019 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:20.349797 31019 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:20.351076 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2858) took 1042 ms. Trace:
I20260709 13:11:20.350936 31019 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.351611 26502 rpcz_store.cc:276] 0709 13:11:19.309490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.314145 (+  4655us) service_pool.cc:224] Handling call
0709 13:11:20.350805 (+1036660us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54003ec954. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:20.350988 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357565184}
I20260709 13:11:20.352308 31019 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.354461 27278 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:20.356738 26505 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:20.356492 31168 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:11:20.358760 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 65551.7us
W20260709 13:11:20.369815 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 135358us
I20260709 13:11:20.370805 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.374915 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:20.377946 26501 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:20.379896 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:20.380498 26501 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.380676 26625 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.382138 26504 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:20.380857 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:20.319916 30654 raft_consensus.cc:2764] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:20.382850 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:20.319916 31176 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:20.383477 26581 raft_consensus.cc:3060] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.383486 26507 raft_consensus.cc:2393] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:20.334411 31053 raft_consensus.cc:2764] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:11:20.395289 27243 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.286912 30940 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:11:20.400597 27243 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.392755 26625 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.391306 26585 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:20.398036 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:20.398860 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:20.403347 27278 raft_consensus.cc:2393] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:20.404438 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:20.405038 27243 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.406219 26579 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 15: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:20.406924 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 20b4ddf1aa104699a71886717f8e24b6: Illegal state: Replica b9c3761688a64982ae1c4aeb758e09ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:20.365741 31234 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:20.417137 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:20.380625 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:20.420466 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:20.423673 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.424091 26507 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.394426 30926 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.394906 31164 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:20.394708 31145 raft_consensus.cc:2804] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:20.389989 30947 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:20.409794 31176 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:20.418396 31234 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:20.455081 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 74544.5us
I20260709 13:11:20.404436 31017 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:20.463862 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.459837 31053 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:11:20.473851 30920 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.478252 27278 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:20.480614 31075 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.448065 30654 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.417311 31111 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:20.482340 31146 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:20.499204 31234 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.483233 31040 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.395339 30939 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.490820 26583 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:11:20.492745 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 179784us
I20260709 13:11:20.429785 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.497486 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:20.403843 31134 consensus_queue.cc:1059] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:11:20.501883 26501 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:20.554832 26579 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:20.500700 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:20.416684 31076 consensus_queue.cc:1048] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:11:20.543656 26507 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:20.483328 30901 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.497265 31164 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:20.549134 27269 raft_consensus.cc:2393] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 13: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:20.550962 26578 raft_consensus.cc:2368] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13.
W20260709 13:11:20.556196 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 58802.7us
W20260709 13:11:20.559782 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 59218.8us
I20260709 13:11:20.551026 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:20.565402 26622 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:20.572530 26651 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:20.544689 31146 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:20.565341 30654 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:20.582110 30654 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:20.583173 30654 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.573378 31240 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:20.568356 31252 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:20.586024 31252 raft_consensus.cc:697] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:20.587108 31252 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.587895 31164 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.590956 30920 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:20.591636 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 658189us
I20260709 13:11:20.593685 30939 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:20.596868 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2868) took 1062 ms. Trace:
I20260709 13:11:20.597106 31040 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:20.597697 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2488) took 1359 ms. Trace:
I20260709 13:11:20.598124 26508 rpcz_store.cc:276] 0709 13:11:19.238637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.519262 (+280625us) service_pool.cc:224] Handling call
0709 13:11:20.597472 (+1078210us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400359b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:20.597638 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855141120}
I20260709 13:11:20.599220 26581 raft_consensus.cc:2468] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:20.599778 30600 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:11:20.603340 31136 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.605718 27271 raft_consensus.cc:2393] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:11:20.605893 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 51546.3us
I20260709 13:11:20.606365 31187 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:20.609050 31240 raft_consensus.cc:3055] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:20.608490 26402 catalog_manager.cc:5697] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 7 to 8, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 8 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.610661 31076 raft_consensus.cc:3055] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:20.523326 31126 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.614164 31076 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:20.615357 31136 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:20.615214 31076 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.616025 31126 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.617129 27275 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:20.597283 26505 rpcz_store.cc:276] 0709 13:11:19.534865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.890828 (+355963us) service_pool.cc:224] Handling call
0709 13:11:20.356289 (+465461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.357234 (+   945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.596684 (+239450us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54003ec950. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:20.596808 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041890560}
I20260709 13:11:20.619059 30908 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:20.619630 30908 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.621068 31108 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.572229 30947 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:20.624990 30947 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:20.625509 30947 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.612689 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:20.611594 26402 catalog_manager.cc:5697] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 3 to 8, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 8 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.627846 27273 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:20.628978 31019 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.630105 26549 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:20.627846 26402 catalog_manager.cc:5697] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 3 to 6, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 6 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.638375 26402 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 5 to 7, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 7 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:20.650130 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.658231 26549 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:20.658628 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 84580.6us
I20260709 13:11:20.659557 26548 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:20.660815 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:20.661729 31248 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:20.662377 26549 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:20.662487 31248 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.663112 31131 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:20.664093 31241 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:20.624717 31238 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.680s	user 0.003s	sys 0.000s
I20260709 13:11:20.613483 30901 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:11:20.665716 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 1053) took 1143 ms. Trace:
I20260709 13:11:20.666260 30901 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:20.666688 30901 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:20.667469 30901 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.668602 30901 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:20.669023 30600 consensus_queue.cc:1175] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260709 13:11:20.666108 27276 rpcz_store.cc:276] 0709 13:11:19.521981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.599687 (+ 77706us) service_pool.cc:224] Handling call
0709 13:11:19.607614 (+  7927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.892201 (+284587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.892236 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.894108 (+  1872us) log.cc:844] Serialized 26 byte log entry
0709 13:11:19.944624 (+ 50516us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:19.944667 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.944732 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.624150 (+679418us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:20.665396 (+ 41246us) raft_consensus.cc:1685] finished
0709 13:11:20.665423 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.665655 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":286529,"raft.queue_time_us":280912,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":7017,"spinlock_wait_cycles":133214464,"thread_start_us":11614,"threads_started":1,"wal-append.queue_time_us":35427}
I20260709 13:11:20.671525 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:20.671581 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:20.670607 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:20.672423 26657 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.673441 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:20.674549 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:20.675238 26658 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:20.611826 31213 log.cc:927] Time spent T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 1.116s	user 0.000s	sys 0.009s
I20260709 13:11:20.631770 31040 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:20.680056 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:20.680344 31040 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.680352 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:20.677030 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:20.630183 31146 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:20.677273 26548 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:20.670238 31250 log.cc:927] Time spent T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:11:20.670116 31235 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.686s	user 0.007s	sys 0.002s
I20260709 13:11:20.688088 26650 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:20.609519 31240 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:20.692159 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:20.675781 30920 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:20.574716 30719 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:11:20.696925 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:20.695698 26658 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:20.699687 26505 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.698215 31019 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:20.701408 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 282849us
I20260709 13:11:20.702172 26625 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.705930 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:20.711705 26625 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.712841 26625 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:20.713471 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.715838 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:20.716614 26502 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.720077 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:20.720971 26509 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:20.687270 31241 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:20.731599 26625 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.690678 30908 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:20.734807 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:20.736012 31248 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:20.738358 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 1049) took 1225 ms. Trace:
I20260709 13:11:20.767658 26657 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:20.766355 27277 rpcz_store.cc:276] 0709 13:11:19.512513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.512767 (+   254us) service_pool.cc:224] Handling call
0709 13:11:19.513249 (+   482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:19.879300 (+366051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.879345 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:19.889719 (+ 10374us) log.cc:844] Serialized 52 byte log entry
0709 13:11:19.999523 (+109804us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:19.999562 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.999626 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.609041 (+609415us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:20.738100 (+129059us) raft_consensus.cc:1685] finished
0709 13:11:20.738119 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.738307 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":403855,"raft.queue_time_us":365625,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6536,"spinlock_wait_cycles":32802176,"thread_start_us":90034,"threads_started":1,"wal-append.queue_time_us":82614}
I20260709 13:11:20.692335 31087 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:20.677102 31170 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.740777 26502 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:20.698824 30920 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.769068 26625 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.739341 30719 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.728415 31134 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:20.736056 31233 log.cc:927] Time spent T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.749s	user 0.004s	sys 0.013s
I20260709 13:11:20.770514 26508 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 15: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:20.788964 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:20.793067 26582 raft_consensus.cc:2410] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:11:20.739604 31017 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:20.731438 31241 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:20.814358 26505 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:20.752987 30940 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:20.786787 26625 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:20.819294 26506 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:20.783540 30926 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:20.856029 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 69317.2us
W20260709 13:11:20.765956 31142 consensus_meta.cc:287] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.006s
I20260709 13:11:20.787693 30920 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.865840 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:20.875134 26502 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.854902 31128 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:20.876710 31128 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.877069 30940 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:20.868155 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:20.877987 30940 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:20.878816 30940 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:20.780632 31240 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.881758 31142 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.884506 31142 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:20.887740 30685 consensus_meta.cc:287] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.676s	user 0.004s	sys 0.004s
I20260709 13:11:20.888281 30685 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.889636 27270 raft_consensus.cc:2368] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:20.890969 30926 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:20.892865 31234 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.894308 26656 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 13: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:20.895427 31234 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:20.855497 31229 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:20.821871 31017 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.898784 31017 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:20.821871 31241 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.914974 26502 raft_consensus.cc:2468] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:20.921937 31040 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:20.923539 31170 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:20.811905 31134 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:20.873463 30719 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:20.960232 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:20.963761 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:20.964164 27276 raft_consensus.cc:2393] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:20.964406 27278 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:20.966398 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 359685us
I20260709 13:11:20.933676 31262 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:20.973341 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:20.975593 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 253278us
W20260709 13:11:20.983063 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 414680us
I20260709 13:11:20.984266 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:20.989290 27278 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:20.990648 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:20.933008 30947 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:20.963974 30719 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:21.006179 27240 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:20.993520 31219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.011s	sys 0.037s
I20260709 13:11:20.996867 26548 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:20.969477 31145 raft_consensus.cc:697] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:21.022307 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:21.028580 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:21.031487 26548 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:21.032604 26659 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:21.034399 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:20.996614 26622 leader_election.cc:400] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14.
I20260709 13:11:20.981666 31262 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.014976 30719 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:21.034684 31075 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:21.020345 31219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.011s	sys 0.038s
I20260709 13:11:21.042122 30908 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:21.043560 31134 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:21.044407 31128 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:21.035971 31263 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.037485 31125 raft_consensus.cc:2804] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:21.035096 31176 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:21.018884 31146 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.071357 31075 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:21.049641 27278 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:21.013500 31142 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:11:21.082868 31128 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.029304 31187 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:21.061978 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:21.065446 30940 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:21.066648 26650 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:21.032572 31019 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:21.048074 26473 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:21.082893 30908 raft_consensus.cc:697] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:21.094509 31144 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.033s	sys 0.029s
I20260709 13:11:21.069530 31076 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:21.031190 30654 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:21.080639 31098 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:21.134595 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 275676us
W20260709 13:11:21.048836 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 52338.2us
I20260709 13:11:21.095223 30685 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:21.144464 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 96478.3us
I20260709 13:11:21.071158 30947 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:21.097939 31125 raft_consensus.cc:697] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:21.134640 31075 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:21.139477 26502 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:21.165218 31144 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.041s	sys 0.033s
I20260709 13:11:21.083290 31263 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.150312 31219 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:11:21.240070 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 64613.9us
I20260709 13:11:21.164990 31019 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:21.167425 31187 raft_consensus.cc:697] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:21.244129 26625 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:21.099040 31176 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.149703 30940 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.259958 26502 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:21.261809 27240 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:21.148557 31128 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.237162 31098 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:21.256117 31101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.283s	user 0.008s	sys 0.038s
I20260709 13:11:21.248559 31219 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:21.221402 30917 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:11:21.268337 31108 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.263774 31255 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.263424 31164 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:21.277247 31101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.009s	sys 0.038s
I20260709 13:11:21.265372 31269 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:21.168617 31145 consensus_queue.cc:237] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.254753 31040 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:11:21.303930 27269 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:21.255154 30654 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:11:21.277422 31257 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:21.297675 31269 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:21.289584 31187 consensus_queue.cc:237] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.343201 31279 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.330166 31257 raft_consensus.cc:697] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:11:21.354568 31271 log.cc:927] Time spent T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:11:21.282078 30908 consensus_queue.cc:237] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.305949 31164 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.306133 31255 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.371599 30685 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.286644 31125 consensus_queue.cc:237] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.398149 26653 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:21.401744 26654 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:11:21.407774 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.401357 26658 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:21.355907 31269 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:21.314386 31241 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.300454 31108 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:21.417204 31275 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:11:21.417821 26625 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.662s (SENT) [suppressed 21 similar messages]
I20260709 13:11:21.359404 31262 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:21.386930 31265 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
I20260709 13:11:21.376411 30917 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.315851 31019 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:21.431511 31270 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:11:21.354707 31098 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.374919 31219 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.476186 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:21.468822 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 434457us
I20260709 13:11:21.477360 27241 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:21.404094 31253 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.771s	user 0.004s	sys 0.006s
W20260709 13:11:21.435439 31267 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:11:21.423373 31146 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:21.496143 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:21.474892 31271 log.cc:927] Time spent T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:21.432190 30940 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:21.502225 26502 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:21.502920 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:21.505245 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:21.506284 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 1020) took 1220 ms. Trace:
I20260709 13:11:21.518241 27271 rpcz_store.cc:276] 0709 13:11:20.272979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.273239 (+   260us) service_pool.cc:224] Handling call
0709 13:11:21.492977 (+1219738us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400780fd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:21.493178 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718713088}
I20260709 13:11:21.508708 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:21.519534 26505 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:21.514421 26659 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:21.388736 31279 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:21.486794 31280 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:11:21.513150 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 126105us
I20260709 13:11:21.505667 31037 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:21.525769 30864 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:11:21.526762 31295 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:11:21.527104 30901 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:21.428970 30685 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.399260 31257 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.473735 30939 consensus_queue.cc:1059] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:11:21.520112 30920 consensus_meta.cc:287] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.000s
I20260709 13:11:21.546531 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:21.558861 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:21.487040 30917 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.569518 26505 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
W20260709 13:11:21.565865 31153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.607s	user 0.027s	sys 0.021s
I20260709 13:11:21.569593 26659 raft_consensus.cc:2393] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:21.513715 30947 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.572664 27271 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:21.543587 31128 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:21.543071 31037 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:11:21.575903 31153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.617s	user 0.027s	sys 0.021s
I20260709 13:11:21.539527 31263 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:21.579582 27278 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:21.517663 31288 consensus_queue.cc:1059] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:11:21.568408 31170 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:21.567968 31075 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.609293 31037 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.616295 31040 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:21.564405 30908 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:11:21.623255 31297 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:11:21.642392 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 47143.8us
W20260709 13:11:21.683669 26578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2951) took 1534 ms (client timeout 1662 ms). Trace:
W20260709 13:11:21.684262 26578 rpcz_store.cc:269] 0709 13:11:20.148859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.149660 (+   801us) service_pool.cc:224] Handling call
0709 13:11:21.683434 (+1533774us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400254254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:21.683593 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882466560}
I20260709 13:11:21.576882 30901 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:11:21.574285 30920 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.639621 31153 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:21.641610 31168 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.583729 30947 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.706561 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:21.707365 26501 raft_consensus.cc:2368] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13.
I20260709 13:11:21.707718 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:21.708374 26509 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:21.710069 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:21.710752 26509 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:21.711920 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:21.642437 31170 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.716213 26510 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:11:21.717883 26510 pending_rounds.cc:85] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 7
I20260709 13:11:21.718135 26510 pending_rounds.cc:107] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:11:21.718384 26510 raft_consensus.cc:2889] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.719995 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:21.722396 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:21.678947 31252 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:11:21.607404 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:21.731129 31279 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:21.734205 30719 consensus_meta.cc:287] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.652s	user 0.004s	sys 0.009s
I20260709 13:11:21.793763 26501 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
W20260709 13:11:21.799258 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 154687us
I20260709 13:11:21.719084 31108 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:21.850185 26651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 2122) took 1526 ms (client timeout 1942 ms). Trace:
I20260709 13:11:21.713212 31309 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:11:21.705499 30940 consensus_queue.cc:1059] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:11:21.703593 31153 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:21.853840 26651 rpcz_store.cc:269] 0709 13:11:20.323384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.323547 (+   163us) service_pool.cc:224] Handling call
0709 13:11:21.850006 (+1526459us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400169254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:21.850131 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570222336}
I20260709 13:11:21.707051 31168 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.864481 31168 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:21.865041 31168 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:21.748327 31111 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.759408 31164 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:21.833290 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.866879 26476 leader_election.cc:336] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.545s (SENT)
I20260709 13:11:21.854367 30960 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.870280 26476 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:21.869467 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 451654us
I20260709 13:11:21.859676 31309 consensus_queue.cc:1243] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer b1f40e8672c549d3b4be7862ac07b7e2 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:21.775873 30719 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.881371 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46306 (request call id 4) took 1407 ms. Trace:
I20260709 13:11:21.881815 31269 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.882905 26657 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:21.883141 31112 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:21.883837 31112 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:21.884318 31112 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.881824 26504 rpcz_store.cc:276] 0709 13:11:20.471558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.471769 (+   211us) service_pool.cc:224] Handling call
0709 13:11:21.878339 (+1406570us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b54000023d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92f735 00007f88318efd29 00007f882ae6e1d4 00007f882ae6e162 00007f882ae6e091 00007f882ae6e00c 00007f882ae6d2c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:21.878514 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195787008}
W20260709 13:11:21.890379 26476 leader_election.cc:336] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.588s (SENT)
W20260709 13:11:21.891287 26476 leader_election.cc:336] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Timed out: RequestConsensusVote RPC to 127.24.204.194:33025 timed out after 1.588s (SENT)
I20260709 13:11:21.891723 26476 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:21.894640 26655 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:21.895983 30719 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:21.897594 31103 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:21.867920 30939 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:11:21.906801 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.870627 30685 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:21.910250 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.910630 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:21.911221 27271 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:21.912446 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:21.912581 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:21.907202 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:21.913172 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:21.916708 26622 leader_election.cc:400] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13.
I20260709 13:11:21.917073 26622 leader_election.cc:403] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:11:21.917156 26504 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:21.917909 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:21.875216 31255 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:21.921487 31294 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:21.875757 30960 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.925422 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:21.926172 26508 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:21.926998 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:21.927630 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:21.927896 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:21.867268 31168 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.871718 31111 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.931155 26583 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:21.934512 26576 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:21.935122 26585 raft_consensus.cc:1275] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:21.910032 30908 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.936592 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:21.943029 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:21.925654 31053 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:21.945219 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:21.927107 30719 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:21.946599 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:21.924794 31075 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:21.962689 27272 pending_rounds.cc:85] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 9
I20260709 13:11:21.963624 27272 pending_rounds.cc:107] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:11:21.951829 26579 raft_consensus.cc:2393] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:21.964648 27272 raft_consensus.cc:2889] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.965371 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:21.915153 30939 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:21.951313 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:21.975327 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.002045 26583 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:22.007831 31257 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:22.008543 31257 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.011665 30825 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.012269 30825 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.014453 30825 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.015267 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.015334 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:21.961156 31305 log.cc:927] Time spent T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:22.018189 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.018889 26583 raft_consensus.cc:2468] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:22.019028 26581 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:22.022593 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.024434 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.025487 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.028118 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.029160 26578 raft_consensus.cc:2368] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11.
I20260709 13:11:21.960732 31112 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:21.960233 30920 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:21.972229 31111 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:22.031633 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:22.040560 31125 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:21.949291 30908 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:21.951282 30719 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:22.044432 30719 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:22.051762 31168 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.016047 31259 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.971211 31269 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:22.056265 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.057632 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.058043 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.017230 31257 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:22.068609 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.069291 26579 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:22.070779 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.070827 26578 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:22.073252 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.031747 31170 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.074926 26585 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:22.076126 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:22.079360 31312 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:11:22.080778 26585 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:22.083554 26656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2307) took 1411 ms. Trace:
W20260709 13:11:22.084077 31303 log.cc:927] Time spent T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:11:22.084672 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:22.085515 31315 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:22.085961 31315 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:22.086300 31315 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:22.087710 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 959) took 1114 ms. Trace:
I20260709 13:11:22.088084 26650 rpcz_store.cc:276] 0709 13:11:20.972980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.973103 (+   123us) service_pool.cc:224] Handling call
0709 13:11:22.087553 (+1114450us) spinlock_profiling.cc:243] Waited 91.5 ms on lock 0x7b54001027d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:22.087656 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210389376}
I20260709 13:11:22.083941 26656 rpcz_store.cc:276] 0709 13:11:20.672542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.673229 (+   687us) service_pool.cc:224] Handling call
0709 13:11:22.083358 (+1410129us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54002da354. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:22.083496 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505577344}
I20260709 13:11:21.970818 30960 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:22.100265 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:22.100354 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.101330 26579 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:22.052855 31259 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.102720 31075 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:22.107028 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:22.107708 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:22.108527 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.108700 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:22.105630 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.109467 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:22.116067 26501 raft_consensus.cc:2393] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:22.116549 26578 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:22.115731 27274 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
W20260709 13:11:22.129040 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 91146.1us
I20260709 13:11:22.154716 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:22.155795 26503 raft_consensus.cc:2410] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:22.168586 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:22.174142 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.177330 26585 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:22.102849 30908 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:22.110922 31153 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.188418 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:22.125396 31075 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:22.189697 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.192955 26577 raft_consensus.cc:2368] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:22.193516 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.193997 26577 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:22.194829 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:22.195956 26585 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:22.189258 26510 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:22.198541 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:22.201889 26578 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:22.198839 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:22.204082 26578 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:22.206869 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:22.211506 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.216645 26577 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:22.216846 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.215335 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:22.218892 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 7fdbcbb3a7ce412c93c07413fe11793f: Illegal state: Replica b9c3761688a64982ae1c4aeb758e09ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:22.222193 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:22.223105 27269 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:22.203210 31321 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:22.236065 26577 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:11:22.248713 31322 log.cc:927] Time spent T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:11:22.250443 31247 raft_consensus.cc:3055] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:11:22.252224 31329 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:11:22.253145 31324 log.cc:927] Time spent T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:22.209318 31330 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:22.265494 27270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 1018) took 2120 ms (client timeout 1599 ms). Trace:
W20260709 13:11:22.254613 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 274eefdb88c143849b4b07f0d6ffcdc0: Illegal state: Replica af1b5d6d444447b7a580afb4aff33320 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:22.266047 27270 rpcz_store.cc:269] 0709 13:11:20.141063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.141483 (+   420us) service_pool.cc:224] Handling call
0709 13:11:22.261409 (+2119926us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54005f28d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:22.261579 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661374848}
I20260709 13:11:22.218766 31309 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:22.234787 31255 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:22.260648 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:22.272096 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 70853.3us
I20260709 13:11:22.227079 31288 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:22.274809 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.263299 31053 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13.
I20260709 13:11:22.261023 31241 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.293991 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:22.293406 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:22.298362 27275 raft_consensus.cc:2393] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:22.262995 31247 raft_consensus.cc:740] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:22.296965 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.298781 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:22.301504 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.270278 31330 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:22.299728 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:22.235026 31311 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:11:22.302204 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:22.305330 27276 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:22.272343 31255 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.289275 31153 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:22.252583 31315 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.307045 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:22.318130 26501 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 11: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:22.290511 31309 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:22.263020 31321 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:22.320374 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.329283 26579 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15.
I20260709 13:11:22.324820 26510 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:22.327762 27277 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:22.329993 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:22.310101 31153 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:22.334220 31153 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.334839 26501 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:22.310892 31255 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:22.306038 31330 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.343972 26507 raft_consensus.cc:1275] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:22.355118 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.355168 26510 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:22.358901 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.361577 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:22.361995 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.353628 26507 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:22.363879 26508 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:22.364205 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:22.368948 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 40a3c5a4dbcb4d7f8b2517b3d86bcb00: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:22.376400 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.377210 26577 raft_consensus.cc:2376] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10. Re-sending same reply.
I20260709 13:11:22.377859 27277 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:22.380841 31075 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:22.373792 31103 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:22.382038 31103 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.383366 31315 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.384065 31103 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.386830 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:22.388118 31176 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:22.370934 31269 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:22.368626 31258 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.393397 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.391697 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:22.411289 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.412693 26577 raft_consensus.cc:2368] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:22.374094 31234 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:22.426271 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.427145 26585 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:22.428010 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.431450 31240 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:22.434392 31321 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:22.356792 31247 consensus_queue.cc:260] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:22.419394 31336 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:11:22.435422 26501 raft_consensus.cc:1240] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:11:22.436319 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.429073 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.438313 26476 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:22.449925 26657 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:22.450908 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.451298 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:22.452211 26659 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 11: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:22.452337 26577 raft_consensus.cc:2393] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:22.452319 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.453351 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.453512 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:22.454893 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.412319 31269 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:22.458197 26549 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:22.459208 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.409755 31309 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.460016 26655 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:22.461133 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.464253 30960 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:22.464584 26655 raft_consensus.cc:2393] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:22.465435 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.466033 30917 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:22.421382 31311 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.466794 26655 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:11:22.462152 31346 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:22.462960 31112 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:22.468974 31112 raft_consensus.cc:3055] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:22.469336 31112 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:22.470256 31112 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.471691 31112 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:22.415221 31258 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:22.452569 31247 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:22.474504 31258 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:22.477101 27241 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:22.478091 31254 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:22.478706 31254 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:22.479139 31254 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:22.483237 31153 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.487313 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:22.488415 27272 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.488571 31259 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:22.491889 31269 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:22.492975 30939 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:22.495168 26652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 2306) took 1824 ms (client timeout 1799 ms). Trace:
W20260709 13:11:22.495622 26652 rpcz_store.cc:269] 0709 13:11:20.671160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.671298 (+   138us) service_pool.cc:224] Handling call
0709 13:11:22.494936 (+1823638us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b540039d0d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:22.495094 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140762368}
I20260709 13:11:22.496734 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.463624 31187 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.502519 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:22.528074 26510 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:22.506367 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.500162 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:22.507285 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.517853 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:22.529851 27240 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:22.530558 26510 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:11:22.501847 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 44332.3us
I20260709 13:11:22.477994 26655 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:22.529901 26507 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:22.530126 26577 raft_consensus.cc:2410] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:11:22.534348 26476 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:22.528638 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 70581.7us
I20260709 13:11:22.537652 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:22.540138 26549 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:22.542079 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.543939 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:22.544863 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.545528 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.545956 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.546370 30600 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:22.547221 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.547720 31111 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:22.548450 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.436877 31234 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.549748 30947 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.550379 30947 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:22.550872 30947 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.551306 31264 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.551581 31234 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.551867 31264 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:22.552264 31234 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.552819 31234 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.553648 31087 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:22.554013 31293 raft_consensus.cc:3055] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:22.554201 31087 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.553763 31330 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.554500 31293 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:22.554666 31087 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:22.555429 31293 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.556951 31293 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.557437 30685 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:22.542199 31168 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:22.557948 30685 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.558248 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.558455 30685 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.558633 31168 consensus_queue.cc:1059] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:22.559496 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.553668 31269 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:22.560254 31269 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.560987 26657 raft_consensus.cc:1275] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:22.550894 26625 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:22.562529 27272 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:22.563498 26654 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:22.549820 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.553185 30947 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.449968 31103 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:22.560930 31255 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.569886 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:22.578925 27278 raft_consensus.cc:2410] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:11:22.567829 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:22.526060 31112 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:22.582195 26578 raft_consensus.cc:1275] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:22.485482 31153 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.563591 31259 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:22.543617 31142 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:22.578003 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 1062) took 1336 ms. Trace:
I20260709 13:11:22.572540 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:22.583685 26654 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:22.570020 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:22.573745 26508 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:22.564023 31294 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:22.834981 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 262557us
I20260709 13:11:22.454037 31219 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:11:22.691043 31234 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.769838 31261 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:22.655839 31343 log.cc:927] Time spent T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:11:22.692420 31153 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:22.657289 31087 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.879230 31301 raft_consensus.cc:3055] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:22.879611 31087 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.879724 31301 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:22.870812 30940 consensus_queue.cc:1048] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:11:22.899042 31350 log.cc:927] Time spent T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:22.625608 31335 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:22.627966 31103 raft_consensus.cc:3055] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:22.654549 31255 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:22.591445 31075 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:11:22.710209 31269 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.630402 31111 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:22.778251 27275 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:22.924332 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:22.542539 31187 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:22.768944 31017 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.662106 27241 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:22.940414 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 278391us
I20260709 13:11:22.683358 31264 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:22.624696 27277 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:22.715093 31287 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.781961 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:22.542927 30960 consensus_queue.cc:1059] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:11:22.466831 31311 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.715346 26576 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:22.579085 30947 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:22.656134 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:22.591675 27273 rpcz_store.cc:276] 0709 13:11:21.241722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.253917 (+ 12195us) service_pool.cc:224] Handling call
0709 13:11:21.271868 (+ 17951us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:21.290443 (+ 18575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.290479 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:21.291119 (+   640us) log.cc:844] Serialized 52 byte log entry
0709 13:11:21.470280 (+179161us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:21.470532 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.572344 (+1101812us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b54007201d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:22.572402 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.572454 (+    52us) raft_consensus.cc:1685] finished
0709 13:11:22.572468 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.577933 (+  5465us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9456,"spinlock_wait_cycles":34608896,"thread_start_us":127632,"threads_started":1,"wal-append.queue_time_us":241159}
W20260709 13:11:22.643437 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 53744.8us
I20260709 13:11:22.765938 30922 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.660782 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.623806 31112 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:22.703125 31283 log.cc:927] Time spent T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 1.141s	user 0.005s	sys 0.000s
I20260709 13:11:22.659862 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:22.969776 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 401856us
W20260709 13:11:22.970016 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 431879us
W20260709 13:11:22.695873 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.848489 31347 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:11:22.576124 30600 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:11:22.536392 30917 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:11:22.639858 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:22.590138 31259 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:22.568917 31330 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.832712 27272 raft_consensus.cc:2368] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:22.834649 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.456023 30719 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:22.837052 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:22.987129 26650 raft_consensus.cc:1240] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:22.987807 30719 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:22.833709 31254 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.845486 26625 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:22.819442 31164 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.844017 30654 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:22.950994 31111 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.943713 27241 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:22.956070 26579 raft_consensus.cc:2410] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:11:22.880788 31301 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.903306 30940 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:22.961623 26582 raft_consensus.cc:2410] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:11:22.843415 31294 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.907030 31103 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:22.907584 31153 raft_consensus.cc:697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:22.968453 26549 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:22.970683 26474 connection.cc:256] RPC call timeout handler was delayed by -1.1136207559998184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 13:11:23.013219 26474 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:23.009847 26402 catalog_manager.cc:5697] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 7 to 10, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 10 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:23.013639 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 45277us
I20260709 13:11:22.953773 31109 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:22.960181 31328 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.996554 30719 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:22.978703 26652 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:22.979987 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:22.978516 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:22.992596 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 147211us
I20260709 13:11:23.031849 26503 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.033490 26625 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.026907 26474 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:22.908093 31261 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.925345 27275 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:22.996770 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 53185.2us
I20260709 13:11:23.039018 27241 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:23.040625 27241 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:22.954658 31017 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.983182 31259 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.046768 30960 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:23.048339 30960 raft_consensus.cc:2764] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:11:23.041635 31330 consensus_queue.cc:1059] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:11:23.049367 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:23.049816 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.041795 30654 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:23.026543 30901 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:23.050590 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:23.001763 31112 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:23.003119 31311 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:22.959861 31287 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.978315 31358 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:11:22.971619 31240 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:11:22.971728 30685 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:22.767818 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:23.014703 26549 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:22.974978 31247 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:11:23.027911 27271 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:22.974414 26476 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:23.061944 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 87603.7us
I20260709 13:11:23.063083 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:22.998077 31300 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:23.042109 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:23.042255 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.044834 27241 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:23.046087 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:22.972137 30922 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.016465 31301 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.054692 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:22.996081 31164 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:23.058492 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 112452us
I20260709 13:11:23.073839 26578 raft_consensus.cc:2410] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:11:23.031816 30917 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:23.068082 26476 leader_election.cc:400] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:23.068413 26655 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:23.076982 26476 leader_election.cc:403] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:11:23.026795 31273 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:11:23.050865 31257 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:23.077345 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.078202 26577 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:23.079052 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:23.081182 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 66590.6us
I20260709 13:11:23.011969 30940 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.086084 27278 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 11. Ops: []
I20260709 13:11:23.082490 26654 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:23.087446 26503 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:23.090234 26655 raft_consensus.cc:1275] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:23.097077 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:23.103480 26657 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.105147 31017 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:23.097842 27243 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:23.105734 27275 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:23.106498 31134 raft_consensus.cc:2764] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:11:23.106626 30712 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:23.107100 30712 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:23.107199 27243 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.107628 30712 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.107992 31017 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:23.108700 31017 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:23.109901 31356 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:23.112568 30685 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.070310 31311 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.113929 31311 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.115278 31287 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:23.116366 26581 raft_consensus.cc:3055] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:23.116775 26581 raft_consensus.cc:740] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:23.117578 26581 consensus_queue.cc:260] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.076715 31170 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:11:23.118593 26581 raft_consensus.cc:3060] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.119232 30940 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:23.054836 30960 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:11:23.120694 30960 raft_consensus.cc:3055] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:23.121057 30960 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:23.121935 30960 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.123380 30960 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.123538 31164 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:23.126628 31187 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.094529 30600 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:23.073222 31219 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:23.128706 30908 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:23.099699 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.033955 31328 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.069702 31112 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:23.140514 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.141487 26659 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:23.141924 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:23.143326 27241 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:23.145213 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.148007 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:23.151026 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:23.151959 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:23.077549 31347 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:23.106550 31254 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.131261 31111 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.116400 31311 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:23.130326 31300 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:23.129487 31294 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:23.177532 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.180720 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:23.181066 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:23.133929 30922 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.181996 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:23.183411 26579 raft_consensus.cc:1240] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:23.184214 31259 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.158476 26576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 829) took 1228 ms. Trace:
I20260709 13:11:23.185148 26576 rpcz_store.cc:276] 0709 13:11:21.929604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.944954 (+ 15350us) service_pool.cc:224] Handling call
0709 13:11:23.158257 (+1213303us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400021554. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:23.158400 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761217280}
I20260709 13:11:23.151763 30644 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:11:23.190280 31261 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:23.190559 30922 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:23.191156 31352 log.cc:927] Time spent T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.368s	user 0.001s	sys 0.001s
I20260709 13:11:23.165421 31170 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.192466 31111 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:23.193002 31111 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.194872 31111 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:23.196796 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.158269 26473 leader_election.cc:400] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:23.201712 26654 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.202036 26473 leader_election.cc:403] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:11:23.203136 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.203157 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:23.204073 26658 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:23.205389 26503 raft_consensus.cc:1275] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:23.213079 26549 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:23.169299 31347 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.214217 30922 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:23.214648 30922 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.214979 30922 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.215737 31347 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:23.217980 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:23.218479 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 60433us
I20260709 13:11:23.218726 26658 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:23.220237 26655 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:23.220645 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:23.220499 31358 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:23.221268 26655 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:23.221684 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:23.146881 31112 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.152977 31255 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:23.065644 31103 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.175699 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2884) took 1464 ms. Trace:
I20260709 13:11:23.250097 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:23.177532 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.094226 31248 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:11:23.222548 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:23.226841 26654 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:23.153402 27269 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:23.254637 26402 catalog_manager.cc:5697] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 5 to 6, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 6 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.250255 26509 rpcz_store.cc:276] 0709 13:11:21.710861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.713537 (+  2676us) service_pool.cc:224] Handling call
0709 13:11:21.714300 (+   763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.874142 (+159842us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:22.053484 (+179342us) log.cc:844] Serialized 14 byte log entry
0709 13:11:22.234903 (+181419us) log.cc:844] Serialized 14 byte log entry
0709 13:11:22.235135 (+   232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:22.235186 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:22.235241 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.661151 (+425910us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b1800043300. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:22.823464 (+162313us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b1800043300. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882980a2a6 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1
0709 13:11:23.174067 (+350603us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b1800043300. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882980a2a6 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419
0709 13:11:23.175450 (+  1383us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54001743d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:23.175509 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.175637 (+   128us) inbound_call.cc:177] Queueing success response
0709 13:11:23.217748 (+ 42111us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b1800043300. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
Metrics: {"prepare.queue_time_us":208812,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":2273,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":24565,"spinlock_wait_cycles":490980224,"thread_start_us":331911,"threads_started":2,"wal-append.queue_time_us":241552}
I20260709 13:11:23.227497 26581 raft_consensus.cc:1275] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:11:23.258021 26581 pending_rounds.cc:85] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 8
I20260709 13:11:23.258319 26581 pending_rounds.cc:107] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:11:23.258599 26581 raft_consensus.cc:2889] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:23.227991 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:23.170775 26657 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:23.249084 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:23.250738 26578 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:23.252737 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.262966 31259 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:23.263094 26474 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.264268 26474 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:23.264526 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 85186.5us
I20260709 13:11:23.253679 26625 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:23.255136 26508 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.256376 26402 catalog_manager.cc:5697] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 8 to 9, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 9 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.271179 26474 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.278448 26549 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:23.239403 31112 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:23.281452 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:23.229808 31358 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:23.282848 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.145524 31153 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.239205 31219 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:23.250735 31255 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:23.288113 26625 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.267012 30644 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:23.276046 31356 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:23.291337 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:23.229547 31170 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.277281 31347 raft_consensus.cc:2804] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:23.318449 26402 catalog_manager.cc:5697] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.327739 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:23.257282 31330 consensus_queue.cc:1059] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:11:23.267233 31257 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:23.289480 31075 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:23.336476 30654 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:23.345448 26402 catalog_manager.cc:5697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 7 to 8, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 8 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:23.320986 30940 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.275597 31172 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:11:23.340116 26625 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:23.282626 31254 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:11:23.331046 31356 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:23.326128 31255 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:23.282372 30825 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:11:23.329021 30644 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.356809 26402 catalog_manager.cc:5697] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 6 to 7, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 7 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.292829 31358 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.347563 31261 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:23.354535 26476 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.394645 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.329339 31219 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:23.368085 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 259711us
I20260709 13:11:23.348114 31347 raft_consensus.cc:697] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:23.372924 30719 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:23.397305 26402 catalog_manager.cc:5697] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.338958 31264 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:11:23.384263 30644 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.384990 31355 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:23.375070 31356 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:23.405104 31293 consensus_meta.cc:287] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.848s	user 0.014s	sys 0.000s
I20260709 13:11:23.367744 31075 raft_consensus.cc:697] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:23.401811 31146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.015s	sys 0.033s
I20260709 13:11:23.352171 31257 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.397279 30917 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:11:23.437724 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.339771 30922 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.365061 30940 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.411725 30719 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.407387 31261 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:23.483569 26402 catalog_manager.cc:5697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 4 to 5, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 5 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:23.446785 31146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.015s	sys 0.034s
I20260709 13:11:23.471665 26506 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:23.425886 31355 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:23.426916 30825 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:23.447419 31304 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:23.427812 31144 consensus_queue.cc:1048] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:11:23.487540 30719 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.488242 30960 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.489326 31170 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.530381 26402 catalog_manager.cc:5697] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:23.532042 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 260941us
I20260709 13:11:23.532264 26402 catalog_manager.cc:5697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:23.516201 26401 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34738 (request call id 298) took 26417 ms (client timeout 15000 ms). Trace:
I20260709 13:11:23.489759 31254 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:23.503113 31355 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:23.540870 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2315) took 1115 ms. Trace:
I20260709 13:11:23.541285 26650 rpcz_store.cc:276] 0709 13:11:22.425843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.426478 (+   635us) service_pool.cc:224] Handling call
0709 13:11:22.426713 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.987653 (+560940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.540641 (+552988us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400169c54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:23.540810 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1288259456}
I20260709 13:11:23.555977 26402 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 8 to 9, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 9 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:23.563452 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 223485us
I20260709 13:11:23.566562 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:23.574373 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.507493 30825 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.579211 27269 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:23.540373 31304 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:23.624784 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.639509 26508 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:23.562357 31335 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:23.538895 30960 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:23.654462 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 259878us
I20260709 13:11:23.522276 31347 consensus_queue.cc:237] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.586164 31364 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.657855 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.544356 31254 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.664505 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:23.665118 26508 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:11:23.665297 26476 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.666067 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:23.667122 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:23.668118 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:23.542474 31075 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.683828 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.719071 30940 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:23.674718 31364 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:23.688091 31367 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:11:23.688982 31362 log.cc:927] Time spent T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:11:23.694240 31361 log.cc:927] Time spent T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:11:23.694783 31219 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:23.533771 26401 rpcz_store.cc:269] 0709 13:10:56.872271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.880245 (+  7974us) service_pool.cc:224] Handling call
0709 13:11:23.282506 (+26402261us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:12.721333 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:12.721959 (+   626us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:12.722002 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:11:12.722018 (+    16us) tablet.cc:662] Decoding operations
0709 13:11:12.897788 (+175770us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:12.897868 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:12.897919 (+    51us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:11:12.899949 (+  2030us) tablet.cc:701] Row locks acquired
0709 13:11:12.899975 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:11:12.900172 (+   197us) write_op.cc:270] Start()
0709 13:11:12.900317 (+   145us) write_op.cc:276] Timestamp: P: 1783602672900109 usec, L: 0
0709 13:11:12.900344 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:11:12.921278 (+ 20934us) log.cc:844] Serialized 7926 byte log entry
0709 13:11:13.601652 (+680374us) op_driver.cc:464] REPLICATION: finished
0709 13:11:13.699701 (+ 98049us) write_op.cc:301] APPLY: starting
0709 13:11:13.699808 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:13.813537 (+113729us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:13.814774 (+  1237us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:14.113027 (+298253us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:14.113379 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 13:11:14.113430 (+    51us) write_op.cc:312] APPLY: finished
0709 13:11:14.113890 (+   460us) log.cc:844] Serialized 180 byte log entry
0709 13:11:14.122028 (+  8138us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:14.131808 (+  9780us) write_op.cc:454] Released schema lock
0709 13:11:14.135492 (+  3684us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:14.157663 (+ 22171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:14.183842 (+ 26179us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":533465,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":97791,"apply.run_cpu_time_us":34055,"apply.run_wall_time_us":456967,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87767,"num_ops":20,"prepare.queue_time_us":356281,"prepare.run_cpu_time_us":24855,"prepare.run_wall_time_us":485282,"raft.queue_time_us":158938,"raft.run_cpu_time_us":32008,"raft.run_wall_time_us":75893,"replication_time_us":701120,"thread_start_us":636068,"threads_started":4,"wal-append.queue_time_us":429912,"wal-append.run_cpu_time_us":20413,"wal-append.run_wall_time_us":1766305}]]}
I20260709 13:11:23.587672 31172 consensus_queue.cc:1059] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:11:23.588529 30712 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.703203 30960 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:23.703747 31358 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:23.663642 30825 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.705837 30922 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:23.707744 31254 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.658712 31335 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.545527 30917 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.581502 31261 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:23.687227 31365 log.cc:927] Time spent T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:11:23.790087 31101 raft_consensus.cc:3055] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:23.790570 31101 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:23.790817 31112 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.791491 31101 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.792177 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.793805 31112 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.660909 31304 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:23.769761 31369 log.cc:927] Time spent T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:11:23.795463 30712 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.723878 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.795596 31328 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:23.778582 31358 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.783943 31257 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:23.837700 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.847240 31219 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.826336 30960 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:23.852288 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:23.853518 26656 raft_consensus.cc:2393] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:23.823446 31168 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:23.826514 31304 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.862460 31304 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:23.856261 31219 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:23.865777 31354 log.cc:927] Time spent T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.895s	user 0.002s	sys 0.000s
I20260709 13:11:23.866168 31219 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.868347 31037 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:23.870427 31364 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.870599 31248 raft_consensus.cc:3055] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:23.871194 31248 raft_consensus.cc:740] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:23.872364 31248 consensus_queue.cc:260] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.873690 31355 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.876134 31355 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.878225 31103 raft_consensus.cc:3060] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.878757 30644 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:23.880885 30644 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.886615 26507 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:11:23.890200 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:23.891242 26508 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 8.
I20260709 13:11:23.845971 31358 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:23.917517 31255 consensus_meta.cc:287] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.001s
I20260709 13:11:23.947041 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:23.930902 30712 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:23.925115 31172 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.928335 31248 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:23.926245 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 260976us
I20260709 13:11:23.948668 26508 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:23.958281 30712 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.967978 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:23.969283 26656 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:23.960212 26476 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:23.956948 31311 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:23.973775 31101 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.973894 31311 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.976524 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:23.962051 31172 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:23.986277 26501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.001s	sys 0.016s
W20260709 13:11:23.987941 26501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.001s	sys 0.016s
I20260709 13:11:23.963388 31335 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:23.988860 26503 raft_consensus.cc:1240] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:23.949028 31255 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:23.992862 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 654) took 1425 ms. Trace:
I20260709 13:11:23.997551 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.001971 27240 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:24.001873 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:24.005333 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.006017 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.006197 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.006850 27271 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:23.993287 26501 rpcz_store.cc:276] 0709 13:11:22.567275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.567432 (+   157us) service_pool.cc:224] Handling call
0709 13:11:22.584358 (+ 16926us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:22.938691 (+354333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.938739 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:22.952762 (+ 14023us) log.cc:844] Serialized 52 byte log entry
0709 13:11:23.287106 (+334344us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:23.340413 (+ 53307us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.988344 (+647931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.988433 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.988486 (+    53us) raft_consensus.cc:1685] finished
0709 13:11:23.988503 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.992801 (+  4298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7969,"prepare.queue_time_us":50671,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2339,"raft.queue_time_us":252957,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":12954,"thread_start_us":1296647,"threads_started":3,"wal-append.queue_time_us":529407}
I20260709 13:11:24.011103 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.006029 27270 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:24.006876 27269 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:24.003633 26507 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:24.018565 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.021760 27273 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:24.020915 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.023913 26656 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:24.024549 26505 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:24.024960 27240 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:24.028884 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:24.042001 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:24.010136 31257 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:11:24.063300 31381 log.cc:927] Time spent T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:11:24.079677 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:24.080793 31387 log.cc:927] Time spent T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:11:24.081087 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.081836 27273 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:24.082899 30901 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:24.083355 30901 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:24.084327 30901 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:24.085290 30901 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:24.094224 27273 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:24.096956 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:24.097654 27278 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:24.100973 31335 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:24.101544 31335 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.102965 27271 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:11:24.081252 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:24.104270 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.025085 31368 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.116901 27278 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:24.120330 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.121312 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.122084 27273 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:24.121912 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.122501 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.125502 27278 raft_consensus.cc:2410] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:11:24.055058 31144 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:24.128228 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.113790 30644 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:24.058756 31261 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:24.130530 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:24.131201 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.133713 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.116681 26548 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:24.114725 31328 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:24.124145 31391 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:24.139226 27273 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:24.119261 31257 raft_consensus.cc:697] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:24.147679 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:24.129616 31347 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.129254 31144 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.150686 31134 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:24.139067 31261 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:24.161773 31261 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:24.161815 31134 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.164680 31134 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:24.161099 31144 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.150610 30922 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:11:24.154261 30825 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:24.141443 31358 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:24.151348 31153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.011s	sys 0.061s
I20260709 13:11:24.152518 31301 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.151648 30901 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:24.155138 31311 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:24.125298 31335 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:24.184415 31172 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:24.185322 30719 consensus_meta.cc:287] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.006s
I20260709 13:11:24.186188 31257 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.148351 31328 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.188179 31255 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:24.143057 30644 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.127574 31368 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.198966 26622 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:24.178277 30940 consensus_queue.cc:1048] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:11:24.203862 31356 consensus_meta.cc:287] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.756s	user 0.011s	sys 0.001s
W20260709 13:11:24.203737 26652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 970) took 1730 ms (client timeout 1682 ms). Trace:
W20260709 13:11:24.210527 26652 rpcz_store.cc:269] 0709 13:11:22.472963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.496460 (+ 23497us) service_pool.cc:224] Handling call
0709 13:11:24.203494 (+1707034us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400143054. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:24.203645 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106926976}
I20260709 13:11:24.161062 31347 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:24.182928 31301 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.215004 30654 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:24.201009 30719 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:24.218773 30712 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:24.238551 26650 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 12. Ops: []
I20260709 13:11:24.214694 31356 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:24.258415 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.263276 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.263582 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.265112 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.266039 26576 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:24.267457 26584 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:11:24.267976 26584 pending_rounds.cc:85] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 7
I20260709 13:11:24.268206 26584 pending_rounds.cc:107] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:11:24.268543 26584 raft_consensus.cc:2889] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:24.271258 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:24.272569 26582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 2985) took 1735 ms (client timeout 1872 ms). Trace:
I20260709 13:11:24.272755 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:24.274354 26582 rpcz_store.cc:269] 0709 13:11:22.537503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.544566 (+  7063us) service_pool.cc:224] Handling call
0709 13:11:24.266771 (+1722205us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54003dfed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:24.272482 (+  5711us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955790720}
I20260709 13:11:24.274978 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.275493 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:24.277423 30644 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:24.278016 30644 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.278482 30644 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:24.279418 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 978) took 1139 ms. Trace:
I20260709 13:11:24.279822 26654 rpcz_store.cc:276] 0709 13:11:23.139574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.141570 (+  1996us) service_pool.cc:224] Handling call
0709 13:11:24.279257 (+1137687us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b5400170cd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:24.279359 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135642880}
I20260709 13:11:24.280579 30644 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:24.280988 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 2162) took 1906 ms. Trace:
I20260709 13:11:24.281114 30644 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.281374 26580 rpcz_store.cc:276] 0709 13:11:22.374450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.374684 (+   234us) service_pool.cc:224] Handling call
0709 13:11:23.127803 (+753119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.173081 (+ 45278us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:23.173109 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:23.173150 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:23.173186 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.173249 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.280819 (+1107570us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54003d1650. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:24.280932 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44882,"raft.queue_time_us":48246,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":1731307904}
I20260709 13:11:24.282915 31347 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:24.283301 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.284042 26580 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:24.284608 26473 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:24.285033 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.286001 30644 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.286576 26578 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:24.287596 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.288262 30644 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:24.289002 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:24.290345 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.298564 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:24.300207 31109 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:24.300803 31109 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:24.301294 31109 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.303275 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.305935 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.306653 26654 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:24.308148 26652 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:24.309597 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.311120 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.312091 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:24.312808 26650 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:24.312515 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.314875 26581 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:24.316406 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:24.317473 26653 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:24.272688 30901 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.322219 30901 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.323434 26580 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:24.323765 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.324378 26656 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:24.324479 30901 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:24.325124 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.326689 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.305953 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2547) took 1104 ms. Trace:
I20260709 13:11:24.334684 27243 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:24.328863 26506 rpcz_store.cc:276] 0709 13:11:23.202644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.202852 (+   208us) service_pool.cc:224] Handling call
0709 13:11:24.305813 (+1102961us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400183dd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:24.305904 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614466816}
I20260709 13:11:24.342133 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.349596 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2900) took 1009 ms. Trace:
I20260709 13:11:24.246206 31311 consensus_queue.cc:1059] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:11:24.371901 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 2993) took 1324 ms. Trace:
I20260709 13:11:24.346889 31356 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:24.372458 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.347481 31364 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:24.372653 27243 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:24.391044 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.373258 26510 rpcz_store.cc:276] 0709 13:11:23.340237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.341042 (+   805us) service_pool.cc:224] Handling call
0709 13:11:23.341377 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.429741 (+ 88364us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:23.488046 (+ 58305us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.900587 (+412541us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.277614 (+377027us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b1800068ec0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:24.333694 (+ 56080us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b1800068ec0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f882c921060 00007f882c933716 00007f882c944287 00007f882c944208
0709 13:11:24.333898 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:24.333962 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:24.334040 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.349278 (+ 15238us) spinlock_profiling.cc:243] Waited 88.1 ms on lock 0x7b54003525d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:24.349335 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.349515 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":460197,"prepare.queue_time_us":86533,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":463209,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":12710,"spinlock_wait_cycles":261886976,"thread_start_us":401963,"threads_started":1,"wal-append.queue_time_us":372077}
I20260709 13:11:24.397333 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:24.402299 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 253922us
I20260709 13:11:24.402606 26650 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:24.406620 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:24.390730 26584 rpcz_store.cc:276] 0709 13:11:23.047206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.048748 (+  1542us) service_pool.cc:224] Handling call
0709 13:11:24.266918 (+1218170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.269426 (+  2508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.371698 (+102272us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003dfed0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:24.371836 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2800762624}
I20260709 13:11:24.381641 26582 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:24.411386 27243 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:24.399777 31111 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:24.414009 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.456074 30712 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:24.456331 26625 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:24.404960 27241 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:11:24.429343 31404 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 13:11:24.372108 30654 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:11:24.403774 31364 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:24.452956 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 301575us
I20260709 13:11:24.404933 31328 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:24.458969 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 54124.3us
W20260709 13:11:24.457322 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 46020.2us
W20260709 13:11:24.462272 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 247307us
I20260709 13:11:24.490124 26576 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:24.507571 27243 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:24.462023 30825 raft_consensus.cc:697] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:24.514838 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:24.515763 26584 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:24.519542 27241 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:24.482299 31406 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:11:24.523733 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 121587us
I20260709 13:11:24.462702 31301 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:24.470378 30712 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:24.529893 31385 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:24.530664 31385 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.531090 31385 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:24.470744 31364 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:24.549448 26650 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:24.554869 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2898) took 1217 ms. Trace:
I20260709 13:11:24.490342 31108 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:24.553447 27243 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:24.537063 30712 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:24.557740 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.584583 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.549610 31364 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:24.522575 30719 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:24.561474 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:24.574484 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.536248 31254 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:24.470640 31261 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.569751 26650 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:24.555397 26509 rpcz_store.cc:276] 0709 13:11:23.337418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.337583 (+   165us) service_pool.cc:224] Handling call
0709 13:11:23.337952 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.338184 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:23.347052 (+  8868us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.999916 (+652864us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.554433 (+554517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:24.554505 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:24.554563 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.554652 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.554798 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":568531,"prepare.queue_time_us":15199,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":99,"raft.queue_time_us":157217,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8600,"thread_start_us":646469,"threads_started":2,"wal-append.queue_time_us":511209}
I20260709 13:11:24.586606 26474 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:24.588608 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 132341us
I20260709 13:11:24.555446 31170 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:24.601184 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 129561us
I20260709 13:11:24.604635 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:24.559723 31037 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.600453 31017 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:24.621934 31037 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:24.562364 31321 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:24.623993 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 339451us
I20260709 13:11:24.609027 26625 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:24.625612 26473 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:24.627048 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:24.629886 31153 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:24.631054 31153 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:24.633508 31376 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:24.634377 31376 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:24.634999 31376 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:24.635457 31363 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:24.636910 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.634549 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2897) took 1302 ms. Trace:
I20260709 13:11:24.639318 26585 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:24.560403 31368 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:24.637452 26502 rpcz_store.cc:276] 0709 13:11:23.332134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.332349 (+   215us) service_pool.cc:224] Handling call
0709 13:11:23.332716 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.332985 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:23.345363 (+ 12378us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.925125 (+579762us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.634068 (+708943us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:24.634139 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:24.634198 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.634297 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.634479 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":714694,"prepare.queue_time_us":13092,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":2783,"raft.queue_time_us":861486,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":11353,"thread_start_us":572897,"threads_started":2,"wal-append.queue_time_us":463946}
I20260709 13:11:24.554872 31301 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:11:24.622155 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 140217us
W20260709 13:11:24.652889 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 692691us
I20260709 13:11:24.653959 26622 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:24.646152 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 85025.5us
I20260709 13:11:24.585012 30712 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:24.651208 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.656307 27273 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:24.651574 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:24.584794 31172 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:24.659425 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:24.659926 26476 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:24.660347 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:24.660799 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:24.661242 26502 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:24.661365 26504 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:24.665997 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:24.665997 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:24.633337 31330 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:24.561771 31108 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.680724 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:24.639734 31017 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:24.639564 31321 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:24.717044 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 130497us
W20260709 13:11:24.717999 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.670924 30940 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:24.639268 31255 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:11:24.702203 31112 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:11:24.670202 31103 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:24.717321 31321 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:24.715116 26504 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
W20260709 13:11:24.740962 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 81105.1us
I20260709 13:11:24.679534 31330 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:24.684302 31398 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.745467 31397 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:24.771265 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:24.670394 31335 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:11:24.679090 31172 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.744721 31255 consensus_queue.cc:1243] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:24.751245 30719 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:24.721833 30685 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:24.730118 31401 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:24.727545 31254 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.738035 30940 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.772734 26507 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:24.756371 31358 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.753554 26476 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:24.766669 31330 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:24.790920 31103 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.812105 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:24.831354 26504 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:24.774602 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:24.670300 30825 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:24.816702 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 172020us
I20260709 13:11:24.786207 31347 raft_consensus.cc:3055] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:11:24.840370 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 159771us
W20260709 13:11:24.826187 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 72717us
W20260709 13:11:24.808049 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 193913us
W20260709 13:11:24.838313 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 63831.8us
I20260709 13:11:24.841955 26476 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:24.813735 31301 raft_consensus.cc:2764] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:11:24.784528 31398 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:24.842974 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:24.845147 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.845799 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:24.817827 31401 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:24.848363 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:24.829715 31390 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:24.828661 30940 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:24.852432 26653 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:24.849000 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:24.825044 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 68167.7us
I20260709 13:11:24.824425 31392 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:24.857813 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:24.827961 31111 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:24.837460 31425 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:24.837270 30901 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:24.867192 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:24.901391 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 52573.1us
I20260709 13:11:24.843848 31397 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:24.874018 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:24.874739 26502 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:24.876117 26506 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 9. Current term is 11. Ops: []
I20260709 13:11:24.876365 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:24.908706 26509 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:24.817413 30685 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.839596 31347 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:24.848843 31168 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:24.855480 31401 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.841368 30719 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:24.903781 26622 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:24.828809 31254 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.830096 31017 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:24.832664 31358 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:24.911369 26510 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 14: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:24.837901 31103 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:24.918980 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 45737.5us
I20260709 13:11:24.857918 31037 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:24.867604 31356 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:24.868675 30917 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:24.933457 26507 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:24.937880 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:24.905800 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:24.939112 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 283793us
W20260709 13:11:24.911161 31417 log.cc:927] Time spent T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:11:24.906653 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:25.052735 26504 raft_consensus.cc:2393] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:11:24.953436 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 92436.3us
I20260709 13:11:24.953780 31450 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:24.953462 31421 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:24.957551 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:24.911526 31397 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.896108 31392 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.032140 26653 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:24.902683 31111 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.034109 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:25.066720 26503 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:25.039136 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:25.067448 26510 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
W20260709 13:11:24.939904 31144 consensus_meta.cc:287] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.774s	user 0.013s	sys 0.000s
I20260709 13:11:24.911067 30901 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.049927 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:25.055727 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 212839us
I20260709 13:11:25.032023 31108 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.070057 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:25.041051 31414 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
W20260709 13:11:25.088457 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 184739us
W20260709 13:11:25.056176 31429 log.cc:927] Time spent T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:11:24.910225 31425 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:24.911676 31432 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.163s
I20260709 13:11:25.052951 30654 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:25.092862 26622 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:25.098030 26651 pending_rounds.cc:85] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 8
I20260709 13:11:25.112427 26651 pending_rounds.cc:107] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:11:25.065038 31397 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.958253 30719 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.066092 31301 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.112751 26651 raft_consensus.cc:2889] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:25.099429 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:25.111603 30654 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:25.059028 30917 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.076084 31434 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:11:25.092808 31255 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:11:25.104820 31418 log.cc:927] Time spent T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:11:25.052464 31347 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.056648 31356 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.094048 31384 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:25.161983 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 69253us
W20260709 13:11:25.208544 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.221150 27241 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:25.229000 26653 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:25.235589 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:25.236406 27271 raft_consensus.cc:2393] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:25.237792 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:25.174479 31434 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:25.240926 31416 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:11:25.179348 31425 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:25.180761 31446 log.cc:927] Time spent T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:11:25.176673 31417 log.cc:927] Time spent T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:25.175414 31255 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:25.243505 31255 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:25.169450 31441 log.cc:927] Time spent T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
W20260709 13:11:25.169734 31248 consensus_meta.cc:287] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 1.207s	user 0.013s	sys 0.001s
W20260709 13:11:25.168869 31433 log.cc:927] Time spent T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 13:11:25.184643 31413 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.419s	user 0.000s	sys 0.001s
I20260709 13:11:25.079054 31144 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:25.186028 31423 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:11:25.169353 30654 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:25.248458 31364 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.615s	user 0.005s	sys 0.005s
I20260709 13:11:25.186872 31398 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.172583 31444 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.174717 31455 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.188313 30901 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.167950 31439 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:25.340881 31254 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:25.287108 31401 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.289769 31412 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:25.342136 31412 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.342903 31401 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:25.343114 31109 consensus_meta.cc:287] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.041s	user 0.011s	sys 0.000s
I20260709 13:11:25.343474 31109 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.344772 31255 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:25.274705 31385 consensus_meta.cc:287] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.723s	user 0.013s	sys 0.000s
W20260709 13:11:25.322960 31376 consensus_meta.cc:287] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.006s
I20260709 13:11:25.169279 31438 consensus_queue.cc:1048] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 13:11:25.263007 31384 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:25.324819 31125 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:25.295845 31429 log.cc:927] Time spent T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:11:25.199079 31301 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.329485 31364 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.339517 31356 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:25.325596 31418 log.cc:927] Time spent T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:25.349900 31109 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.394861 31412 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:25.352644 31376 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.397673 31376 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:25.399665 31364 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.403146 31172 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:25.410125 31301 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:25.411641 31384 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:25.415724 31321 consensus_meta.cc:287] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.003s
I20260709 13:11:25.416376 31321 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.421447 31321 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:25.346272 31455 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:25.419142 31330 consensus_meta.cc:287] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.003s
I20260709 13:11:25.335964 31444 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.450863 31444 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.443876 31455 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:25.491660 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.503274 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:25.505149 26501 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:25.511858 26504 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:25.514031 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:25.515527 26505 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:25.517729 26506 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:25.519619 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 666) took 1550 ms. Trace:
I20260709 13:11:25.519622 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:25.520282 26508 rpcz_store.cc:276] 0709 13:11:23.968591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.968913 (+   322us) service_pool.cc:224] Handling call
0709 13:11:23.969218 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.534982 (+565764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.535025 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.535583 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.793845 (+258262us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:24.793901 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.793988 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.519109 (+725121us) raft_consensus.cc:1685] finished
0709 13:11:25.519143 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.519421 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":673707,"raft.queue_time_us":566265,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":16695,"thread_start_us":235760,"threads_started":1,"wal-append.queue_time_us":329349}
W20260709 13:11:25.531653 26584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.001s	sys 0.004s
W20260709 13:11:25.531562 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 469383us
W20260709 13:11:25.532620 26584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.001s	sys 0.005s
I20260709 13:11:25.262460 26579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 3005) took 1001 ms. Trace:
I20260709 13:11:25.533543 26549 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:25.531792 26580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.004s	sys 0.003s
I20260709 13:11:25.536670 26581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 847) took 1271 ms. Trace:
W20260709 13:11:25.537077 26580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.004s	sys 0.003s
I20260709 13:11:25.537202 26581 rpcz_store.cc:276] 0709 13:11:24.265526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.315647 (+ 50121us) service_pool.cc:224] Handling call
0709 13:11:24.315996 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.341457 (+ 25461us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:24.524849 (+183392us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.723333 (+198484us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.730608 (+  7275us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.730852 (+   244us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:24.730909 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.731029 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.535995 (+804966us) raft_consensus.cc:1685] finished
0709 13:11:25.536169 (+   174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.536418 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49182,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":169786,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":3385,"thread_start_us":319396,"threads_started":3,"wal-append.queue_time_us":154513}
I20260709 13:11:25.534091 26579 rpcz_store.cc:276] 0709 13:11:24.260740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.262363 (+  1623us) service_pool.cc:224] Handling call
0709 13:11:24.262806 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.281868 (+ 19062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.281926 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.283655 (+  1729us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.454759 (+171104us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:24.454824 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.454917 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.262131 (+807214us) raft_consensus.cc:1685] finished
0709 13:11:25.262169 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.262367 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18642,"raft.queue_time_us":25670,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":170120,"threads_started":1,"wal-append.queue_time_us":321087}
I20260709 13:11:25.541515 26549 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:25.544205 26549 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:25.555246 26654 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:25.561405 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:25.564213 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:25.565584 26653 raft_consensus.cc:2410] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:25.567631 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:25.568557 26653 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:25.570075 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:25.574880 26655 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:25.579914 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:25.583566 26474 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:25.584026 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:25.589344 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:25.591871 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:25.592324 26651 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:25.593799 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:25.346814 27269 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
W20260709 13:11:25.601995 27273 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.010s	sys 0.003s
W20260709 13:11:25.296329 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 75319us
W20260709 13:11:25.330428 30712 consensus_meta.cc:287] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.004s
I20260709 13:11:25.339519 30719 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:25.598836 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:25.345672 30685 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.603583 30901 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.607661 31134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.014s	sys 0.020s
I20260709 13:11:25.665045 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:25.675253 27273 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.010s	sys 0.004s
I20260709 13:11:25.679376 31355 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.680644 31376 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.686139 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:25.696445 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:25.706434 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 116084us
W20260709 13:11:25.712603 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 92045.6us
I20260709 13:11:25.715247 31426 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:11:25.712385 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 103958us
I20260709 13:11:25.742987 31168 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:25.743351 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:25.744379 26548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.009s	sys 0.049s
I20260709 13:11:25.745817 31111 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:25.789856 31301 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:25.790760 31464 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.791888 27240 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:25.749655 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:25.352082 31385 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.793761 30644 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:25.794487 30644 raft_consensus.cc:697] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:25.748054 31390 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.750862 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 498569us
I20260709 13:11:25.751494 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:25.721418 31436 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:25.712922 31412 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.789321 31411 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:25.783102 31134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.015s	sys 0.021s
I20260709 13:11:25.793977 31330 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.750512 26577 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 12. Ops: []
I20260709 13:11:25.681474 31389 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:25.798228 26548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.010s	sys 0.049s
I20260709 13:11:25.790577 31301 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.791754 31464 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.815541 26579 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:25.817095 27278 raft_consensus.cc:2393] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 14: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:25.816790 30712 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.808736 31411 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.818073 31411 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:25.819473 30712 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.821941 31168 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.825094 31168 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.826768 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:25.829097 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:25.831382 31401 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:25.834010 31435 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:25.835395 31457 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:25.837949 31376 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:25.841670 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 49984.7us
I20260709 13:11:25.842551 30685 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:25.842129 31389 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.809657 31300 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.846346 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:25.847018 26474 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:25.827067 31144 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:25.803743 31436 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.861598 31412 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.862143 31398 consensus_queue.cc:1059] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:11:25.863823 31376 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:25.875694 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:25.855538 31401 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:25.865392 30685 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:25.871011 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 786513us
W20260709 13:11:25.889715 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 60857.3us
I20260709 13:11:25.879557 31457 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:25.890592 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:25.890791 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:25.890887 30940 consensus_meta.cc:287] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.996s	user 0.013s	sys 0.009s
I20260709 13:11:25.891613 30940 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.894009 31457 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:25.894646 31482 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:25.895123 31464 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.895363 31482 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:25.872901 30901 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.898422 30901 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.899533 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:25.900470 26583 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:25.901166 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:25.902715 26503 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:11:25.904098 26509 consensus_meta.cc:287] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.995s	user 0.013s	sys 0.009s
I20260709 13:11:25.904618 26509 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:25.905267 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 2909) took 1029 ms. Trace:
I20260709 13:11:25.905812 26509 rpcz_store.cc:276] 0709 13:11:24.875949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.876088 (+   139us) service_pool.cc:224] Handling call
0709 13:11:25.905155 (+1029067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:25.905551 31461 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:25.907814 31311 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:25.908185 31311 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:25.909699 31300 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.909633 31311 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.911725 31311 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:25.912124 31300 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.912926 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:25.914812 30940 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:25.915992 31457 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:25.918619 31437 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:11:25.919907 30654 consensus_meta.cc:287] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.014s
I20260709 13:11:25.922151 26622 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:25.922143 30654 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.925170 31437 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:25.934234 26654 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:25.926482 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:25.937049 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:25.937999 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:25.940850 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.942471 26476 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:25.944595 31389 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:25.884416 26585 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.951444 31437 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:25.951776 26548 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:25.953128 31443 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:25.883289 31401 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.953702 31443 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:25.954252 31443 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.885128 30685 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:25.958791 31411 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.813297 31355 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.961078 31411 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:25.961527 31355 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:25.878489 31426 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:25.963696 31426 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:25.877686 31385 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:25.871058 31436 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.964520 31443 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:25.934952 31330 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:25.937067 30719 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:25.975581 26584 pending_rounds.cc:85] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 10
I20260709 13:11:25.984848 26585 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:25.986143 26548 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:25.988517 31412 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:25.989271 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 178298us
I20260709 13:11:25.919090 31301 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:25.996495 31389 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:25.997846 31437 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:26.000560 31255 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 13:11:25.976001 26584 pending_rounds.cc:107] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:11:26.002581 26584 raft_consensus.cc:2889] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:25.896968 31482 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.006110 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:26.007090 26503 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:26.009595 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:26.010290 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:26.010784 31037 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:26.011595 31037 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:26.013998 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:26.015519 26509 raft_consensus.cc:2410] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 11 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 10.
I20260709 13:11:25.860776 30644 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.010336 26508 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:25.942502 30654 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:25.861639 31390 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.010715 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:26.001149 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.016390 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.046254 31172 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.048924 31390 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:26.050495 26506 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:26.046150 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 104007us
I20260709 13:11:26.053145 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:26.053122 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.049266 31392 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:26.012791 31037 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.070982 26503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:43670
I20260709 13:11:26.060868 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.061388 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.065426 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:26.073024 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 136232us
W20260709 13:11:26.066279 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 80407.9us
I20260709 13:11:26.072536 26659 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:26.082118 26503 raft_consensus.cc:606] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:26.082578 26503 raft_consensus.cc:614] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:26.083046 26651 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:26.084226 26652 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:26.086098 31153 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:26.086758 31153 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:26.088413 31153 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.092754 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:26.094141 31255 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:26.094866 31255 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.095744 27276 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:26.100162 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:26.101089 27275 raft_consensus.cc:2368] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:26.106222 26476 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.103065 26506 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:26.107828 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46406 (request call id 1046) took 1456 ms. Trace:
I20260709 13:11:26.108670 26476 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.111398 31261 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:26.113073 31392 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:26.114014 31392 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.114945 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:26.116779 26548 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:26.094875 31452 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.117861 31426 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:26.118321 31426 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:26.118161 31452 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.118778 31426 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:26.130185 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:26.131148 27270 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:26.131867 26622 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.132319 31437 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.108345 27278 rpcz_store.cc:276] 0709 13:11:24.651234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.651355 (+   121us) service_pool.cc:224] Handling call
0709 13:11:26.107539 (+1456184us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54006f1154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:26.107747 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2617539328}
I20260709 13:11:26.144853 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:26.145483 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.116971 31255 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.148285 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:26.149387 26576 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 10: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:26.054266 31390 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:26.153228 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:26.154132 27274 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.159598 26508 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
W20260709 13:11:26.161711 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 53146.1us
I20260709 13:11:26.155124 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:26.165859 31390 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.167004 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:26.168804 31390 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:26.169783 26503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:43670
I20260709 13:11:26.170429 26503 raft_consensus.cc:606] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.170761 26503 raft_consensus.cc:614] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:26.170921 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:26.171556 26577 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:26.172418 30917 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.144996 30654 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:26.173491 30654 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:26.173987 30654 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.139811 31452 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.203088 31443 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.150382 30922 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:26.143389 31153 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:26.204906 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 64978.2us
I20260709 13:11:26.205818 26625 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:26.180292 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:26.207640 31301 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:26.208684 31301 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.209048 31301 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.191282 31103 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.192584 30901 consensus_queue.cc:1059] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:26.216410 31466 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:26.197233 31458 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:26.217274 30901 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:26.217592 26508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:43670
I20260709 13:11:26.216436 27277 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:26.217612 31458 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.219957 31358 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.200793 31401 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.224752 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:26.202102 26476 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.227039 31101 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:26.207319 26625 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:26.213922 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 97324.2us
I20260709 13:11:26.220289 31458 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:26.198067 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 66353.2us
W20260709 13:11:26.221623 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 171802us
I20260709 13:11:26.197649 31436 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.177336 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:26.224481 27240 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:26.161808 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:26.228963 27270 raft_consensus.cc:2393] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:11:26.212371 31495 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:26.169387 31390 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:26.226873 31401 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.217761 30901 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:26.226936 30654 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.241336 30685 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.242081 31436 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:26.242492 30654 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:26.235733 30644 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.246373 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:26.246840 30685 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:26.246491 31255 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:26.247740 27240 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:26.248183 31255 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:26.248636 31255 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.250270 31452 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:26.238811 31103 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:26.250784 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:26.252131 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:26.253425 26548 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:26.253962 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:26.255069 31438 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:26.255623 31438 raft_consensus.cc:697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:26.256623 31438 consensus_queue.cc:237] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.257500 31255 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.258857 30644 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:26.259693 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 57772.3us
I20260709 13:11:26.234242 30917 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:11:26.261381 31476 log.cc:927] Time spent T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.403s	user 0.002s	sys 0.000s
I20260709 13:11:26.261878 31108 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:26.250851 31452 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:26.278796 31452 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.280202 31347 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:26.281049 31301 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.267390 26473 leader_election.cc:400] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12.
I20260709 13:11:26.273819 31461 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:26.266597 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 59377.5us
I20260709 13:11:26.262552 27273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 1047) took 1491 ms. Trace:
I20260709 13:11:26.290514 30685 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.291003 26625 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:26.291491 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:26.291219 30685 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.297638 27274 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 14.
I20260709 13:11:26.298245 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:26.285427 27273 rpcz_store.cc:276] 0709 13:11:24.770735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.773682 (+  2947us) service_pool.cc:224] Handling call
0709 13:11:24.802969 (+ 29287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:25.850003 (+1047034us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:25.850536 (+   533us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.161130 (+310594us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.177302 (+ 16172us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.233387 (+ 56085us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:26.258583 (+ 25196us) log.cc:844] Serialized 52 byte log entry
0709 13:11:26.260191 (+  1608us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:26.260436 (+   245us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.261635 (+  1199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.262242 (+   607us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.262303 (+    61us) raft_consensus.cc:1685] finished
0709 13:11:26.262318 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.262476 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77672,"prepare.queue_time_us":20891,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":123,"raft.queue_time_us":322629,"raft.run_cpu_time_us":723,"raft.run_wall_time_us":56569,"thread_start_us":1248923,"threads_started":3,"wal-append.queue_time_us":348149}
I20260709 13:11:26.282919 30654 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:26.303140 26580 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:26.306649 26474 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:26.319686 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.322806 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.310163 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:26.330369 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 102221us
I20260709 13:11:26.334964 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:26.335258 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:26.335837 26651 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.302170 31437 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:26.317891 31153 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:26.333447 31397 consensus_meta.cc:287] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.959s	user 0.008s	sys 0.005s
I20260709 13:11:26.300525 31390 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.332413 31461 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:26.344663 26476 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.328771 30654 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:26.352926 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:26.273315 30901 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.332589 31103 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:26.352851 26474 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:26.338862 31437 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.302649 31108 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.347776 31153 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:26.344084 31412 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:26.360235 26581 raft_consensus.cc:2368] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
I20260709 13:11:26.355384 30685 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.376371 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:26.360791 31103 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.364514 31437 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:26.389704 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:26.384480 26473 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:26.371666 31153 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.378607 31037 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:26.393368 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:26.382961 30917 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:26.386283 31482 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.403715 31482 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.406730 31482 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:26.409773 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:26.409904 30654 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.418346 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:26.398583 31376 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:26.420053 31376 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 14 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
W20260709 13:11:26.422019 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 97643.6us
I20260709 13:11:26.423652 26476 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:26.425062 26476 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.426226 31401 raft_consensus.cc:2764] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:11:26.427570 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 52930.8us
I20260709 13:11:26.399220 31037 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.432729 31037 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:26.438228 31499 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:11:26.439482 31393 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.501s	user 0.025s	sys 0.023s
W20260709 13:11:26.439857 31393 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.610s	user 0.025s	sys 0.023s
I20260709 13:11:26.441890 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:26.442409 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:26.443110 26504 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:26.443629 27273 raft_consensus.cc:1240] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:26.400287 31461 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.446588 26654 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 14.
I20260709 13:11:26.390293 31103 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.401846 30644 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:26.391676 31412 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.402957 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:26.360939 31397 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.451730 27240 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:26.451303 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.449826 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:26.476846 26577 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.490978 26651 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:26.448669 30901 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:26.492657 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:26.498925 27274 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:26.504669 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 75470.7us
I20260709 13:11:26.507551 27270 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 6.
I20260709 13:11:26.517805 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:26.524214 27277 raft_consensus.cc:2393] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 14: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:26.502321 31134 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:26.421227 31376 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.508417 31438 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:26.555892 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:26.522619 31301 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:26.516906 31358 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.566789 26502 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:26.542958 31389 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.550832 31134 raft_consensus.cc:697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:11:26.593988 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 142776us
I20260709 13:11:26.556932 31461 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:26.610738 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:26.567480 31438 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.615582 31438 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.620072 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:26.572992 31443 consensus_queue.cc:1059] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:11:26.615635 31153 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:26.630728 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 205733us
I20260709 13:11:26.633273 27243 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.642517 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:26.657996 26504 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:11:26.660475 27240 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:26.662034 26508 raft_consensus.cc:606] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.662504 26508 raft_consensus.cc:614] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:26.589102 31358 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.650753 31456 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:26.680765 26622 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.193:37907 timed out after 1.964s (SENT) [suppressed 20 similar messages]
I20260709 13:11:26.684181 30685 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:11:26.694202 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 65667.8us
I20260709 13:11:26.675132 31356 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:26.682099 31389 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.710117 26650 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:26.767467 27243 leader_election.cc:400] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
I20260709 13:11:26.768059 27243 leader_election.cc:403] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:11:26.772565 26577 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
W20260709 13:11:26.739921 31509 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:11:26.694809 31435 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:26.687381 31442 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:11:26.784252 31452 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:26.788411 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.790227 26659 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:26.792201 26474 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:26.793663 31390 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.794100 31392 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:26.794639 31392 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:26.795709 31392 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.796890 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.797644 26651 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:26.798012 31455 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.798791 26651 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:26.798557 31455 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.801082 31455 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:26.802109 31505 log.cc:927] Time spent T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:11:26.802366 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2153) took 1953 ms. Trace:
W20260709 13:11:26.803543 31503 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:11:26.801934 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:26.804694 26652 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:26.770308 31153 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:26.818630 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 49243.4us
I20260709 13:11:26.802835 26650 rpcz_store.cc:276] 0709 13:11:24.849079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.849222 (+   143us) service_pool.cc:224] Handling call
0709 13:11:24.869367 (+ 20145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.773467 (+1904100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.802022 (+ 28555us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54002db754. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:26.802266 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4232085376}
W20260709 13:11:26.781417 31426 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.005s
I20260709 13:11:26.827854 31426 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.831511 31426 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.832665 26576 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:26.773802 30712 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:26.779405 31412 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:26.705475 31037 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.834484 26656 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:26.850104 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:26.867574 26659 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:26.705701 31134 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.878445 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.877137 31153 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:26.886620 31153 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.883589 26650 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 8.
I20260709 13:11:26.895591 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:26.850749 30917 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:11:26.833942 31356 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.844941 31389 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:26.904508 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 223761us
I20260709 13:11:26.875662 30685 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:26.894433 31153 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.913749 26656 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:11:26.872344 31437 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:26.916393 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.918603 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.920068 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.904515 31390 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:26.884593 30712 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:26.925763 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:26.927493 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:26.926357 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:26.929041 26474 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:26.951922 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.038635 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:26.963253 26506 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:26.966293 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.987005 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.003969 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.963924 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:26.996892 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.066570 26655 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:26.935577 26652 raft_consensus.cc:2368] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13.
I20260709 13:11:26.963758 26656 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.931432 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:26.951793 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:27.065143 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 136170us
I20260709 13:11:26.983377 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.002941 31255 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:26.952194 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:26.992640 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:27.071426 26658 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:26.998435 31518 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:11:27.073753 26650 raft_consensus.cc:2410] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:11:27.045910 31524 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:11:26.926009 31368 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.976526 31452 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
W20260709 13:11:26.931213 31515 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:11:26.924845 31412 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:27.035115 30712 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:26.934453 31037 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.030005 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:26.974079 31455 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:27.057102 31523 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.044852 31356 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:26.930958 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet c46a2e31548b4665b067897f6ebe9bf9: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:26.984450 31464 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:26.977500 31301 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.998872 30825 raft_consensus.cc:3055] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:26.930296 31376 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:27.079923 26509 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:27.086536 31389 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:27.094372 30901 consensus_meta.cc:287] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.001s
I20260709 13:11:27.090847 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.104854 26655 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:27.106082 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:27.106889 26655 raft_consensus.cc:2368] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
I20260709 13:11:27.107832 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.109653 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46398 (request call id 1091) took 1873 ms. Trace:
I20260709 13:11:27.110054 27269 rpcz_store.cc:276] 0709 13:11:25.235772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.237478 (+  1706us) service_pool.cc:224] Handling call
0709 13:11:27.109268 (+1871790us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54006f2f54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:27.109460 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248967936}
I20260709 13:11:27.111557 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.111369 31376 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.112149 26653 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:27.113160 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:26.982795 30685 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.118355 31456 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:27.119279 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:27.119494 26578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 844) took 2854 ms (client timeout 2591 ms). Trace:
W20260709 13:11:27.119913 26578 rpcz_store.cc:269] 0709 13:11:24.264631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.287360 (+ 22729us) service_pool.cc:224] Handling call
0709 13:11:27.119132 (+2831772us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b5400076cd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:27.119276 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5374368000}
I20260709 13:11:27.092854 31455 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:27.121897 31455 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.126109 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.127846 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2911) took 2215 ms. Trace:
W20260709 13:11:27.128544 31103 consensus_meta.cc:287] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.002s
I20260709 13:11:27.103636 31108 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:27.098796 31464 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:26.964782 31358 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:27.072773 30917 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:26.925864 31393 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 13:11:27.096808 27271 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:27.097620 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:27.098731 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.134552 31301 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.137920 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:27.140524 26509 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:27.140832 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.140698 31464 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.146289 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.147482 27271 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:27.147864 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:11:27.150313 31520 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.188s	user 0.001s	sys 0.002s
I20260709 13:11:27.099983 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:26.935992 31461 consensus_queue.cc:1059] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.156s
I20260709 13:11:27.144037 31464 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.151911 31437 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:27.152956 31376 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.153834 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.147691 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:27.156819 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.087260 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 109695us
I20260709 13:11:26.977437 30654 consensus_queue.cc:1059] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 13:11:27.101362 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:26.925814 31153 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.164s
I20260709 13:11:27.102101 30825 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:27.131932 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.162364 26505 raft_consensus.cc:2393] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 13: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:27.164106 26577 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:27.183234 26651 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:27.119865 26654 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.167095 26655 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
W20260709 13:11:27.150483 31513 log.cc:927] Time spent T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:11:27.181346 26509 raft_consensus.cc:2468] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:27.185873 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.169440 26504 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:27.173501 27274 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:27.177016 26658 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:27.155794 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.182255 26656 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
W20260709 13:11:27.169780 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99631.7us
I20260709 13:11:27.128249 26502 rpcz_store.cc:276] 0709 13:11:24.912815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.919531 (+  6716us) service_pool.cc:224] Handling call
0709 13:11:24.919940 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.596287 (+1676347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.127564 (+531277us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54001833d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:27.127763 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3644775680}
I20260709 13:11:26.953953 31390 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.191830 26658 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:27.194660 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.197270 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:27.198848 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.202114 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.203050 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.203104 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:27.203624 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:27.132537 30917 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:27.202316 27269 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:27.209206 27241 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.101249 31523 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.209172 26582 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:27.214213 26474 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:27.210736 26501 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:27.209820 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.095634 31368 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.228606 26577 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:27.199790 31301 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:27.207808 31347 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:27.232275 31261 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:27.233287 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 159473us
I20260709 13:11:27.246040 27241 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:27.244978 31356 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:27.249897 31356 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:27.250362 31356 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.229911 31438 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:27.251129 31438 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.252143 31261 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.252590 31261 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:27.229735 31389 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:27.254115 31389 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:27.253756 30825 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.255209 31389 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.215663 30917 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:27.128973 31103 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:27.241601 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 74706us
I20260709 13:11:27.260726 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:27.250264 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 64478.9us
I20260709 13:11:27.251554 27241 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.237154 26549 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:27.262133 26510 raft_consensus.cc:1240] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 14 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:27.264014 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.264364 31103 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:27.265163 26503 raft_consensus.cc:1240] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:11:27.272539 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.273397 26508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43670 (request call id 2) took 1050 ms. Trace:
I20260709 13:11:27.273844 26508 rpcz_store.cc:276] 0709 13:11:26.216199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.217422 (+  1223us) service_pool.cc:224] Handling call
0709 13:11:27.266520 (+1049098us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54003539d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c923853 00007f88318f160a 00007f882ae777d4 00007f882ae77762 00007f882ae77691 00007f882ae7760c 00007f882ae768c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:27.266630 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020396800}
I20260709 13:11:27.277709 26622 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.279742 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.279812 31528 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:11:27.246259 31347 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:27.283870 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.291667 27241 leader_election.cc:400] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10.
I20260709 13:11:27.288738 31261 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.285540 26579 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:27.286545 31108 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:27.286600 31528 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:27.287180 31412 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:27.290189 27274 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:27.284785 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 47705.3us
I20260709 13:11:27.292716 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 858) took 1037 ms. Trace:
I20260709 13:11:27.299743 26580 rpcz_store.cc:276] 0709 13:11:26.243483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.243653 (+   170us) service_pool.cc:224] Handling call
0709 13:11:27.281162 (+1037509us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b54000d9b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:27.281297 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128390400}
I20260709 13:11:27.302848 31528 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:27.293766 31347 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:27.303316 31528 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:27.260282 31438 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:27.302028 31108 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.268709 31134 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:27.293700 26654 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:27.309808 26502 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:27.319281 27241 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:27.292479 31385 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:27.262794 31455 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.328644 27241 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.334458 26657 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:11:27.335321 31421 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:27.335367 31134 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:27.326115 31458 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:11:27.348438 26502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:43670
I20260709 13:11:27.349339 27274 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:27.335832 31421 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.353704 26652 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:27.358862 31437 raft_consensus.cc:3055] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:27.359316 31437 raft_consensus.cc:740] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:27.360204 31437 consensus_queue.cc:260] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.365682 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.372018 26577 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:27.327855 31385 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:27.373253 31385 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:27.374981 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.377691 31364 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:27.378149 31364 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:27.378531 31364 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.328044 31426 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:11:27.364056 31421 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:27.391927 31103 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:27.413669 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.417055 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.402509 31437 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:27.433758 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99504.6us
I20260709 13:11:27.437184 27275 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:27.419435 31455 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:27.443698 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.451254 26510 raft_consensus.cc:2393] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 14: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:27.427770 31261 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.461800 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.462791 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.462920 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.463449 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:27.465808 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 188219us
I20260709 13:11:27.468459 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.469117 31328 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:27.474516 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.475147 26583 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:27.477452 26476 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.478158 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.478658 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.432709 31390 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.480818 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.482473 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.482187 31328 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.484553 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.485942 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.487114 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.488247 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.491142 27243 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:27.491823 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.493590 31017 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:27.493896 31261 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:27.494285 31261 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:27.494167 31134 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:27.494848 31017 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:27.495220 31108 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.495352 31017 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:27.496286 31017 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.497704 31017 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.489362 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.500123 31368 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.422325 31103 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.425136 31528 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.504621 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.506944 26578 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:27.493008 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.504436 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.508236 26577 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:27.474448 31523 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.494844 31261 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:27.515426 26622 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:27.521075 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 43733.1us
I20260709 13:11:27.516443 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.527602 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.528779 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.530002 26476 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.522136 31539 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.535663 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.504022 31356 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.536803 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.537241 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:27.538422 27275 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:27.519876 31376 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:27.558367 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.560076 26502 raft_consensus.cc:606] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.555183 31356 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.577764 31401 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.578068 26476 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:27.579325 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 64009.9us
I20260709 13:11:27.579989 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.560477 26502 raft_consensus.cc:614] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:27.561154 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.538679 26510 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:27.581225 26505 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 15: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:27.562734 31532 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.530844 31390 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.563498 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.564747 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.569507 26579 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:27.571203 31528 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:27.571431 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.573698 31347 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:27.574982 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.575590 31364 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.585613 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.588320 26510 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 16: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:27.589035 26506 raft_consensus.cc:2393] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 14: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:27.589318 31364 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.589056 31523 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:27.590005 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.591373 26622 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.591796 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.584952 26583 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:27.587169 26476 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.593847 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:27.595815 26577 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:27.597036 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.597602 26508 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:27.558450 31103 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:27.596876 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.602677 26583 raft_consensus.cc:3055] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:27.603138 26583 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:27.604176 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 67037us
I20260709 13:11:27.586880 31539 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:27.592553 31368 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:27.613145 26476 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:27.598558 31153 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:27.598424 31455 raft_consensus.cc:2804] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:27.622241 31455 raft_consensus.cc:697] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:27.621249 31397 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:27.616873 31461 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:11:27.620591 26583 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.611614 31539 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:27.600924 31544 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:27.609529 31528 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:27.628504 31528 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:27.619163 31390 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:27.629593 31390 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.629945 31390 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:27.631245 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:27.632361 26501 raft_consensus.cc:2368] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13.
I20260709 13:11:27.630172 26583 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:27.633773 31539 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.643175 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.643513 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:27.646211 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 7fdbcbb3a7ce412c93c07413fe11793f: Illegal state: Replica b9c3761688a64982ae1c4aeb758e09ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:27.646368 27241 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.647900 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.648450 27241 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:27.649029 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:27.649217 31328 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:27.649852 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:27.650733 26659 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:27.653510 26655 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:27.654758 26653 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:27.655076 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.656553 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:27.657282 26510 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:27.657541 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.658289 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 691) took 1212 ms. Trace:
I20260709 13:11:27.658463 26656 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 16.
I20260709 13:11:27.659736 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.660560 26508 raft_consensus.cc:2410] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:27.650090 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:27.654906 26655 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:27.661522 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:27.661975 31364 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:27.662218 30719 raft_consensus.cc:3055] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:27.662649 31364 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.663093 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.662712 30719 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:27.663548 31364 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:27.658671 26503 rpcz_store.cc:276] 0709 13:11:26.446099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.448471 (+  2372us) service_pool.cc:224] Handling call
0709 13:11:26.476943 (+ 28472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.265621 (+788678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.658055 (+392434us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540027e2d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:27.658233 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812170624}
I20260709 13:11:27.664454 30719 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.665683 30719 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:27.666810 26508 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:27.667994 31108 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:27.668563 31108 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:27.669525 31108 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.656610 26653 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:27.672254 26657 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.663733 26509 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:27.674121 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:27.660435 26579 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:27.676918 26579 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:27.677800 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 72775us
I20260709 13:11:27.683641 31456 raft_consensus.cc:3055] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:27.684326 31456 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:27.686232 31528 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.694012 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.694060 31301 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:27.695590 31461 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:27.696180 31461 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:27.697767 31438 raft_consensus.cc:3055] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:27.698197 31438 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:27.697443 31461 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.698939 31438 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.700104 31438 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.704533 31261 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:27.723218 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 49425.5us
I20260709 13:11:27.723764 31261 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.725009 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.725425 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:27.726241 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 108788us
I20260709 13:11:27.727422 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.729018 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.729907 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:27.730942 27273 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:27.732049 27240 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:27.735587 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:27.736217 31134 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.706414 26502 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:27.737385 27240 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.738817 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:27.707232 30917 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.740091 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.623620 31455 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.742453 26507 raft_consensus.cc:2393] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 9: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:27.714505 26509 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:11:27.715521 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.677515 26579 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.746513 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:27.717893 26474 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.747151 26509 raft_consensus.cc:2376] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12. Re-sending same reply.
I20260709 13:11:27.748270 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:27.748781 31368 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.749010 26509 raft_consensus.cc:2393] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 13: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:27.749555 31368 consensus_queue.cc:1059] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:27.716154 31347 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:27.719668 31421 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.769415 26510 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:27.770498 26504 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:11:27.721426 31461 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:27.729213 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.733716 30825 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:27.695617 26582 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:27.780745 26502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:43670
I20260709 13:11:27.781885 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.782160 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:27.700953 31385 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.747159 26579 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.714064 31456 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.735702 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:27.790829 27273 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:27.752745 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:27.719259 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.752964 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:27.753928 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 80362.9us
I20260709 13:11:27.794421 27241 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.754415 26549 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:27.755481 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.668043 26508 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:27.759276 26658 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:27.752116 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.762794 26657 raft_consensus.cc:2468] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:27.800000 26659 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:27.763322 26583 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:11:27.784451 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.786204 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.789072 26548 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:27.733268 31539 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.801146 26583 pending_rounds.cc:85] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 8
I20260709 13:11:27.804122 26549 leader_election.cc:400] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13.
I20260709 13:11:27.804919 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:27.806041 26583 pending_rounds.cc:107] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:11:27.806157 26549 leader_election.cc:403] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:11:27.806612 26583 raft_consensus.cc:2889] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.806849 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.807612 26584 raft_consensus.cc:2368] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14.
W20260709 13:11:27.779613 31464 consensus_meta.cc:287] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.002s
I20260709 13:11:27.767802 31134 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:27.806612 26653 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:11:27.768194 31392 raft_consensus.cc:3055] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:27.814651 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:27.822410 27274 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:27.811419 27241 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:27.824450 26502 raft_consensus.cc:606] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:27.824937 26502 raft_consensus.cc:614] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:27.826071 26651 raft_consensus.cc:1240] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:27.800364 31544 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:11:27.828433 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 76391.5us
I20260709 13:11:27.843740 31442 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:27.828435 26549 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:27.814356 31134 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.814865 31392 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:27.851689 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:27.851434 26476 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.822446 30901 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:27.846189 31464 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.811282 31390 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:27.845963 30917 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:27.844825 31458 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13.
I20260709 13:11:27.878448 26507 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:27.853215 31134 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:27.895219 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 174234us
I20260709 13:11:27.869182 26476 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:27.850258 31528 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:27.900292 31528 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.850610 31261 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:27.903759 31528 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:27.905174 31397 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:27.907905 26625 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:27.909543 31397 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:27.911064 31528 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:27.911824 31528 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:27.911947 26476 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:27.913074 31528 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.918022 31397 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:27.918999 31397 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:27.920672 31397 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:27.922920 31347 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:27.928531 26659 raft_consensus.cc:1240] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:11:27.931457 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:27.846903 31426 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:11:27.938642 26505 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 14: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:27.864732 31401 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:27.876893 31144 raft_consensus.cc:2804] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:27.961443 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.987778 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:27.988817 26652 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:27.938201 30901 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:28.014070 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:28.018826 26507 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:27.864202 31541 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.133s
W20260709 13:11:28.026420 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.960348 30917 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:27.991590 31542 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:28.043516 26650 raft_consensus.cc:1240] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:28.044404 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:27.998450 31533 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.991979 31347 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:28.002610 31144 raft_consensus.cc:697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:28.043015 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:28.055195 26652 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:28.060158 26507 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:28.046751 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 291327us
I20260709 13:11:28.010188 30901 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:28.052852 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.063292 27240 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:28.065267 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:28.066008 26551 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.029706 31257 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:28.046790 31458 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.070950 26622 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.077829 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.081601 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.084558 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:27.958668 31392 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.062002 30901 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:27.998660 31248 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.280s
I20260709 13:11:28.068773 31539 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:28.103456 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 275086us
I20260709 13:11:28.071406 31257 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.079610 31482 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.103392 30719 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:28.091930 27240 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.074450 31455 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:28.117134 30719 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:28.107718 31544 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:28.063275 30917 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.087728 31437 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:28.139441 26579 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:28.063863 31533 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.102777 31356 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.088297 31421 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.137820 30719 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.163133 30719 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:28.075809 31347 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.102699 31261 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:28.116937 31257 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:28.101982 31017 consensus_queue.cc:1059] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:11:28.088387 31458 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.142266 31392 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.140444 31385 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.144038 31437 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:28.163745 31376 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:28.167416 31261 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.187955 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:28.194844 26655 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:28.167959 31564 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:28.196332 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 99759.1us
I20260709 13:11:28.202178 26622 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.202435 31347 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:28.185405 31421 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 13:11:28.206758 31551 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:11:28.208544 31458 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.185619 31437 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:28.196378 31261 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:28.213941 30719 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.180338 31390 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:28.215953 26658 raft_consensus.cc:1240] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:11:28.227783 26655 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:28.168639 31248 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:11:28.164281 31356 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.232369 27271 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:28.239148 30719 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:28.213792 31385 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:11:28.242797 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 431469us
W20260709 13:11:28.234664 31549 log.cc:927] Time spent T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:11:28.263831 27241 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.164359 31144 consensus_queue.cc:237] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.215476 31564 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.271685 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:28.273103 31564 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:28.273758 31544 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.275828 31356 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:28.235526 31539 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:11:28.284683 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.218699 31426 consensus_queue.cc:1059] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:11:28.230611 31376 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:28.268514 31364 consensus_meta.cc:287] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.604s	user 0.015s	sys 0.000s
I20260709 13:11:28.283854 27241 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:28.289765 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 198869us
I20260709 13:11:28.260538 31458 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:28.289712 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 87609.5us
I20260709 13:11:28.266927 31552 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:28.230074 31567 consensus_queue.cc:1059] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:11:28.280069 31558 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:28.267264 31385 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:28.296314 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:28.297396 26622 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.297058 26549 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:28.316999 31533 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:28.318123 31567 raft_consensus.cc:3055] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:28.318526 31567 raft_consensus.cc:740] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:28.319262 31567 consensus_queue.cc:260] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.320451 31567 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:28.325182 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.321853 31557 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:28.321514 30825 consensus_meta.cc:287] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.531s	user 0.002s	sys 0.005s
I20260709 13:11:28.330292 31563 raft_consensus.cc:3055] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:28.330746 31563 raft_consensus.cc:740] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:28.331635 31563 consensus_queue.cc:260] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.332715 31563 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.296988 31108 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:28.300359 31542 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:11:28.351409 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 49476.6us
I20260709 13:11:28.294814 31364 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.340014 31569 raft_consensus.cc:2804] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:28.358541 31569 raft_consensus.cc:697] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:28.359697 31569 consensus_queue.cc:237] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.354061 31257 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.297170 31458 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:28.350507 31438 consensus_meta.cc:287] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.002s
W20260709 13:11:28.366104 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 70138.8us
I20260709 13:11:28.371346 26585 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:28.372994 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.374235 30917 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:28.377967 26473 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:28.379405 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:28.380726 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:28.352735 31558 raft_consensus.cc:697] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:28.355440 31542 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:28.387110 26504 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:28.386139 31571 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:28.381179 31579 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:11:28.405876 31455 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:28.386564 31558 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.406587 31455 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:28.393962 31547 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.550s	user 0.002s	sys 0.005s
I20260709 13:11:28.383173 31564 raft_consensus.cc:2764] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:11:28.410043 26504 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:28.381546 31533 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:28.408609 31455 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:28.396904 31552 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:28.398483 31376 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.420491 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:28.421314 31458 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:28.415366 31261 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:28.422430 26548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.015s
W20260709 13:11:28.422732 26548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.000s	sys 0.015s
W20260709 13:11:28.423218 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 571583us
I20260709 13:11:28.423818 31261 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.424676 26657 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:28.425743 31464 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.003s
I20260709 13:11:28.425910 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:28.426440 31464 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:28.427099 26504 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:28.381584 30917 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:28.398921 31565 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:11:28.415762 31442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.009s	sys 0.005s
I20260709 13:11:28.396997 31557 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:28.418216 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45344.3us
I20260709 13:11:28.438349 26622 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.424062 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:28.416443 26508 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:28.439597 26507 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:28.383490 31390 consensus_queue.cc:1059] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:11:28.453801 31390 raft_consensus.cc:3055] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:28.454245 31390 raft_consensus.cc:740] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:28.455200 31390 consensus_queue.cc:260] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.456517 31390 raft_consensus.cc:3060] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.418239 31257 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.458799 31364 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:28.445688 31581 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.128s	user 0.001s	sys 0.002s
I20260709 13:11:28.436162 31565 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:28.460520 31565 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.461879 31565 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:28.463609 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.464990 26474 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:28.467491 31560 log.cc:927] Time spent T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
W20260709 13:11:28.468852 31134 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:11:28.469511 31542 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.471065 31542 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.471670 26502 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:28.473908 31482 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:28.474195 31533 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:28.475638 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:28.477126 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:28.478003 30917 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:28.478397 30917 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.478716 30917 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:28.411171 31385 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.484073 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:11:28.484545 31578 log.cc:927] Time spent T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.162s	user 0.001s	sys 0.001s
W20260709 13:11:28.487330 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 49102.1us
I20260709 13:11:28.488073 26622 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.447640 30901 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.490913 30654 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:28.492859 30917 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:28.494010 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 70010.8us
W20260709 13:11:28.500509 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.440052 31442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.010s	sys 0.005s
I20260709 13:11:28.506415 27274 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:28.516566 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:28.516710 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2579) took 1005 ms. Trace:
I20260709 13:11:28.516813 26510 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:28.522567 26658 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:28.520372 26505 rpcz_store.cc:276] 0709 13:11:27.514352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.654829 (+140477us) service_pool.cc:224] Handling call
0709 13:11:28.516501 (+861672us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400194e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:28.516654 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649883520}
I20260709 13:11:28.532049 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:28.533073 27274 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:28.533238 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:28.534046 26654 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:28.539925 26658 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:28.542038 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:28.546753 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:28.550282 31376 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:28.554787 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:28.555502 27274 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:28.508101 31533 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:11:28.560520 31464 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:28.562407 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 788) took 1193 ms. Trace:
I20260709 13:11:28.517549 31552 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:28.526405 31587 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:28.563043 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:28.562844 27269 rpcz_store.cc:276] 0709 13:11:27.380467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.380643 (+   176us) service_pool.cc:224] Handling call
0709 13:11:27.398017 (+ 17374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:27.407678 (+  9661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.407724 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:27.424683 (+ 16959us) log.cc:844] Serialized 52 byte log entry
0709 13:11:27.562309 (+137626us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:27.598036 (+ 35727us) log.cc:844] Serialized 14 byte log entry
0709 13:11:27.722041 (+124005us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b1800414e20. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:27.874767 (+152726us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b1800414e20. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f88303213c7 00007f882c9339a7 00007f882c9430bf 00007f882c943038
0709 13:11:27.874972 (+   205us) log.cc:844] Serialized 14 byte log entry
0709 13:11:27.877424 (+  2452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.877511 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.393643 (+516132us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b24000c90f8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f88296c29c4 00007f88296c0acb 00007f882987bdc9 00007f882987ba55 00007f882987b09d 00007f882c4ad10e 00007f882c4c488c 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221
0709 13:11:28.562185 (+168542us) raft_consensus.cc:1685] finished
0709 13:11:28.562214 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.562350 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":259922,"prepare.queue_time_us":311739,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":72,"raft.queue_time_us":20420,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":46866,"spinlock_wait_cycles":72912512,"thread_start_us":88013,"threads_started":1,"wal-append.queue_time_us":353711}
I20260709 13:11:28.510593 31563 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:11:28.579475 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.489042 31134 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:28.592017 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.595741 26652 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:28.595983 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:28.591140 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2580) took 1065 ms. Trace:
I20260709 13:11:28.571549 31442 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:28.546051 31458 consensus_queue.cc:1059] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:11:28.555787 31565 consensus_queue.cc:1059] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:11:28.564414 31438 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:11:28.556182 31544 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:11:28.571430 31587 raft_consensus.cc:697] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:28.609323 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:28.620452 26654 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:28.570027 31577 consensus_queue.cc:1059] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:11:28.650758 27269 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:28.605690 26503 rpcz_store.cc:276] 0709 13:11:27.525757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.334259 (+808502us) service_pool.cc:224] Handling call
0709 13:11:28.334608 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:28.334915 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.334942 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:28.335370 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.367584 (+ 32214us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:28.581410 (+213826us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.581754 (+   344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.581841 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.581892 (+    51us) raft_consensus.cc:1685] finished
0709 13:11:28.581903 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.591023 (+  9120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12500,"prepare.queue_time_us":36145,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":8318,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":5838,"thread_start_us":211647,"threads_started":2,"wal-append.queue_time_us":54235}
I20260709 13:11:28.588096 31569 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:11:28.595312 30654 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:11:28.622283 31461 consensus_meta.cc:287] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.831s	user 0.012s	sys 0.000s
I20260709 13:11:28.666801 27274 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:28.667202 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:28.667448 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:28.606207 31557 consensus_queue.cc:1059] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:11:28.667858 27273 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 14.
I20260709 13:11:28.680956 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:28.681972 27273 raft_consensus.cc:2393] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:28.682796 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:28.679721 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:28.689065 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:28.648980 31364 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:28.691287 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:28.697178 26505 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:28.694278 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:11:28.673763 31584 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:28.665470 31442 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:28.742503 27278 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 9. Current term is 11. Ops: []
W20260709 13:11:28.747370 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 151462us
I20260709 13:11:28.748550 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:28.749995 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:28.751924 30917 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.684037 31392 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:11:28.752803 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:28.753290 26548 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:28.693737 31438 consensus_queue.cc:1243] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer af1b5d6d444447b7a580afb4aff33320 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:11:28.754313 31589 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:11:28.753925 31587 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.754587 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:28.740688 31533 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:28.739610 31571 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:28.696646 31261 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:11:28.696650 31466 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
W20260709 13:11:28.793365 31437 consensus_meta.cc:287] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.001s
I20260709 13:11:28.697283 31542 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:11:28.814455 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:28.788520 31248 raft_consensus.cc:3055] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:28.816294 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:28.784096 31533 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.815229 31571 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.818012 26505 raft_consensus.cc:2468] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:11:28.731316 31364 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.793507 30901 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.810331 31442 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:28.830776 30719 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:28.831171 30719 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:28.825778 31533 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:28.833092 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2570) took 1409 ms. Trace:
I20260709 13:11:28.834304 26509 rpcz_store.cc:276] 0709 13:11:27.428799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.749695 (+320896us) service_pool.cc:224] Handling call
0709 13:11:27.749969 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.750220 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:28.800899 (+1050679us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b1800490ea0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882c4d14bc 00007f882981f48b 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f8829839455 00007f88303213c7 00007f882c9339a7 00007f882c93c5e5
0709 13:11:28.801063 (+   164us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.829365 (+ 28302us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.829681 (+   316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:28.829744 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:28.832839 (+  3095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.832909 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.833036 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":185397,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":3154,"raft.queue_time_us":658,"spinlock_wait_cycles":32324352,"thread_start_us":266811,"threads_started":2}
I20260709 13:11:28.835827 27240 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:28.831895 31558 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.837327 31558 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.839195 31571 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.839558 31558 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.841739 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:28.842494 26656 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:28.841926 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2942) took 1107 ms. Trace:
I20260709 13:11:28.820300 31248 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:28.819867 31437 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.843778 26504 rpcz_store.cc:276] 0709 13:11:27.734557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.437757 (+703200us) service_pool.cc:224] Handling call
0709 13:11:28.438134 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:28.441419 (+  3285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.441454 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:28.496954 (+ 55500us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.666137 (+169183us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:28.695010 (+ 28873us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.695299 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.695368 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.841658 (+146290us) raft_consensus.cc:1685] finished
0709 13:11:28.841682 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.841871 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29953,"prepare.run_cpu_time_us":3014,"prepare.run_wall_time_us":12716,"raft.queue_time_us":1056,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":1230,"spinlock_wait_cycles":8041728,"thread_start_us":104136,"threads_started":1,"wal-append.queue_time_us":217057}
I20260709 13:11:28.846400 31558 raft_consensus.cc:2804] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:11:28.864038 31554 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.696s	user 0.000s	sys 0.003s
I20260709 13:11:28.864136 31558 raft_consensus.cc:697] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:28.865264 31558 consensus_queue.cc:237] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.849071 26508 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:11:28.869817 26508 pending_rounds.cc:85] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 7
I20260709 13:11:28.870123 26508 pending_rounds.cc:107] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:11:28.870398 26508 raft_consensus.cc:2889] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:28.853770 31600 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:28.872644 26625 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.873678 31437 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:28.856177 31364 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:28.875664 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 121145us
W20260709 13:11:28.837486 31590 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:11:28.856773 31591 log.cc:927] Time spent T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:11:28.827087 31544 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:28.828161 31577 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:28.862079 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:28.880439 26548 leader_election.cc:400] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13.
I20260709 13:11:28.886044 26548 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:28.887328 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:28.887367 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:28.889806 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:28.890211 31442 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:28.889850 31604 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:28.891017 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:28.891466 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:28.892256 26580 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:28.893339 31442 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:28.893894 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:28.894021 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:28.894922 31442 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:28.896412 26548 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:28.889297 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:28.898715 31421 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:28.899577 31558 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:28.902398 26509 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 11: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:28.874291 31438 raft_consensus.cc:3055] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:28.904333 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:28.905494 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.906702 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:28.907838 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:28.908365 26509 raft_consensus.cc:3060] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:28.884145 31385 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:11:28.914340 31103 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.917734 31390 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.918000 31103 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.918366 31390 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.920230 31103 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.920930 31390 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.923352 27243 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:28.905941 31438 raft_consensus.cc:740] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:28.874220 31248 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.881898 31533 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.916359 30917 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.939651 31577 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:11:28.942904 31577 raft_consensus.cc:3055] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:28.943336 31577 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:28.944424 31577 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.947278 31577 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:28.930927 31559 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:28.911247 31600 consensus_queue.cc:1059] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:11:28.958559 31604 consensus_queue.cc:1059] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:11:28.963181 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 697) took 1495 ms. Trace:
W20260709 13:11:28.976303 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.961196 26580 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:28.974509 26509 raft_consensus.cc:2468] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:28.978341 27243 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:28.980461 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:28.976655 26510 rpcz_store.cc:276] 0709 13:11:27.467545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.815692 (+348147us) service_pool.cc:224] Handling call
0709 13:11:28.516636 (+700944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.521454 (+  4818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.962961 (+441507us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400194e50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:28.963116 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611040512}
I20260709 13:11:28.961848 31017 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:28.982365 31017 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:28.982832 31438 consensus_queue.cc:260] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:28.984169 31438 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.954764 31482 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:28.984700 31017 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.990084 31385 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:11:28.964521 30917 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:29.000174 31575 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.638s	user 0.003s	sys 0.000s
I20260709 13:11:29.000276 30917 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:28.979099 31544 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:11:29.001538 27271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 1066) took 1275 ms. Trace:
I20260709 13:11:29.013195 31567 raft_consensus.cc:3055] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:29.013919 31567 raft_consensus.cc:740] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:29.002019 26510 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:11:29.015355 26510 pending_rounds.cc:85] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 7
I20260709 13:11:29.015607 26510 pending_rounds.cc:107] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:11:29.015869 26510 raft_consensus.cc:2889] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:29.015910 31553 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.852s	user 0.000s	sys 0.008s
I20260709 13:11:29.019770 31134 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:29.021524 31533 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:29.022029 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:29.023701 31438 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.023898 31456 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.025827 27275 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:11:29.014700 31567 consensus_queue.cc:260] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:29.032307 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 51964.2us
I20260709 13:11:29.008488 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:29.002559 26507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2576) took 1505 ms. Trace:
I20260709 13:11:29.013340 27271 rpcz_store.cc:276] 0709 13:11:27.726532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.728332 (+  1800us) service_pool.cc:224] Handling call
0709 13:11:27.728616 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.237390 (+508774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.001298 (+763908us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400845dd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:29.001482 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158018944}
I20260709 13:11:29.050601 26503 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:29.040692 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:29.029321 31588 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:11:29.053581 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.054706 26578 raft_consensus.cc:3055] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:29.054512 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:29.057351 27272 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.050786 26507 rpcz_store.cc:276] 0709 13:11:27.497226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.289543 (+792317us) service_pool.cc:224] Handling call
0709 13:11:28.300630 (+ 11087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.440142 (+139512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.002339 (+562197us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54002fb7d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:29.002504 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319159680}
I20260709 13:11:29.053465 26580 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:11:29.058863 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:29.056761 26578 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:29.059478 27243 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:29.061551 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:29.061650 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.062462 26476 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.005728 31559 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:29.062532 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:29.060797 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.064002 26476 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.064491 26578 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.066576 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:29.050611 31577 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:29.069761 26503 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:29.086607 31426 raft_consensus.cc:3055] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:29.087237 31426 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:29.087478 26503 raft_consensus.cc:1240] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:29.088124 31426 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.070217 31108 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:29.089280 31108 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:29.070387 31464 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:29.066244 31356 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:29.074434 26578 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:29.053655 31438 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.076083 31559 raft_consensus.cc:697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:29.076747 31017 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:29.078212 26505 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:29.078588 31248 raft_consensus.cc:3060] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:29.065135 31571 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.129209 31606 raft_consensus.cc:3055] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:29.129667 31606 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:29.130131 31438 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:29.081485 27272 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15.
I20260709 13:11:29.083997 31567 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:29.084465 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2565) took 1706 ms. Trace:
I20260709 13:11:29.105063 26510 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:29.123737 26476 leader_election.cc:400] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14.
I20260709 13:11:29.135228 26476 leader_election.cc:403] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:29.100476 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:29.109122 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 2213) took 1356 ms. Trace:
I20260709 13:11:29.105472 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.100119 26501 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:29.105755 26579 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:11:29.124694 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.104005 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:29.102677 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.126838 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 60686.5us
I20260709 13:11:29.142853 26548 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:29.130478 31606 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:29.146512 31606 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.132639 26506 rpcz_store.cc:276] 0709 13:11:27.378561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.669147 (+290586us) service_pool.cc:224] Handling call
0709 13:11:27.669631 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.670469 (+   838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.670518 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.671207 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.897362 (+226155us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:28.007223 (+109861us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.007477 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.007566 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.079166 (+1071600us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b18002b4680. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:29.084151 (+  4985us) raft_consensus.cc:1685] finished
0709 13:11:29.084264 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.084403 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39020,"prepare.queue_time_us":160636,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1216,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":11744,"spinlock_wait_cycles":5303040,"thread_start_us":225515,"threads_started":1,"wal-append.queue_time_us":430942}
I20260709 13:11:29.149832 31397 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:29.150660 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.151412 26579 raft_consensus.cc:2393] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 16: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:29.152513 26655 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:29.137626 26585 rpcz_store.cc:276] 0709 13:11:27.752625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.754858 (+  2233us) service_pool.cc:224] Handling call
0709 13:11:27.785521 (+ 30663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.371729 (+586208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.108856 (+737127us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54001c3ed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:29.109046 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336419712}
I20260709 13:11:29.126278 31108 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.154618 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.158675 31017 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.159245 31017 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.161844 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.164086 31482 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:29.165552 26577 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:29.161374 31017 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:29.179523 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:29.179648 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.089489 31426 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:29.180621 26502 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 16: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:29.098186 31605 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:29.183969 26476 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.193032 27273 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:29.188886 27271 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 13. Ops: []
W20260709 13:11:29.194729 26549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.195354 27275 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:11:29.195932 27275 pending_rounds.cc:85] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Aborting all ops after (but not including) 10
I20260709 13:11:29.196288 27275 pending_rounds.cc:107] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:11:29.196695 27275 raft_consensus.cc:2889] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:29.196376 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:29.200337 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:29.206439 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 30ffd86793fb4eab863861f1047dec1e: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:29.206652 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:29.179755 31248 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:29.164125 31579 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:11:29.214098 31397 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14.
I20260709 13:11:29.214321 26401 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 14, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 14 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:29.220403 26502 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:11:29.209129 31542 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.183279 31569 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:11:29.232405 26502 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:29.224406 31541 raft_consensus.cc:3055] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:29.200661 31605 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:29.236575 26502 raft_consensus.cc:1240] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:29.229378 31577 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:29.237984 26502 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:29.246485 26580 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:29.234927 31541 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:29.251463 31541 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.252765 31541 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.259563 31605 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:29.261211 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:29.264017 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:29.233713 31559 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.278748 26583 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:11:29.279155 26583 pending_rounds.cc:85] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 10
I20260709 13:11:29.279412 26583 pending_rounds.cc:107] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:11:29.279628 26583 raft_consensus.cc:2889] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:29.282294 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 98445.3us
I20260709 13:11:29.278949 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:29.286835 26578 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:29.294829 31466 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:29.295562 31567 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:29.295259 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.296248 31567 consensus_queue.cc:1059] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:29.297258 26506 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:29.297333 26549 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:29.304312 26476 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.306380 26476 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:29.317008 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 637354us
I20260709 13:11:29.282008 31599 raft_consensus.cc:3055] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:29.292351 26401 catalog_manager.cc:5697] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:29.327477 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 454850us
I20260709 13:11:29.329658 26476 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.289405 31458 raft_consensus.cc:3055] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:11:29.298905 31565 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:11:29.292971 31328 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:29.353389 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:29.340777 30719 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:29.354413 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43794.7us
I20260709 13:11:29.357479 27276 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:29.316077 31376 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:29.360733 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:29.360922 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:29.360989 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 63740.1us
I20260709 13:11:29.367399 26655 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:29.308511 31455 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:29.296959 31569 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:11:29.407850 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:29.328071 31532 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.411279 26659 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:29.327626 31347 raft_consensus.cc:3055] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:29.414261 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:29.422768 26625 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.367192 31564 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.321333 31397 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:29.415027 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.415566 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.415920 26656 raft_consensus.cc:1275] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:29.331907 31599 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:29.416658 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:29.430012 26576 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:29.356494 31612 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:11:29.408607 31557 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.353081 31458 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:29.417186 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 49001.6us
I20260709 13:11:29.419822 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:29.420428 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.421651 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:29.421144 31539 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.369318 26658 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:29.361848 31456 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:29.368094 31438 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:11:29.353302 31328 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:29.359977 31572 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:29.451959 31572 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:29.452397 31572 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:29.457686 31618 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:29.422502 31455 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.444855 31170 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:11:29.458966 31599 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.460216 31412 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:29.430990 31564 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.448496 31539 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.463044 26654 raft_consensus.cc:1275] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:29.463335 31564 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:29.450479 31456 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:29.464304 31615 log.cc:927] Time spent T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:29.465842 31456 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:29.368028 31301 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:29.405964 31600 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:29.466552 31600 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:29.428380 26583 raft_consensus.cc:2410] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:11:29.327517 31426 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:11:29.323529 31385 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:11:29.352324 31571 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.435392 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:29.339237 31364 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:11:29.435745 26401 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 14, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 14 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:29.439035 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.490598 30654 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:29.297186 31605 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:11:29.423177 31347 raft_consensus.cc:740] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:29.494730 31347 consensus_queue.cc:260] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.496589 31347 raft_consensus.cc:3060] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.497155 26659 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:29.406174 31103 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:11:29.443732 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:29.500437 26656 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:29.447113 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:29.501596 26658 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 14.
I20260709 13:11:29.357508 31108 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.504489 31108 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:29.423678 31376 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 15 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:29.506209 31376 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.428885 31461 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:29.439478 31559 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.510070 31559 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.512705 31559 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:29.464046 31539 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:29.466694 26651 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:29.367834 30917 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:29.469877 26650 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:29.471247 26657 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 16.
I20260709 13:11:29.517771 30917 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:11:29.517470 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 78510.8us
I20260709 13:11:29.521927 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.523708 31571 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:29.524165 31571 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:29.524629 31571 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:29.530126 31103 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.530897 31103 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.534623 31103 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:29.445752 31557 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.478231 31017 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.548581 31017 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.552204 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:29.471179 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:29.473286 27241 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.479866 26655 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:11:29.486761 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 108a6730154b42819badee4f37f31ad8: Illegal state: Replica af1b5d6d444447b7a580afb4aff33320 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:29.487028 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:29.490168 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.562795 26652 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
W20260709 13:11:29.572466 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 99247.1us
W20260709 13:11:29.582211 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 92126.2us
I20260709 13:11:29.472383 31600 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.582968 26622 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.585431 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:29.592363 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 121254us
I20260709 13:11:29.586418 26503 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:29.595192 26504 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:29.586335 31571 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:29.580766 31458 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.589715 31559 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:29.580953 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:29.605429 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 166758us
I20260709 13:11:29.596953 26622 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.605343 26549 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:29.609671 27241 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.613078 26508 raft_consensus.cc:1240] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:11:29.591687 31438 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.590772 31528 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.571420 31533 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:29.602626 31567 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:29.720868 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.619995 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:29.727064 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:29.601362 31437 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:29.630702 26580 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 7.
I20260709 13:11:29.571888 31563 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:11:29.625082 26474 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:29.736215 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 111184us
W20260709 13:11:29.723507 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 165807us
I20260709 13:11:29.724524 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.635004 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.629578 26584 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:29.727806 26657 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
W20260709 13:11:29.742072 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 107181us
I20260709 13:11:29.731540 26652 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 7: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:11:29.732372 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 127113us
I20260709 13:11:29.744717 30654 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:29.602470 31482 consensus_queue.cc:1048] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 13:11:29.600780 31542 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:11:29.723639 31559 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:29.769906 26501 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:29.754218 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:29.755290 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:29.755537 31017 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:29.738554 31617 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:11:29.619995 31257 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 13:11:29.769150 26474 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.624347 31630 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:29.775556 26622 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.723821 31455 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:29.746273 31604 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:29.779924 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:29.739193 31437 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.746606 31103 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:29.787321 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:29.719319 31461 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:11:29.624536 31426 consensus_queue.cc:1048] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.149s
I20260709 13:11:29.624408 31544 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 13:11:29.757457 31557 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:29.725385 31438 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:29.792721 26507 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:29.770645 31559 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.799681 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.806569 26584 raft_consensus.cc:2410] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:11:29.751737 26476 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.767652 31528 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:11:29.786917 31539 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:29.792801 31437 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.809069 27241 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
W20260709 13:11:29.822499 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 71000.1us
I20260709 13:11:29.826901 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:29.826723 31557 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:29.827813 31301 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:29.828514 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:29.829756 31301 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:29.830332 31301 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.830775 31301 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.829763 31376 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:29.856917 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 47964.5us
I20260709 13:11:29.811776 31559 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:29.861366 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 233444us
I20260709 13:11:29.863725 27243 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:29.859838 26657 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:29.864454 31558 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:29.807561 31421 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:11:29.824640 31631 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:29.814793 31604 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 16 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:29.821576 31103 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.816903 31630 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:29.869920 31558 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.882799 31604 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:29.883315 31558 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:29.883315 31630 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.885852 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:29.886565 27278 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:29.879048 31523 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:29.887238 31523 raft_consensus.cc:697] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:29.888236 31523 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.896431 31103 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:29.898283 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:29.899825 31571 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:29.899111 31103 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:29.874729 31631 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.908248 31631 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.912714 31328 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:29.920859 31328 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:29.900903 26651 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:29.901549 30719 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:29.882295 27272 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:29.901222 31572 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:29.903264 31438 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:29.934593 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:29.935488 26577 raft_consensus.cc:2410] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:29.905586 26659 raft_consensus.cc:1275] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:11:29.936087 26659 pending_rounds.cc:85] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 10
I20260709 13:11:29.936411 26659 pending_rounds.cc:107] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:11:29.936736 26659 raft_consensus.cc:2889] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:29.905766 26656 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:29.906704 31599 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:29.907163 31541 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.000s
I20260709 13:11:29.933305 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:29.940407 26583 raft_consensus.cc:2393] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 16: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:29.942534 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:29.945889 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:29.948271 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:29.954828 26654 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:29.959029 26502 raft_consensus.cc:2393] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 12: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:29.973369 26584 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:29.979940 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:29.982239 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:29.985219 26583 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:29.997455 26653 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:29.994426 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 256618us
I20260709 13:11:29.938705 30825 consensus_queue.cc:1059] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:11:30.007817 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:29.899119 31558 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.011288 27270 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:30.014915 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:30.016682 30719 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:30.016708 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:29.966107 31438 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:11:30.032718 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:30.034579 31461 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:30.034898 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.036639 31559 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.038241 31572 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.038635 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:30.038829 31385 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:30.020341 26653 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15.
W20260709 13:11:30.054982 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.987397 31630 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.102355 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:30.107890 26657 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:30.020810 31455 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.111886 27278 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 11: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:30.111770 30654 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:30.075258 31541 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.113338 30654 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.114056 27241 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:30.122560 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:30.021095 31573 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:11:30.079368 31248 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:11:30.115362 30917 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.151611 30654 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:30.136880 31640 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:11:30.154604 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:30.131587 31464 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:30.139170 31639 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:30.189640 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 178679us
I20260709 13:11:30.121206 31541 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.118582 31455 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.223444 26473 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:30.226810 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 210189us
I20260709 13:11:30.183934 31639 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:30.202351 31600 consensus_meta.cc:287] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
W20260709 13:11:30.232563 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 214258us
I20260709 13:11:30.173220 31301 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.237613 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:30.241483 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:30.235191 31639 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:30.222118 31397 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:30.186086 31437 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.202705 31464 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:30.251389 30719 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.228448 31569 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.172928 30917 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.232259 31248 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.231942 31438 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.256763 30719 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.257212 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:30.191453 31640 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:11:30.196573 31644 consensus_queue.cc:1059] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:11:30.268111 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:30.348591 30719 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:30.333252 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 76129.9us
I20260709 13:11:30.243448 31600 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.251858 31572 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.344798 26502 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:30.346589 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:30.347529 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:30.350966 30719 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.407785 30719 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.340499 30654 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:30.409214 30654 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:30.409705 30654 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:30.352589 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:30.262609 31569 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.266151 31558 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.410684 26584 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:30.247489 31631 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.270968 31248 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.258051 31397 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.350481 31559 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.435369 26625 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:30.353361 31532 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:30.352125 31347 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:30.270730 31438 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:30.464483 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.423508 31103 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.440294 30719 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:30.482299 30719 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:30.482712 30719 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.483022 30719 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:30.489506 30654 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.429672 31426 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.498893 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:30.503882 26578 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:30.479212 31612 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:30.428987 31572 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.491640 31153 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:30.474795 31532 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:30.576244 31328 consensus_meta.cc:287] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.011s
I20260709 13:11:30.577148 31569 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.577766 31532 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.582463 31631 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.584542 31600 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.500628 31464 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.587313 30917 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.588621 31437 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:30.502555 31426 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.575857 31248 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.550232 30719 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:30.573436 31661 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:11:30.548305 31356 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:30.575294 31438 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.575845 31301 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.633646 31356 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.587211 31397 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.636351 31356 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.601648 30719 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:30.609913 31656 log.cc:927] Time spent T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:11:30.495401 31347 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.546233 31541 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.610306 31426 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:30.611282 31653 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:11:30.611583 31659 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:11:30.629158 31458 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:30.617015 31599 consensus_meta.cc:287] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.002s
W20260709 13:11:30.617683 31654 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:11:30.607044 31569 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.624034 31572 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.599505 30825 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:30.661732 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 235220us
W20260709 13:11:30.629760 31645 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.368s	user 0.002s	sys 0.000s
I20260709 13:11:30.493289 31103 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:30.619606 31650 log.cc:927] Time spent T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 13:11:30.640606 31648 log.cc:927] Time spent T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:11:30.654646 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:30.668663 26584 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:30.655783 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:30.669414 26583 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:30.656769 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:30.657543 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.573186 31647 log.cc:927] Time spent T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:11:30.669947 26580 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 7.
I20260709 13:11:30.667984 26548 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:30.659516 31301 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:30.683055 26501 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:30.684801 31600 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.684932 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:30.685508 31600 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.687572 26508 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:29.718982 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:30.688843 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39256 (request call id 1045) took 1271 ms. Trace:
I20260709 13:11:30.689219 26650 rpcz_store.cc:276] 0709 13:11:29.410526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.414039 (+  3513us) service_pool.cc:224] Handling call
0709 13:11:30.681807 (+1267768us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b54002d9e54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:30.681906 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103156480}
I20260709 13:11:30.671171 31170 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:30.676182 31438 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:30.699162 26583 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:30.704989 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:30.699643 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:30.705538 26501 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 9.
I20260709 13:11:30.699810 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:30.706588 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:30.687875 26401 catalog_manager.cc:5697] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 10, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 10 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.703925 26548 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:30.664498 31569 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:30.711136 26653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 2216) took 1290 ms (client timeout 1598 ms). Trace:
I20260709 13:11:30.668092 30825 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.671538 31426 consensus_queue.cc:1059] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:11:30.712430 26657 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:30.712845 26656 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 14: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:30.717921 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:30.711714 26653 rpcz_store.cc:269] 0709 13:11:29.420450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.421398 (+   948us) service_pool.cc:224] Handling call
0709 13:11:30.710912 (+1289514us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b540039c6d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:30.711066 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280699776}
I20260709 13:11:30.719027 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:30.687592 30901 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.719725 26653 raft_consensus.cc:2393] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:30.719846 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:30.720417 26508 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:30.720506 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:30.721371 26653 raft_consensus.cc:2410] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:11:30.715920 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:30.722776 26650 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:30.731392 26549 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:30.731336 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:30.732394 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:30.733352 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:30.732832 26650 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:30.734433 26656 raft_consensus.cc:2393] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:30.735319 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:30.735970 26651 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 15: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:30.691453 31565 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:30.738476 26549 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:30.725735 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:30.708901 31170 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.755303 26653 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:30.738029 30901 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:30.768429 31651 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.544s	user 0.002s	sys 0.000s
I20260709 13:11:30.799247 26656 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:30.754935 31671 log.cc:927] Time spent T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:11:30.754240 31668 log.cc:927] Time spent T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:30.741042 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2600) took 1185 ms. Trace:
W20260709 13:11:30.755605 31666 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:11:30.713979 31606 raft_consensus.cc:3055] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:30.812582 31678 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.814570 31606 raft_consensus.cc:740] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:30.814751 31678 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.815804 31347 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.815547 31606 consensus_queue.cc:260] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.816872 31606 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:30.810913 31356 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:30.806551 31426 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.718339 31541 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 13:11:30.801715 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 63407.2us
I20260709 13:11:30.691665 31301 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.808835 26548 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:30.736984 31438 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:11:30.826285 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 100714us
I20260709 13:11:30.824647 26549 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:30.829793 26653 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:30.812870 26510 rpcz_store.cc:276] 0709 13:11:29.555500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.581740 (+ 26240us) service_pool.cc:224] Handling call
0709 13:11:29.582070 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.606682 (+ 24612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.606734 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.619117 (+ 12383us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.052307 (+433190us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:30.052345 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.052420 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.740856 (+688436us) raft_consensus.cc:1685] finished
0709 13:11:30.740875 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.740988 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2414,"raft.queue_time_us":9736,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":10562,"thread_start_us":285392,"threads_started":1,"wal-append.queue_time_us":497364}
I20260709 13:11:30.839641 26625 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:30.845677 26625 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:30.822115 31541 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:30.771842 31565 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.823573 31301 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:30.817500 31678 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.818578 31356 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.862346 31356 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.864390 30901 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.866739 31682 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:30.851729 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:30.821914 30825 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.867338 31682 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.828526 31438 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.867726 31682 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:30.867812 31438 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:30.869704 31675 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:30.870298 31675 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.870744 31675 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:30.853200 31541 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.872648 31541 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:30.874001 31670 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:30.874584 31670 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.875012 31670 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:30.889297 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 43850.9us
I20260709 13:11:30.819336 31426 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:30.891990 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 80486.8us
I20260709 13:11:30.893617 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:30.895200 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:30.895833 26653 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:30.895774 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:30.898206 31170 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.896551 26585 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:30.902668 26584 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:30.909298 26474 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:30.904587 31458 raft_consensus.cc:2764] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:11:30.903860 30825 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:11:30.907662 31639 consensus_meta.cc:287] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.001s
I20260709 13:11:30.909185 31600 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.918072 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 1056) took 1114 ms. Trace:
I20260709 13:11:30.917016 26625 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:30.914839 31669 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:30.904223 31572 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:30.911257 31103 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.924079 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:30.914115 31687 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:30.922134 31639 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.931062 30654 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.939528 27272 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:30.923370 26652 rpcz_store.cc:276] 0709 13:11:29.803388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.909250 (+105862us) service_pool.cc:224] Handling call
0709 13:11:29.909608 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:29.910014 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.910043 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:29.910642 (+   599us) log.cc:844] Serialized 52 byte log entry
0709 13:11:30.081033 (+170391us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:30.081073 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.081161 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.767599 (+686438us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:30.912931 (+145332us) raft_consensus.cc:1685] finished
0709 13:11:30.912957 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.918002 (+  5045us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":504,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":9437568,"thread_start_us":169964,"threads_started":1,"wal-append.queue_time_us":229729}
W20260709 13:11:30.933494 31683 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:11:30.925410 31669 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:30.933691 31301 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:30.934072 31676 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:30.946314 31572 raft_consensus.cc:697] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:30.962389 31572 consensus_queue.cc:237] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.959174 31301 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:30.964927 31301 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:30.966331 31426 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.967895 31639 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.970409 31347 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:30.970993 31347 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:30.973119 31347 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:30.976799 31248 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:30.977407 31248 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.948268 31678 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:30.994361 31646 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.643s	user 0.002s	sys 0.000s
I20260709 13:11:30.958563 31669 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:30.999830 26505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2960) took 1250 ms. Trace:
I20260709 13:11:31.000321 26505 rpcz_store.cc:276] 0709 13:11:29.749031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.749852 (+   821us) service_pool.cc:224] Handling call
0709 13:11:29.775371 (+ 25519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.822103 (+ 46732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.822142 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.822769 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.113243 (+290474us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:30.133507 (+ 20264us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.135427 (+  1920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.822930 (+687503us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b1800467c80. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882980a2a6 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419
0709 13:11:30.824017 (+  1087us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b5400359b54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:30.824081 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.993585 (+169504us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:30.999555 (+  5970us) raft_consensus.cc:1685] finished
0709 13:11:30.999587 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.999757 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17316,"prepare.queue_time_us":17043,"prepare.run_wall_time_us":43,"raft.queue_time_us":20049,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":18710,"spinlock_wait_cycles":88293632,"thread_start_us":242458,"threads_started":1,"wal-append.queue_time_us":388202}
I20260709 13:11:30.979573 31248 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:30.944514 31438 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:30.980321 31569 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.006436 31301 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.013760 26654 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:31.015610 31301 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:30.990718 31676 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:11:31.021145 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 65669.5us
I20260709 13:11:31.021428 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:31.024825 26584 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:30.947515 31687 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.001197 31678 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.027768 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:31.028303 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:31.033702 26652 raft_consensus.cc:2376] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15. Re-sending same reply.
I20260709 13:11:31.039434 26585 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:31.041278 31689 consensus_queue.cc:1059] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:11:31.042778 31541 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.043917 31301 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:31.045231 31541 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.048179 26584 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:31.051031 26625 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:31.059118 31688 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:31.059717 31688 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:31.060593 31688 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.067756 31687 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.071166 31455 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:31.071167 26651 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:11:31.077023 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 227175us
I20260709 13:11:31.040084 31565 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.079046 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:31.078727 31153 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:31.053229 31690 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:31.082157 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.083653 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.083942 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.081264 27278 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:11:31.084800 27275 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:31.082736 31103 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.088886 31103 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.089895 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:31.090735 26510 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:31.086916 26506 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:31.092868 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.093219 27271 raft_consensus.cc:2368] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13.
I20260709 13:11:31.093626 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.036048 31682 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.052858 30825 raft_consensus.cc:697] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:31.096062 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.096223 31103 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.096469 31544 raft_consensus.cc:3055] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:31.096736 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.102080 26508 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:31.105451 26622 leader_election.cc:400] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13.
I20260709 13:11:31.107771 26622 leader_election.cc:403] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:11:31.112555 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:31.113144 26653 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.114033 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:31.089409 31678 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.091071 31392 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.125326 26401 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 6 to 9, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 9 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:31.137593 26401 catalog_manager.cc:5697] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 10 to 11, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 11 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:31.139611 26401 catalog_manager.cc:5697] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 8 to 11, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 11 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:31.142117 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:31.116537 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.119794 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.126878 31103 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.147585 26401 catalog_manager.cc:5697] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 10 to 11, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 11 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.143417 26652 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15.
I20260709 13:11:31.152866 26653 raft_consensus.cc:2468] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:31.127089 31675 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.107214 31544 raft_consensus.cc:740] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:31.019153 31676 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.146054 31630 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.155473 31579 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.108237 31572 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:11:31.156085 31678 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.194751 31397 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.198221 31559 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:31.199493 31261 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:31.201131 31153 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.195170 31103 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.158849 31392 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.219722 31579 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.297432 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.298648 26585 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:31.301254 27278 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
W20260709 13:11:31.221675 31644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.011s	sys 0.033s
I20260709 13:11:31.236383 31261 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.239655 31695 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.231s
I20260709 13:11:31.231094 31397 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.244102 31103 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.226984 31678 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.228665 31559 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.247411 31392 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.230671 31153 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.340065 31153 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.225749 31438 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.246119 26503 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:31.243341 31572 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.342018 31572 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.329698 31687 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.344137 31572 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.308420 31170 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.308576 31688 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.344627 31687 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.344894 31170 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.345026 31688 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.309139 31532 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.346376 31532 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.347501 31688 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:31.310002 31701 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.348731 31559 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.349543 31261 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.313587 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:31.350679 31694 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:31.351218 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.351307 31694 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.352035 26508 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:11:31.313890 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.354182 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.354725 26509 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:31.355451 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.356789 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:31.352957 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:31.357736 31675 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.358223 31482 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.314841 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.315618 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.314752 26625 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:31.316119 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:31.355564 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:31.362330 26504 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:31.362303 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 47631.5us
I20260709 13:11:31.317970 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:31.317175 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:31.329757 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 251560us
I20260709 13:11:31.364017 26507 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:31.327732 31579 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.333724 31328 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:11:31.361459 26505 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
W20260709 13:11:31.333119 31644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.011s	sys 0.034s
I20260709 13:11:31.358744 31482 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.348810 31701 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.365540 31466 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.365335 31558 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.370823 31688 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:31.372606 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:31.329880 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 247273us
I20260709 13:11:31.367743 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.368254 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.361478 26506 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:31.370070 26510 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 15: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:31.375335 31466 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.375752 31558 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.427629 27274 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:31.428709 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.429720 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:31.430110 31572 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.430722 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.430598 31572 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.366638 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.431560 26653 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:31.432439 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.432612 31572 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.432689 31466 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.433632 31523 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.434135 31523 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.389194 31328 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.419044 31660 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.434991 31328 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.435367 31660 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.437062 31328 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.389869 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:31.438439 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.439043 26508 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:31.391866 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:31.395552 31670 consensus_meta.cc:287] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:11:31.376559 31688 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.448467 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.449117 26578 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:31.358649 31682 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.398300 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:31.402472 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.402910 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.404392 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:31.401400 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.452214 26579 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15.
I20260709 13:11:31.412264 26651 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:31.454551 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.450999 26549 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:31.413643 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.403048 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.456708 26581 raft_consensus.cc:2368] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 14. Current term is 15.
I20260709 13:11:31.414891 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.458168 26580 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:31.418383 26548 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:31.420002 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:31.420539 26504 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:31.460932 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.461635 27271 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:31.422048 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:31.425259 26577 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:31.425444 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.425856 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.463932 27270 raft_consensus.cc:2393] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 13: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:31.426461 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.433465 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:31.464946 26653 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:31.465431 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 106906us
I20260709 13:11:31.417290 31438 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:31.457309 26585 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 15: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:31.427088 31385 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:31.467694 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.471231 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.471954 26504 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:31.472199 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.443856 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.269984 30825 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.475081 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.474150 27241 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:31.474246 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:31.474442 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:31.463212 31689 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:31.476655 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 54732.3us
I20260709 13:11:31.455567 31688 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:31.490032 26653 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:31.477721 27278 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 13: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:31.473750 31695 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:31.492326 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.478088 26476 leader_election.cc:400] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 14. Current term is 15.
I20260709 13:11:31.479029 31533 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:31.479758 31461 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:31.467514 31690 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:31.482542 31558 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.483425 31532 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:31.484165 26502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55308 (request call id 736) took 1261 ms (client timeout 1660 ms). Trace:
I20260709 13:11:31.484565 31397 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.487699 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.512488 26578 raft_consensus.cc:2410] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:11:31.493871 26476 leader_election.cc:403] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:31.500317 26474 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:31.506397 26504 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:31.507441 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:31.507440 26502 rpcz_store.cc:269] 0709 13:11:30.222781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.222938 (+   157us) service_pool.cc:224] Handling call
0709 13:11:31.483994 (+1261056us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540027e2d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:31.484087 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232070912}
I20260709 13:11:31.475682 31385 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.454094 31670 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.508893 31170 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.473704 31438 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.487037 31689 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.510746 31701 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.482589 31466 consensus_queue.cc:1048] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:11:31.519680 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.504858 31690 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.526046 31103 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:31.495802 31461 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:31.509946 31694 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:31.532431 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 57433.3us
I20260709 13:11:31.509369 31709 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:31.533862 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.547582 26652 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:31.536330 31689 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:31.541438 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.552018 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.552767 26654 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 16.
I20260709 13:11:31.554102 31715 raft_consensus.cc:2764] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:31.557727 31709 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:31.558877 31482 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.535284 31170 consensus_queue.cc:1059] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:11:31.559060 31709 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.560096 31170 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:31.560546 31170 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:31.561422 31170 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.562748 31170 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:31.529855 31680 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.682s	user 0.002s	sys 0.001s
I20260709 13:11:31.535275 31710 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:31.526201 31301 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:31.545797 26650 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 15: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:31.572665 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.496025 31533 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.503175 31669 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.577410 31670 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:31.579128 31669 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.579277 31385 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:31.542596 31103 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.568953 31571 raft_consensus.cc:3055] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:31.594300 31571 raft_consensus.cc:740] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:31.595321 31571 consensus_queue.cc:260] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.596062 31630 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13.
I20260709 13:11:31.569207 31461 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.596510 31571 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:31.505029 31695 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.542371 31690 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:31.534703 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 56748us
I20260709 13:11:31.571774 31710 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.576016 31702 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:11:31.582219 26510 raft_consensus.cc:1240] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:31.581622 31438 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.594274 31103 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:31.603072 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2223) took 1550 ms. Trace:
I20260709 13:11:31.605104 27272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 801) took 1406 ms. Trace:
I20260709 13:11:31.609176 31604 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.609516 31676 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.615123 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:31.570812 31671 log.cc:927] Time spent T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.734s	user 0.004s	sys 0.000s
I20260709 13:11:31.619334 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.620537 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.623620 31675 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.624136 31689 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.627234 31688 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.631045 26476 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:31.664686 26476 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:31.638710 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 93159.2us
I20260709 13:11:31.585152 31533 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.646622 27272 rpcz_store.cc:276] 0709 13:11:30.199136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.200499 (+  1363us) service_pool.cc:224] Handling call
0709 13:11:30.939372 (+738873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.943911 (+  4539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.604872 (+660961us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54006f2f50. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:31.605043 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635008896}
I20260709 13:11:31.645627 26657 rpcz_store.cc:276] 0709 13:11:30.052391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.168918 (+116527us) service_pool.cc:224] Handling call
0709 13:11:30.712004 (+543086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.717235 (+  5231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.602873 (+885638us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540039c6d0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:31.603015 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248182528}
I20260709 13:11:31.656869 31461 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.658080 26656 raft_consensus.cc:2468] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:31.659991 26579 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:31.661099 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:31.670888 26581 raft_consensus.cc:2393] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 15: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:31.668861 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 178414us
I20260709 13:11:31.671908 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:31.674367 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 200273us
I20260709 13:11:31.674816 26659 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 16: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:31.672361 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:31.675717 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.676733 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:31.678622 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.679241 26579 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:31.680275 26549 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:31.665910 31464 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:31.681746 26549 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:31.706852 26549 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:31.708462 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.713639 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.668295 31153 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:31.761390 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 84757.1us
I20260709 13:11:31.762539 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:31.764972 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.771294 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:31.660540 31604 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.662616 31676 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:31.776651 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 99357.2us
I20260709 13:11:31.664000 31675 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:31.751130 31654 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:31.771185 31606 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:31.683511 31301 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:31.706226 31438 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:31.690196 31437 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:31.691630 31464 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:31.845592 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2414) took 1695 ms. Trace:
I20260709 13:11:31.750789 31421 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:31.849083 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 173840us
W20260709 13:11:31.844799 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 73591.6us
I20260709 13:11:31.678462 31669 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:11:31.879675 27241 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:31.682883 31397 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:31.774343 31629 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:31.876682 31421 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.889899 31629 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.890326 31421 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:31.891674 31689 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.867473 31658 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:31.869253 31637 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:31.880132 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.888924 31604 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.890399 31629 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.867660 31606 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.774175 31455 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:31.896351 31688 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:31.897636 31397 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.874173 26658 rpcz_store.cc:276] 0709 13:11:30.150633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.219109 (+ 68476us) service_pool.cc:224] Handling call
0709 13:11:30.219614 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.237715 (+ 18101us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:30.260216 (+ 22501us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.537665 (+277449us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.547487 (+  9822us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.547669 (+   182us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:30.547716 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.547806 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.570558 (+1022752us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b24001f8098. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f88296c29c4 00007f88296c0acb 00007f882987bdc9 00007f882987ba55 00007f882987b09d 00007f882c4ad10e 00007f882c4c488c 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221
0709 13:11:31.770629 (+200071us) raft_consensus.cc:1685] finished
0709 13:11:31.781085 (+ 10456us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.845486 (+ 64401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12430,"prepare.queue_time_us":310686,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":75184,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":24637,"spinlock_wait_cycles":10665856,"thread_start_us":155399,"threads_started":1,"wal-append.queue_time_us":323905}
I20260709 13:11:31.871706 31532 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:31.877285 31464 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:31.955506 31678 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.957798 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:31.877820 31438 raft_consensus.cc:697] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:31.909265 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:31.915731 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:31.918704 31667 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 1.234s	user 0.000s	sys 0.003s
I20260709 13:11:31.902843 31658 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:31.967180 31658 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.877537 31437 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.923202 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:31.926568 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:31.975136 26650 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:31.911837 31698 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:31.941962 27241 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:31.949236 31675 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.946302 31532 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.950462 31544 consensus_queue.cc:260] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:31.959189 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.959244 26658 raft_consensus.cc:1240] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:31.961176 27272 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:31.908704 31637 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:31.962940 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:31.964733 31523 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:32.004282 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:32.007634 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:31.960242 31533 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.009732 31397 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:32.011221 31533 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:32.012081 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:32.012764 26580 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.013763 31438 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.016381 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 1057) took 1928 ms. Trace:
I20260709 13:11:32.016752 26655 rpcz_store.cc:276] 0709 13:11:30.088301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.193314 (+105013us) service_pool.cc:224] Handling call
0709 13:11:30.198575 (+  5261us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:30.223203 (+ 24628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.223228 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:30.230860 (+  7632us) log.cc:844] Serialized 52 byte log entry
0709 13:11:30.543159 (+312299us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:30.543202 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.543276 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.917795 (+1374519us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:32.016082 (+ 98287us) raft_consensus.cc:1685] finished
0709 13:11:32.016103 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.016321 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24774,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6346,"spinlock_wait_cycles":11709696,"thread_start_us":281288,"threads_started":1,"wal-append.queue_time_us":411414}
I20260709 13:11:31.999789 31134 raft_consensus.cc:2804] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:32.018134 31676 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:32.018573 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:32.019147 26655 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:32.020076 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:32.020437 26580 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:32.020757 26655 raft_consensus.cc:2393] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:31.931774 31606 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:32.000047 31541 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:11:32.021713 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:32.022581 31571 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:32.023175 31571 raft_consensus.cc:697] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:32.024129 31571 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.003700 31695 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:31.946525 31710 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:31.931650 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:31.945539 31103 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.026705 31637 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:31.975333 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 48837.8us
I20260709 13:11:32.028625 31103 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:31.977293 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.977837 31639 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:32.029747 31639 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.030108 31639 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:32.033129 26473 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:31.975723 31455 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:32.051120 31455 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.051589 31455 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:32.054410 31103 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:32.020285 31690 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.023191 31532 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:32.026301 31134 raft_consensus.cc:697] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:32.060261 31134 consensus_queue.cc:237] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.060837 31606 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.033954 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.034628 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.035066 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:32.079454 26501 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:32.080183 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:32.080792 26580 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:32.035305 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.024832 26658 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:32.035495 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:32.036778 31725 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:11:31.974571 31702 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 14. Current term is 15.
I20260709 13:11:32.037714 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.083477 26658 raft_consensus.cc:1240] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:32.041705 26582 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:32.042516 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:32.042310 31658 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.043970 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:32.043556 31421 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.112600 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:32.062980 26655 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:32.113813 27270 raft_consensus.cc:2393] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 13: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:31.979439 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.112651 26654 raft_consensus.cc:2393] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:32.035557 31437 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:32.115233 30654 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:32.115779 30654 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.076802 31660 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:32.118521 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.119728 27278 raft_consensus.cc:2410] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:11:32.077696 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 44629.5us
I20260709 13:11:32.121088 26473 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:32.122602 26473 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:32.124075 26473 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:32.039311 31464 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.084156 26401 catalog_manager.cc:5697] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.084990 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.085295 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.090252 26658 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:31.961761 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 53459.8us
I20260709 13:11:32.086702 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.088307 26585 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:32.091162 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:32.092419 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.084856 26656 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
W20260709 13:11:32.095084 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.058477 31690 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:32.112035 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:32.140569 26582 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:32.068902 31455 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.101490 31694 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.078711 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:32.159204 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:32.159930 26655 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.160882 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.126412 31544 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:32.128175 27243 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:32.137101 26651 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:32.173339 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 45284.4us
I20260709 13:11:32.143381 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:32.143781 26504 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:32.175050 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:32.144594 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.145998 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:32.176693 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:32.148444 30654 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:32.119513 26650 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:32.179406 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:32.083329 31606 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:32.180765 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.175521 26505 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 16: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:32.178045 30719 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:32.189950 26585 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:32.185863 27277 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:32.135694 31644 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:32.191155 26476 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:32.198940 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.160318 31630 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:32.200176 31579 consensus_queue.cc:1059] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:11:32.200953 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.201951 31421 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:32.203023 26650 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:32.200995 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 55284.2us
I20260709 13:11:32.172832 31694 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.204272 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.147845 31675 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:11:32.213112 31657 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:32.159191 31557 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:32.196460 31722 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:32.136133 31702 raft_consensus.cc:3060] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.222904 27277 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:32.116321 31248 consensus_queue.cc:1059] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:11:32.250389 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:32.251076 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.253046 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.139465 31528 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:11:32.239334 26473 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:32.238826 26622 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:32.260848 30654 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:32.261266 30654 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:32.262331 30654 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.269276 26473 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:32.218489 26401 catalog_manager.cc:5697] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 11 to 14, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 14 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:32.261255 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:32.265980 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:32.273257 30719 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:32.273656 30719 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.273804 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:32.274801 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:32.273993 30719 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:32.277127 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:32.277742 27277 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:32.280825 26473 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:32.249742 31657 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.181846 31639 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.240741 31533 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:32.244860 31397 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.252893 31532 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:32.249964 31722 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.263856 31606 raft_consensus.cc:3055] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:32.308468 31606 raft_consensus.cc:740] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:32.308815 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.309719 31392 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.310101 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:32.310205 31392 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.261718 31678 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:32.311878 31678 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.312260 26584 raft_consensus.cc:1240] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:32.294000 31657 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:32.314899 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:32.315896 26579 raft_consensus.cc:2410] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:11:32.306665 31464 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:32.306936 31455 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:32.292361 31389 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.324285 31533 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:32.328745 31533 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.307641 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:32.330353 26578 raft_consensus.cc:2368] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13.
I20260709 13:11:32.308130 31722 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:32.331938 31669 consensus_queue.cc:1059] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:32.333010 31669 raft_consensus.cc:3055] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:32.333423 31669 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:32.336628 26476 leader_election.cc:400] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13.
I20260709 13:11:32.337026 26476 leader_election.cc:403] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:11:32.338680 31153 raft_consensus.cc:3060] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.346029 27273 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:32.295642 31690 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:32.347960 31690 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:32.348351 31690 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:32.353470 31724 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.391s	user 0.003s	sys 0.001s
I20260709 13:11:32.357196 26401 catalog_manager.cc:5697] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 12, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 12 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:32.367225 31658 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:32.298346 31170 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:32.292783 31675 raft_consensus.cc:2764] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:11:32.278087 31248 raft_consensus.cc:2764] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:11:32.374076 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.379758 27241 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:32.405045 27277 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:32.410818 27241 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:32.317421 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:32.257055 31557 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.396472 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:32.428411 27241 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:32.243665 31630 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:32.399053 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 118336us
I20260709 13:11:32.310446 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.439291 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:32.439841 26505 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:11:32.376699 26401 catalog_manager.cc:5697] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 3 to 12, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 12 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.441015 30654 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.441085 26401 catalog_manager.cc:5697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 2 to 10, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 10 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:32.311327 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.444111 26508 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:32.440196 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:32.444986 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.442930 26401 catalog_manager.cc:5697] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 9, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 9 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:32.446302 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:32.447027 26401 catalog_manager.cc:5697] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 11, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 11 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:32.430181 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:32.451167 26510 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.436275 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:32.443483 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:32.447258 30719 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.449151 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:32.432063 26655 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:32.455438 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:32.471709 30719 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:32.476697 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.478178 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:32.481386 26505 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:32.450603 26401 catalog_manager.cc:5697] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.483992 26622 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:32.485680 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:32.485083 26401 catalog_manager.cc:5697] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 10, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 10 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:32.428440 31103 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.489392 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:32.502987 27275 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:32.489926 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:32.490734 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.497992 30654 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:32.499158 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 70824us
I20260709 13:11:32.505019 27241 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:32.309310 31606 consensus_queue.cc:260] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:32.460415 31565 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.030s	sys 0.044s
I20260709 13:11:32.518056 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.435972 31698 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:32.254581 31629 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.506912 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:32.456609 31261 raft_consensus.cc:2804] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:32.545341 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:32.546093 31261 raft_consensus.cc:697] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:32.547415 31261 consensus_queue.cc:237] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.451845 31612 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:32.525285 31565 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.030s	sys 0.044s
I20260709 13:11:32.533063 31248 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.552629 31248 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.555276 31248 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:32.556648 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.556951 31606 raft_consensus.cc:3060] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.557964 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:32.558518 26658 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:32.535760 26402 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34762 (request call id 322) took 39420 ms (client timeout 15000 ms). Trace:
I20260709 13:11:32.546085 27274 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:32.570488 31726 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.609s	user 0.001s	sys 0.000s
I20260709 13:11:32.571580 26650 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:32.572686 26657 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2240) took 1071 ms. Trace:
I20260709 13:11:32.551903 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:32.573109 26657 rpcz_store.cc:276] 0709 13:11:31.501217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.689496 (+188279us) service_pool.cc:224] Handling call
0709 13:11:31.708732 (+ 19236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:31.760731 (+ 51999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:31.760780 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:31.761407 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.869946 (+108539us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:31.869999 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.870067 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:32.569961 (+699894us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:32.572401 (+  2440us) raft_consensus.cc:1685] finished
0709 13:11:32.572423 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.572628 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1631,"raft.queue_time_us":51973,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":6134,"spinlock_wait_cycles":31458560,"thread_start_us":108119,"threads_started":1,"wal-append.queue_time_us":186939}
I20260709 13:11:32.500949 31392 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:32.574357 26653 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:32.532467 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.536574 31687 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:32.536787 31694 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:32.606295 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:32.538762 31557 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:32.630383 26658 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:32.542945 31639 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:32.480835 31675 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:32.553042 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.535908 31678 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:32.519981 31644 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.674393 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:32.674734 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.577839 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:32.683843 31557 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:32.684458 31557 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.455530 31464 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.150s
I20260709 13:11:32.686507 31557 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:32.528225 31579 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.603451 27274 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:32.603648 30654 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:32.687788 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:32.688045 30654 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.688596 26577 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 16: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:32.565382 31669 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.690092 30654 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:32.604564 26651 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:32.690577 31669 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:32.601641 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.691449 27269 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:32.691993 26505 raft_consensus.cc:1240] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 15. Ops: []
I20260709 13:11:32.601488 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:32.612732 26510 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:32.693689 26653 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:32.595237 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:32.696046 31392 consensus_queue.cc:1175] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "af1b5d6d444447b7a580afb4aff33320" responder_term: 16 status { last_received { term: 16 index: 9 } last_committed_idx: 7 last_received_current_leader { term: 16 index: 9 } }
I20260709 13:11:32.696461 31630 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:32.626930 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:32.590441 27241 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:32.539134 31629 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:32.594384 26549 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:32.530366 31144 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:32.668630 26503 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:32.701879 31144 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.701992 31606 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:32.702292 31144 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:32.577035 26585 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:32.689586 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:32.702577 31606 raft_consensus.cc:697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:32.690649 26580 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:32.497416 31455 raft_consensus.cc:2804] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:32.703681 31606 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.694686 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:32.702528 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.705637 26503 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 13: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:32.706422 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.695904 26622 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:32.701381 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 107116us
I20260709 13:11:32.694666 26510 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:32.657172 27243 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:32.709267 26510 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:11:32.709414 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 119114us
I20260709 13:11:32.654722 27275 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 16.
I20260709 13:11:32.491386 26401 catalog_manager.cc:5697] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 6 to 8, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 8 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:32.712484 26401 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 13, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 13 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.714064 26401 catalog_manager.cc:5697] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 13, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 13 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:32.715623 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 58527.5us
I20260709 13:11:32.715638 26401 catalog_manager.cc:5697] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 8, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 8 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:32.718924 26501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.017s	sys 0.009s
I20260709 13:11:32.719369 26401 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 10 to 12, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 12 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:32.561826 26402 rpcz_store.cc:269] 0709 13:10:53.115083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.115486 (+   403us) service_pool.cc:224] Handling call
0709 13:11:32.535503 (+39420017us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:24.185194 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:24.185947 (+   753us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:24.186009 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:11:24.186035 (+    26us) tablet.cc:662] Decoding operations
0709 13:11:24.187564 (+  1529us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:24.187666 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:24.187700 (+    34us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:11:24.189118 (+  1418us) tablet.cc:701] Row locks acquired
0709 13:11:24.189173 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:11:24.189350 (+   177us) write_op.cc:270] Start()
0709 13:11:24.189506 (+   156us) write_op.cc:276] Timestamp: P: 1783602684189280 usec, L: 0
0709 13:11:24.189554 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:11:24.272280 (+ 82726us) log.cc:844] Serialized 6355 byte log entry
0709 13:11:25.827515 (+1555235us) op_driver.cc:464] REPLICATION: finished
0709 13:11:26.097756 (+270241us) write_op.cc:301] APPLY: starting
0709 13:11:26.097901 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:26.612869 (+514968us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:26.612994 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:26.849880 (+236886us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:26.961875 (+111995us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:11:26.976582 (+ 14707us) write_op.cc:312] APPLY: finished
0709 13:11:27.003267 (+ 26685us) log.cc:844] Serialized 148 byte log entry
0709 13:11:27.093686 (+ 90419us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:27.214098 (+120412us) write_op.cc:454] Released schema lock
0709 13:11:27.237849 (+ 23751us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:27.247445 (+  9596us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:27.247489 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5921972,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":209487,"apply.run_cpu_time_us":49294,"apply.run_wall_time_us":1189719,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71039,"num_ops":16,"prepare.queue_time_us":395537,"prepare.run_cpu_time_us":32775,"prepare.run_wall_time_us":377075,"raft.queue_time_us":486568,"raft.run_cpu_time_us":46162,"raft.run_wall_time_us":151046,"replication_time_us":1631080,"thread_start_us":1070511,"threads_started":5,"wal-append.queue_time_us":501980,"wal-append.run_cpu_time_us":32535,"wal-append.run_wall_time_us":3111336}]]}
I20260709 13:11:32.722842 26401 catalog_manager.cc:5697] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 12, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 12 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:32.724754 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:32.724439 26401 catalog_manager.cc:5697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:32.719372 26501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.017s	sys 0.009s
I20260709 13:11:32.723245 26622 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:32.727561 26625 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:32.725641 26509 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
W20260709 13:11:32.732923 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 289477us
I20260709 13:11:32.738132 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:32.719439 26549 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:32.744879 30654 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:32.530577 31108 consensus_queue.cc:1059] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.187s
I20260709 13:11:32.749639 26625 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:32.726343 26401 catalog_manager.cc:5697] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:32.791338 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 71999.9us
W20260709 13:11:32.758674 26506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.011s
I20260709 13:11:32.758853 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:32.717449 31639 raft_consensus.cc:2764] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:11:32.781243 31558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.003s	sys 0.024s
I20260709 13:11:32.765954 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.766606 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:32.767380 27269 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:32.717482 31455 raft_consensus.cc:697] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:32.717607 31523 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:32.800182 26622 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:32.790094 30654 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:32.751389 31437 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:32.721201 31544 consensus_meta.cc:287] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.524s	user 0.013s	sys 0.000s
I20260709 13:11:32.753171 31557 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:32.810072 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:32.794296 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 44775.2us
I20260709 13:11:32.812413 26625 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:32.797667 26577 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:32.797816 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:32.801575 26549 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:32.757773 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:32.802809 31461 raft_consensus.cc:2764] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:11:32.806149 31687 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:32.821172 26549 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:32.792605 26506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.011s	sys 0.011s
I20260709 13:11:32.769817 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:32.798571 31558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.003s	sys 0.026s
I20260709 13:11:32.834990 26576 raft_consensus.cc:2468] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:32.849416 26577 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:32.835152 30654 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.800812 31675 raft_consensus.cc:2804] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:32.754879 31412 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:11:32.752900 31637 consensus_queue.cc:1059] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:32.769522 31658 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:11:32.893260 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 72178us
W20260709 13:11:32.927083 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 189031us
I20260709 13:11:32.835675 31711 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:32.846907 31604 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.846032 31248 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:32.941267 26584 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:32.807858 31703 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:32.933554 31732 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:11:32.932518 31733 log.cc:927] Time spent T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:11:32.937724 26657 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:32.882444 31670 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:32.807675 31689 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 13:11:32.846342 31421 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:11:32.881150 31687 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:32.926771 31629 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:11:32.929390 31533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.052s	sys 0.071s
I20260709 13:11:32.934064 31458 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:32.947700 31544 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:32.938511 31675 raft_consensus.cc:697] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:32.951881 31599 raft_consensus.cc:3055] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:33.014886 31153 consensus_meta.cc:287] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.003s
W20260709 13:11:33.012439 31533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.053s	sys 0.076s
I20260709 13:11:33.007148 31455 consensus_queue.cc:237] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:32.993297 31711 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:32.947502 31703 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:32.966275 31248 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:33.032460 26576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 3095) took 1423 ms (client timeout 1503 ms). Trace:
I20260709 13:11:33.018591 31458 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:33.033421 26576 rpcz_store.cc:269] 0709 13:11:31.608649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.618795 (+ 10146us) service_pool.cc:224] Handling call
0709 13:11:33.031532 (+1412737us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400254254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:33.031659 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2702607104}
I20260709 13:11:33.019325 31629 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 16 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:11:33.033804 26550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.019s	sys 0.016s
I20260709 13:11:33.057735 31687 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:33.058763 26550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.019s	sys 0.017s
I20260709 13:11:33.025697 31599 raft_consensus.cc:740] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:32.953996 31604 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:33.063311 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.029908 31153 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13.
W20260709 13:11:33.081025 26473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.008s	sys 0.032s
W20260709 13:11:33.060823 31722 consensus_meta.cc:287] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.730s	user 0.016s	sys 0.009s
I20260709 13:11:33.033196 31703 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:33.042522 31458 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:33.089180 26473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.008s	sys 0.032s
W20260709 13:11:33.113034 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 667025us
I20260709 13:11:33.119936 26473 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:33.121412 26508 raft_consensus.cc:2468] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:33.082369 31687 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:33.122169 26584 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:33.113291 31747 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.159502 26506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 2991) took 1017 ms. Trace:
I20260709 13:11:33.145776 31629 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.125630 31599 consensus_queue.cc:260] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:33.165148 31565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.014s	sys 0.014s
W20260709 13:11:33.167295 26504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.009s	sys 0.032s
I20260709 13:11:33.170667 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:33.183712 26657 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
W20260709 13:11:33.183741 26504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.009s	sys 0.032s
I20260709 13:11:33.173390 26506 rpcz_store.cc:276] 0709 13:11:32.142495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.142670 (+   175us) service_pool.cc:224] Handling call
0709 13:11:32.143109 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.143545 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.143586 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.150769 (+  7183us) log.cc:844] Serialized 26 byte log entry
0709 13:11:32.843000 (+692231us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:32.843060 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.843155 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.159304 (+316149us) raft_consensus.cc:1685] finished
0709 13:11:33.159323 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.159446 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7477,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":14815,"thread_start_us":641256,"threads_started":1,"wal-append.queue_time_us":946290}
W20260709 13:11:33.173730 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 53928.8us
I20260709 13:11:33.186267 26473 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:33.187681 26473 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:33.089728 31722 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.185191 26549 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:33.185613 31565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.014s	sys 0.014s
I20260709 13:11:33.087170 31675 consensus_queue.cc:237] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.180382 31533 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:11:33.199723 26650 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.023s
I20260709 13:11:33.085382 31711 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.188984 31669 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:33.206835 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:33.179767 31689 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:33.181823 31421 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:33.211503 26650 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.006s	sys 0.023s
W20260709 13:11:33.194139 31690 consensus_meta.cc:287] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.845s	user 0.013s	sys 0.000s
I20260709 13:11:33.228101 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.305523 26501 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:33.231282 26507 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:33.145306 31248 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:33.198238 31579 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.004s
I20260709 13:11:33.206001 26585 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:33.194272 31153 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:33.318933 31579 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:33.278314 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 71587.1us
W20260709 13:11:33.198664 31702 consensus_meta.cc:287] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.946s	user 0.009s	sys 0.005s
I20260709 13:11:33.174486 31557 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:33.196700 31544 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:33.320996 31702 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:33.321092 31544 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:33.199375 31640 consensus_queue.cc:1059] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 13:11:33.321718 31544 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:33.308331 27277 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 15: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:33.189260 31749 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:11:33.177094 31687 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.212240 31532 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:33.320472 31722 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:33.322706 26505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.016s	sys 0.025s
I20260709 13:11:33.183557 31747 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.329254 27274 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:11:33.277102 31528 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:33.297729 31523 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:33.323683 31738 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:11:33.356431 26505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.017s	sys 0.025s
W20260709 13:11:33.359805 31657 consensus_meta.cc:287] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 1.047s	user 0.008s	sys 0.003s
W20260709 13:11:33.361384 31144 consensus_meta.cc:287] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.002s
I20260709 13:11:33.366273 31557 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.366844 31541 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:33.314677 31690 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.374894 31532 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.382179 31144 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.383656 31690 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:33.304514 31689 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.384265 31144 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.384438 31533 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.384985 31533 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.377477 31528 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.385763 31689 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.386394 26578 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:33.378486 31745 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:11:33.387090 31533 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.387419 31528 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:33.388478 31458 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.308669 31421 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.376324 31579 raft_consensus.cc:3055] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:11:33.398797 26502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.016s	sys 0.024s
W20260709 13:11:33.414970 26502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.018s	sys 0.024s
W20260709 13:11:33.413069 26654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.018s	sys 0.017s
W20260709 13:11:33.414341 26652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.003s	sys 0.054s
I20260709 13:11:33.417459 26505 raft_consensus.cc:1275] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:11:33.417960 26652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.003s	sys 0.054s
W20260709 13:11:33.419261 26654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.019s	sys 0.018s
I20260709 13:11:33.422264 30719 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:33.424666 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 1078) took 1421 ms. Trace:
I20260709 13:11:33.389729 31541 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
W20260709 13:11:33.431708 26625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.016s	sys 0.022s
W20260709 13:11:33.436625 26625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.016s	sys 0.022s
I20260709 13:11:33.427841 26652 rpcz_store.cc:276] 0709 13:11:32.003041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.355331 (+352290us) service_pool.cc:224] Handling call
0709 13:11:32.355652 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.355846 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:32.836936 (+481090us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.421892 (+584956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.421975 (+    83us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:33.422051 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.424311 (+  2260us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.424520 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":798045,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"thread_start_us":1063735,"threads_started":2}
W20260709 13:11:33.440400 27241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.016s	sys 0.008s
W20260709 13:11:33.437273 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 599374us
W20260709 13:11:33.441015 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 505550us
W20260709 13:11:33.441236 27241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.016s	sys 0.009s
I20260709 13:11:33.395052 31579 raft_consensus.cc:740] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:33.444181 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:33.451586 27275 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:11:33.451997 27274 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:33.389268 31657 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.455770 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:33.456132 27274 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:33.456451 27275 raft_consensus.cc:2368] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14.
I20260709 13:11:33.457948 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:11:33.451248 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 707299us
W20260709 13:11:33.450475 26622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.012s	sys 0.015s
W20260709 13:11:33.459426 26622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.013s	sys 0.015s
W20260709 13:11:33.460088 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 650067us
I20260709 13:11:33.442381 26625 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:33.461241 31690 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:33.467634 27270 raft_consensus.cc:2368] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14.
I20260709 13:11:33.468698 27241 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:33.479725 27241 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:33.489147 26583 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:11:33.489782 26583 pending_rounds.cc:85] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 10
I20260709 13:11:33.490075 26583 pending_rounds.cc:107] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:11:33.490803 26583 raft_consensus.cc:2889] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:33.463449 31749 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:33.497253 26548 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:33.501863 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:33.502436 26583 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:33.509729 26659 raft_consensus.cc:1240] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:11:33.519027 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 51828.9us
I20260709 13:11:33.520124 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:33.446458 31689 consensus_queue.cc:1059] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:11:33.550490 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:33.498071 31563 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:33.478838 31748 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.559528 31748 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.471681 31438 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:33.562536 31438 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.507751 31749 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.466524 31257 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:11:33.464672 31690 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.549666 31466 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:33.492278 31715 consensus_queue.cc:1059] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:11:33.597435 26583 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:11:33.605502 31747 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:33.653337 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.597152 31606 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:33.593192 31523 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.529255 31579 consensus_queue.cc:260] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.596115 31689 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:33.604148 31687 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.659526 31261 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:11:33.720257 31754 log.cc:927] Time spent T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:11:33.720405 31657 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:33.717039 31533 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:33.723199 31533 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.724012 26578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 965) took 1323 ms. Trace:
I20260709 13:11:33.725665 27277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 814) took 1473 ms. Trace:
I20260709 13:11:33.727639 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:33.728384 26581 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:33.725971 26578 rpcz_store.cc:276] 0709 13:11:32.401007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.402927 (+  1920us) service_pool.cc:224] Handling call
0709 13:11:32.450218 (+ 47291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.386767 (+936549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.723760 (+336993us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54001a9ad4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:33.723937 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152590592}
I20260709 13:11:33.725622 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 3001) took 1319 ms. Trace:
I20260709 13:11:33.726596 27277 rpcz_store.cc:276] 0709 13:11:32.252167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.532226 (+280059us) service_pool.cc:224] Handling call
0709 13:11:33.725487 (+1193261us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54006680d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:33.725618 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517867904}
I20260709 13:11:33.660221 31747 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:33.732120 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.732996 26501 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:33.731312 26502 rpcz_store.cc:276] 0709 13:11:32.405845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.677279 (+271434us) service_pool.cc:224] Handling call
0709 13:11:32.709470 (+ 32191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.720376 (+ 10906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.720432 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.720986 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.418878 (+697892us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:33.418937 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.419030 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.725403 (+306373us) raft_consensus.cc:1685] finished
0709 13:11:33.725423 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.725544 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1062,"raft.queue_time_us":3092,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":7801,"thread_start_us":626504,"threads_started":1,"wal-append.queue_time_us":908828}
I20260709 13:11:33.664052 31392 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:33.707702 31755 raft_consensus.cc:3055] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:33.708289 31523 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.743134 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:33.721499 31261 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:33.746008 26501 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:33.725782 31017 consensus_queue.cc:1175] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "af1b5d6d444447b7a580afb4aff33320" responder_term: 12 status { last_received { term: 12 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 12 index: 8 } }
I20260709 13:11:33.736800 31579 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:33.751303 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:33.754045 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 234044us
I20260709 13:11:33.755012 26548 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:33.742026 31755 raft_consensus.cc:740] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:33.747294 31421 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.757829 31248 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:33.758353 26548 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:33.736965 31747 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.739164 31544 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.761909 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:33.757145 31640 raft_consensus.cc:3055] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:33.746287 31392 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.767763 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:33.767616 31689 raft_consensus.cc:2764] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:11:33.771755 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:33.773624 26580 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:33.776015 31758 log.cc:927] Time spent T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:11:33.780875 26580 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:33.763340 31421 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:33.783789 31687 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:11:33.787950 31753 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:11:33.761837 31533 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.779070 31675 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:33.790535 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:33.769129 31640 raft_consensus.cc:740] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:33.793653 31523 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.800905 31748 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.803196 31640 consensus_queue.cc:260] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.805353 26501 raft_consensus.cc:2468] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:33.806633 31421 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:33.808954 31604 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.812011 31544 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:33.813881 26510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46306 (request call id 6) took 1257 ms. Trace:
I20260709 13:11:33.813445 26581 raft_consensus.cc:2468] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:33.816861 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.817796 31532 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:33.836254 26501 raft_consensus.cc:2410] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:11:33.821669 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:33.835075 26510 rpcz_store.cc:276] 0709 13:11:32.556259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.710807 (+154548us) service_pool.cc:224] Handling call
0709 13:11:33.813614 (+1102807us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400353ed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92f735 00007f88318efd29 00007f882ae6e1d4 00007f882ae6e162 00007f882ae6e091 00007f882ae6e00c 00007f882ae6d2c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:33.813797 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872629120}
I20260709 13:11:33.838236 26653 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:33.830978 26548 leader_election.cc:400] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14.
W20260709 13:11:33.843169 26474 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.878s (SENT) [suppressed 1 similar messages]
I20260709 13:11:33.805673 31690 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:33.837751 31757 log.cc:927] Time spent T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
I20260709 13:11:33.850771 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.855055 26653 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:33.860196 31458 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.844451 31748 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:11:33.862485 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.845394 31533 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:11:33.863175 26509 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:33.863550 31533 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:33.864120 31533 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:33.864176 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.820031 31755 consensus_queue.cc:260] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.844609 31640 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:33.869297 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:33.870201 26510 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:33.871634 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.872810 26509 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:33.874009 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.771550 31261 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.876956 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.837561 31644 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.881281 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.882951 31261 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:33.884848 26656 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:33.884971 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.885905 26509 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:33.886963 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.865406 31533 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.894302 31747 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:33.895033 31533 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:33.895678 31703 consensus_meta.cc:287] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.785s	user 0.007s	sys 0.005s
I20260709 13:11:33.896085 31703 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.897657 31644 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.847632 31604 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:11:33.899300 26548 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:33.900075 31747 raft_consensus.cc:2804] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:33.900274 31644 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:33.900584 31747 raft_consensus.cc:697] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 15 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:33.901155 31392 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:33.901456 31747 consensus_queue.cc:237] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.905587 26651 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:33.906081 26548 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:33.906412 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:33.906833 31604 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:33.906986 26501 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:33.907229 31604 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:33.907639 31604 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:33.910126 31565 raft_consensus.cc:3055] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:33.910650 31565 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:33.911571 31565 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:33.914206 31703 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:33.914569 31604 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.916777 31604 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:33.916958 31770 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:11:33.917533 26501 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:33.917841 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:33.918840 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.919368 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:33.920101 31675 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:33.920475 31675 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.920433 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:33.920995 31675 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:33.921300 26501 raft_consensus.cc:2393] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 15: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:11:33.923285 27270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 807) took 1713 ms (client timeout 1893 ms). Trace:
W20260709 13:11:33.923698 27270 rpcz_store.cc:269] 0709 13:11:32.210126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.347359 (+137233us) service_pool.cc:224] Handling call
0709 13:11:33.923075 (+1575716us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54006117d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:33.923225 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432654080}
I20260709 13:11:33.924780 27269 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:33.889803 26510 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:11:33.930364 26548 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:33.947369 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:33.941262 31604 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:33.942696 31748 raft_consensus.cc:2804] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:11:33.963604 26476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.962636 27243 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:33.956521 31364 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:11:33.967546 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 124399us
I20260709 13:11:33.967942 27243 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:33.974561 26508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59080 (request call id 2628) took 1529 ms (client timeout 1884 ms). Trace:
I20260709 13:11:33.974838 26506 raft_consensus.cc:1275] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:11:33.974964 26508 rpcz_store.cc:269] 0709 13:11:32.444808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.448928 (+  4120us) service_pool.cc:224] Handling call
0709 13:11:33.974384 (+1525456us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54000023d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:33.974503 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454899968}
I20260709 13:11:33.946128 31675 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.963961 31604 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:33.977681 31640 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:33.970768 31748 raft_consensus.cc:697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:33.973614 31134 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:11:33.979028 31558 raft_consensus.cc:2804] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:33.987491 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:33.988765 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.004525 26577 raft_consensus.cc:2393] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 15: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:33.985782 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:33.992688 31748 consensus_queue.cc:237] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:33.994253 31640 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:33.979513 31669 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:11:33.995961 31134 raft_consensus.cc:3055] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:33.999713 31599 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:34.002072 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.981580 31746 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.982239 31604 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:34.012061 26582 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 16: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:34.016510 31134 raft_consensus.cc:740] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:34.014988 31558 raft_consensus.cc:697] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:34.020063 31778 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.040642 26548 leader_election.cc:400] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14.
I20260709 13:11:34.042867 31778 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.042933 31640 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.044857 31749 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:34.045214 31778 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:34.072367 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:34.075433 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.047863 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.028916 31746 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:34.052286 31438 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:34.054659 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 1079) took 2048 ms. Trace:
I20260709 13:11:34.057777 31755 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:34.058177 31134 consensus_queue.cc:260] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:34.059204 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 616854us
I20260709 13:11:34.059679 31676 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:34.143054 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.061908 31461 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.062649 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.062791 31759 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:34.063745 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.064136 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:34.065891 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:34.149706 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:34.146507 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 731b96cedb5749df893a1de699717183: Illegal state: Replica b9c3761688a64982ae1c4aeb758e09ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:34.083415 26580 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:34.087056 26625 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:34.091207 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.201320 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:34.202288 26653 raft_consensus.cc:2368] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14.
I20260709 13:11:34.203356 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:34.204027 26653 raft_consensus.cc:3060] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:34.083089 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:34.078576 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.208123 27277 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:34.211356 26505 raft_consensus.cc:1240] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:34.084543 26654 rpcz_store.cc:276] 0709 13:11:32.006048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.355952 (+349904us) service_pool.cc:224] Handling call
0709 13:11:32.356242 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.356469 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:32.810957 (+454488us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.441725 (+630768us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.992020 (+550295us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b18003f5680. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882980a2a6 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1
0709 13:11:33.993546 (+  1526us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b18003f5680. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:34.054143 (+ 60597us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b18003f5680. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f882c921060 00007f882c933716 00007f882c944287 00007f882c944208
0709 13:11:34.054308 (+   165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:34.054358 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:34.054414 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.054482 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.054600 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":621903,"prepare.queue_time_us":802387,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":626034,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":8889,"spinlock_wait_cycles":38241408,"thread_start_us":1064118,"threads_started":2,"wal-append.queue_time_us":779425}
I20260709 13:11:34.074098 27243 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:34.138343 31675 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:34.072675 31669 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
W20260709 13:11:34.143225 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 52488.9us
I20260709 13:11:34.060883 31541 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:34.247686 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 185121us
I20260709 13:11:34.248842 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.144769 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.081790 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.184481 31558 consensus_queue.cc:237] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.184446 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:34.184851 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.252631 26656 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:34.191561 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:34.192066 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.215072 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:34.216111 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:34.216393 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:34.217590 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:34.251139 26651 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:34.094197 31397 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:34.082144 31694 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:34.082342 31760 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:11:34.220897 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 146880us
I20260709 13:11:34.220956 27269 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:34.271505 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:34.224761 27240 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:34.228953 26653 raft_consensus.cc:2468] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
W20260709 13:11:34.231048 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.273517 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.273592 31746 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:34.221685 31759 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.279683 31759 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:34.189091 31791 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:11:34.187919 31461 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.281975 31461 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:34.146113 31764 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:11:34.236470 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.237771 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:34.282701 31764 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:34.239684 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 30ffd86793fb4eab863861f1047dec1e: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:34.284886 31764 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:34.243182 27278 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:34.243402 31604 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.253430 26659 raft_consensus.cc:1275] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:11:34.258039 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2453) took 1317 ms. Trace:
W20260709 13:11:34.286952 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 200221us
I20260709 13:11:34.262154 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.256094 27276 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
W20260709 13:11:34.290164 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 65525.4us
I20260709 13:11:34.286809 26655 rpcz_store.cc:276] 0709 13:11:32.940193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.940336 (+   143us) service_pool.cc:224] Handling call
0709 13:11:32.961501 (+ 21165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.961746 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:33.440100 (+478354us) log.cc:844] Serialized 14 byte log entry
0709 13:11:34.257609 (+817509us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:34.257682 (+    73us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:34.257751 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.257838 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.257968 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":354855,"prepare.queue_time_us":192815,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":477885,"spinlock_wait_cycles":41188608,"thread_start_us":939574,"threads_started":3,"wal-append.queue_time_us":334542}
I20260709 13:11:34.252267 31657 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:34.291819 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.298715 26582 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 17.
I20260709 13:11:34.326584 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.287253 31541 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:34.330206 26655 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:34.334240 26659 raft_consensus.cc:1240] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:34.335016 31777 consensus_queue.cc:1048] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:11:34.338968 26654 raft_consensus.cc:1275] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:34.314311 31579 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:34.290347 31644 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:34.341820 31604 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:34.343618 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:34.314495 31629 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:11:34.300843 31675 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:34.288327 31544 consensus_queue.cc:1175] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "af1b5d6d444447b7a580afb4aff33320" responder_term: 13 status { last_received { term: 13 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:34.300175 31711 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:34.347295 26582 raft_consensus.cc:1240] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:34.289036 31769 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:34.350713 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.378438 26653 raft_consensus.cc:2410] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:34.359030 31464 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:34.316525 31793 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:11:34.286567 31798 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:34.339076 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 90362.9us
I20260709 13:11:34.364141 31579 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:34.312644 31746 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:34.406975 26501 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:11:34.407454 26501 pending_rounds.cc:85] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 10
I20260709 13:11:34.407685 26501 pending_rounds.cc:107] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:11:34.407960 26501 raft_consensus.cc:2889] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:34.357719 31658 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:11:34.287434 31694 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:34.370803 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 81940us
I20260709 13:11:34.295092 31669 consensus_queue.cc:1059] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:11:34.351016 26549 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.288944 31760 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:34.359338 31461 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:34.408067 31579 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:34.354146 31795 log.cc:927] Time spent T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:11:34.362851 31657 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:34.394941 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:34.401515 26473 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:34.404630 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:34.485790 26505 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
W20260709 13:11:34.486022 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 84616.5us
I20260709 13:11:34.405817 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:34.287457 31397 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:34.422379 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet e14f699cfba34b90b5f92484e9fd0ddc: Illegal state: Replica af1b5d6d444447b7a580afb4aff33320 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:34.421187 31781 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.450s	user 0.005s	sys 0.000s
I20260709 13:11:34.421700 31746 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:34.454092 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 103179us
W20260709 13:11:34.426632 31732 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:34.490181 26549 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.378247 31675 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.464193 31797 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:34.488251 31669 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:34.493639 31397 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:34.465883 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.495008 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.495575 26655 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:34.496022 31690 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:34.496351 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.497435 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:34.498098 26655 raft_consensus.cc:2368] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13.
I20260709 13:11:34.407589 31438 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:11:34.466519 31802 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:34.467258 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.468608 26653 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 16 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:11:34.469893 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.470397 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:34.504902 26656 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 16: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:11:34.474346 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 78676.7us
I20260709 13:11:34.477173 26650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 1086) took 1828 ms. Trace:
I20260709 13:11:34.373484 31644 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:34.388166 31720 consensus_queue.cc:1059] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:11:34.486920 26473 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:34.457470 31458 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:34.409658 31629 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:11:34.324877 31703 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:11:34.389338 31464 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:34.498876 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.472245 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.505435 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.385097 31769 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:34.506785 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.505491 26650 rpcz_store.cc:276] 0709 13:11:32.648808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.648959 (+   151us) service_pool.cc:224] Handling call
0709 13:11:32.649295 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.649551 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:33.298310 (+648759us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.916433 (+618123us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:34.475009 (+558576us) log.cc:844] Serialized 14 byte log entry
0709 13:11:34.476732 (+  1723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:34.476791 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:34.476869 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.476944 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.477098 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":578282,"prepare.queue_time_us":556340,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":628560,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":19579,"spinlock_wait_cycles":2677120,"thread_start_us":1294947,"threads_started":5,"wal-append.queue_time_us":443017}
I20260709 13:11:34.450242 31749 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:11:34.454035 31747 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:11:34.513871 26473 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:34.515726 26652 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:11:34.520152 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 137497us
I20260709 13:11:34.525180 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.486660 31599 consensus_queue.cc:1059] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 13:11:34.568897 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.569864 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 56124.3us
I20260709 13:11:34.519387 31532 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:34.575474 26503 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:11:34.578495 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 106342us
W20260709 13:11:34.580531 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 90476.4us
I20260709 13:11:34.581367 26549 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.584460 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.575026 31397 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:34.591027 26503 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:34.590137 26549 leader_election.cc:400] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14.
I20260709 13:11:34.512825 31802 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.595049 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:34.596227 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet c46a2e31548b4665b067897f6ebe9bf9: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:34.602334 27276 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:34.591638 26549 leader_election.cc:403] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:34.568686 31458 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:34.595993 26504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2621) took 2288 ms. Trace:
I20260709 13:11:34.606165 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.605257 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:34.583119 31801 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:34.606119 26504 rpcz_store.cc:276] 0709 13:11:32.308053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.309794 (+  1741us) service_pool.cc:224] Handling call
0709 13:11:32.310060 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.313240 (+  3180us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:33.185996 (+872756us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.573342 (+387346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.573398 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:33.573453 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.595767 (+1022314us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b540008f2d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:34.595815 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.595937 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148,"prepare.queue_time_us":350454,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":4085,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6215,"spinlock_wait_cycles":6855040,"thread_start_us":1165690,"threads_started":2,"wal-append.queue_time_us":576858}
I20260709 13:11:34.611421 31747 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14.
I20260709 13:11:34.611348 31749 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:34.588971 31687 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:11:34.586374 31657 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.614640 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.616052 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.616631 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:34.617316 26655 raft_consensus.cc:2368] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13.
I20260709 13:11:34.618093 27276 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:34.591440 31397 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.614856 31678 raft_consensus.cc:3055] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:34.622871 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.595842 31438 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:34.625439 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.633601 31644 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:34.634747 31805 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:34.626807 27276 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:34.627897 26583 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:34.628168 31694 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:34.625177 31678 raft_consensus.cc:740] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:34.641587 31678 consensus_queue.cc:260] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.642050 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.642647 31678 raft_consensus.cc:3060] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:34.642858 26656 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
W20260709 13:11:34.644933 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.625348 31397 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:34.629937 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.651315 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39256 (request call id 1090) took 1139 ms. Trace:
I20260709 13:11:34.632325 31802 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:34.605624 31797 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:34.592518 31759 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:34.651773 26658 rpcz_store.cc:276] 0709 13:11:33.511621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.511804 (+   183us) service_pool.cc:224] Handling call
0709 13:11:33.512130 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.615602 (+1103472us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4800240258. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8831852aa1 00007f8831849b37 00007f88318499ca 00007f883194126f 00007f8831940f37 00007f883195555c 00007f8831955508 00007f8831955488 00007f8831955443 00007f88319546ec 00007f883087ea96
0709 13:11:34.650787 (+ 35185us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b180029d580. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882c4d14bc 00007f882981f48b 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f8829839455 00007f882c921060 00007f882c921bfb 00007f882c92c64b
0709 13:11:34.650919 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.650945 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:34.651048 (+   103us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:34.651090 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.651152 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.651258 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":550758,"raft.queue_time_us":677481,"raft.run_cpu_time_us":5193,"raft.run_wall_time_us":407174,"spinlock_wait_cycles":68523136,"thread_start_us":134230,"threads_started":1}
W20260709 13:11:34.654973 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 59695.9us
I20260709 13:11:34.653355 27275 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:34.658200 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:34.657449 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:34.660001 27276 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:34.663182 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:34.664532 26577 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:34.667666 26622 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:34.656394 31797 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:34.667325 31802 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:34.683552 31760 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:34.691576 31464 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:34.692070 26584 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:11:34.695122 26550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.697340 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.676662 31676 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:34.699039 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 109039us
I20260709 13:11:34.700516 26549 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.701157 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.666430 31759 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.706344 26549 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.688094 31802 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.670147 31812 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:11:34.667003 31811 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:34.674562 31658 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:11:34.717641 31421 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:34.727049 31694 raft_consensus.cc:3060] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:34.728852 26584 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:34.730290 31760 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.731125 31760 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.720180 31746 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:34.720026 31579 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.736382 31579 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:34.736981 31769 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:34.737746 31675 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:34.739377 31759 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:34.701013 31676 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:34.740104 31676 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:34.725335 31802 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:34.679495 31715 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:11:34.727602 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.737067 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 162447us
I20260709 13:11:34.775825 26577 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:11:34.776580 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.778923 27275 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:34.725474 26549 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:34.838519 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 113117us
I20260709 13:11:34.839737 26549 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:34.846817 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 67767.6us
I20260709 13:11:34.853621 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:34.856073 27275 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:34.859073 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:34.859845 26625 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:34.860080 26474 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:34.861770 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.863459 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.866348 31533 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:34.866916 31533 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.867779 31710 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.868489 31710 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:34.870494 31769 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:34.869382 31533 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:34.871079 31769 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.876024 26625 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:34.870501 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:34.886837 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:34.727216 31797 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:34.902379 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.903151 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.904225 26625 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:34.845331 31658 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.905350 26474 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:34.788007 31759 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:34.803481 31134 raft_consensus.cc:3060] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:34.901491 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 53270.8us
I20260709 13:11:34.898550 31528 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:34.922207 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:34.916630 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.923884 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:34.924360 26582 raft_consensus.cc:2393] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 17: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:34.860261 31817 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:34.873392 31769 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:34.918685 26549 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.919739 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:34.920132 26506 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:34.924474 27271 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:34.900372 31819 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:34.874187 31532 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:34.906049 31803 log.cc:927] Time spent T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:11:34.884172 31533 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:34.939930 26548 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:34.945912 26549 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.942485 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:34.928742 31797 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:34.949553 31261 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:34.951371 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:34.952205 26653 raft_consensus.cc:2393] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 14: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:34.933080 31759 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.956120 31759 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:34.929257 31817 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:34.958001 31690 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:34.958899 31458 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:34.959442 31458 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:34.959925 31458 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:34.961753 31813 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:34.914934 31679 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:34.915477 31464 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:34.964282 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:34.957310 31817 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:34.969791 31544 consensus_queue.cc:1048] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:11:34.964823 31769 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:34.994459 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 90368.4us
I20260709 13:11:34.922717 31412 consensus_queue.cc:1059] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:34.917232 31392 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:11:34.969074 31759 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:35.008388 26653 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:34.969667 31528 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.927551 31658 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:34.979540 31669 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:35.016703 26655 raft_consensus.cc:1275] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:35.016615 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.021272 31711 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:34.979342 31819 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:35.023161 31694 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:35.023541 31760 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:34.928390 31779 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:11:35.047010 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.986159 31690 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:35.057687 31687 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:35.059011 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:34.967470 31532 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.064441 31669 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:35.023687 31397 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:35.112586 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.067298 31679 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:35.233038 27242 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.081648 31533 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:35.049214 31528 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.082327 31557 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:35.113153 31669 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:35.279635 26581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.039s	sys 0.054s
W20260709 13:11:35.280095 26581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.039s	sys 0.054s
I20260709 13:11:35.071473 31711 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.108084 31687 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:35.103753 31690 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:35.336798 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 431513us
W20260709 13:11:35.337700 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.255159 31679 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.361981 26474 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:35.382527 26474 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:35.278270 31557 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:35.386598 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:35.403105 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 1.32505e+06us
I20260709 13:11:35.403288 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.387701 31392 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:35.416903 31802 consensus_meta.cc:287] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.666s	user 0.005s	sys 0.003s
W20260709 13:11:35.418097 31826 log.cc:927] Time spent T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:11:35.418470 31779 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:35.408202 26474 leader_election.cc:400] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13.
I20260709 13:11:35.390072 31678 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:35.428668 27241 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:35.432579 31466 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:35.434814 31466 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:35.434890 31715 raft_consensus.cc:3055] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:35.435559 31715 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:35.436009 31392 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:35.436530 31392 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:35.437786 31658 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:35.406478 31823 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 13:11:35.438726 31392 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:35.438735 31532 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:35.441033 31563 consensus_queue.cc:1048] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:35.410765 31722 raft_consensus.cc:3055] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:35.442711 31722 raft_consensus.cc:740] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:35.443645 31722 consensus_queue.cc:260] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.444701 31722 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:35.450937 31678 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:35.451565 31678 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.453804 31532 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:35.454429 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.455063 31644 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:35.455636 31644 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:35.406708 31533 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:35.457983 31533 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:35.457969 31458 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.458721 31464 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:35.458757 31533 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:35.460485 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.461104 31533 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:35.461241 26658 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:35.462005 26651 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:35.463487 31644 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:35.464066 31779 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.457242 31837 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:11:35.467168 31678 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:35.454439 31532 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:35.418910 31679 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:35.473641 31827 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.103s	user 0.003s	sys 0.000s
I20260709 13:11:35.474014 31532 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:35.421986 26474 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:35.478154 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 56246.2us
I20260709 13:11:35.478255 31532 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:35.478916 31532 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.479522 31532 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:35.480026 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:35.480909 31392 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:35.485862 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.491755 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.494537 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.504238 26651 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:11:35.493618 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.436561 31715 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.521982 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:35.485509 31676 consensus_meta.cc:287] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.745s	user 0.004s	sys 0.009s
I20260709 13:11:35.524010 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.527805 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:35.489480 31784 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.009s	sys 0.011s
I20260709 13:11:35.528155 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:35.530737 26548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.534854 27240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.001s	sys 0.009s
W20260709 13:11:35.535374 27240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.001s	sys 0.009s
I20260709 13:11:35.417438 31802 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.536617 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.537737 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:35.504571 31464 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:35.541327 26503 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
W20260709 13:11:35.536020 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 592707us
W20260709 13:11:35.543728 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 72300.1us
I20260709 13:11:35.526949 31678 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.525766 31769 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:35.550858 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.532821 31784 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.009s	sys 0.011s
I20260709 13:11:35.554742 26503 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:11:35.555375 26503 pending_rounds.cc:85] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 10
I20260709 13:11:35.555882 26503 pending_rounds.cc:107] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:11:35.556205 26503 raft_consensus.cc:2889] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:35.557106 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:35.558570 27272 raft_consensus.cc:1240] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:35.558198 26659 raft_consensus.cc:2393] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:35.533273 31421 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:35.561856 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:35.537022 31844 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:35.544133 31715 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:35.562451 27271 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:35.566838 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:35.558146 31769 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:35.531226 31676 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.591120 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:35.606997 30654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.012s	sys 0.025s
I20260709 13:11:35.597158 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:35.617107 30654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.012s	sys 0.025s
I20260709 13:11:35.571334 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:35.571903 26584 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:35.577167 26577 raft_consensus.cc:1240] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:35.592679 26652 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:35.594916 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:35.558341 31678 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.608392 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:35.633455 26506 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 13: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:35.610298 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:35.612409 26580 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:11:35.585191 31134 consensus_meta.cc:287] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
I20260709 13:11:35.622220 26473 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:35.634182 27271 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:35.651742 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:35.576435 31687 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:35.652801 27269 raft_consensus.cc:1275] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:35.580016 31710 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:35.549667 31464 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.606971 31792 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:35.663868 26654 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:35.567816 31843 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.683771 31843 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:35.684118 31678 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:35.684202 31817 consensus_meta.cc:287] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.693s	user 0.004s	sys 0.007s
I20260709 13:11:35.684778 31678 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:35.685230 31678 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.685969 31843 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:35.686820 31464 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:35.687986 31364 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.688496 31364 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.689947 27278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 1148) took 1043 ms. Trace:
I20260709 13:11:35.690704 31364 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:35.616078 31694 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:11:35.569430 31844 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.583307 31669 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.639130 31849 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.679567 31769 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:35.680760 31802 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:35.568125 31421 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:35.692230 31678 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:35.690308 27278 rpcz_store.cc:276] 0709 13:11:34.646162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.654665 (+  8503us) service_pool.cc:224] Handling call
0709 13:11:34.656133 (+  1468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.656484 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.656511 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.669072 (+ 12561us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.299898 (+630826us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b180044b720. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c90d1 00007f882c8e4a0f
0709 13:11:35.400563 (+100665us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:35.400618 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.400712 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.689649 (+288937us) raft_consensus.cc:1685] finished
0709 13:11:35.689669 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.689884 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6356,"spinlock_wait_cycles":3020032,"thread_start_us":100408,"threads_started":1,"wal-append.queue_time_us":946968}
I20260709 13:11:35.714671 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:35.735571 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 179582us
I20260709 13:11:35.719558 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:35.737169 26549 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:35.736408 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 194170us
I20260709 13:11:35.740091 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.585525 31532 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:35.724054 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.742153 26657 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:35.743108 26505 raft_consensus.cc:2368] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 17. Current term is 18.
I20260709 13:11:35.647794 31720 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:11:35.683184 31565 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:35.746729 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 124615us
I20260709 13:11:35.751343 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:35.752377 31687 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:35.754237 31687 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:35.754725 31687 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:35.755168 31687 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:35.758082 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:35.759322 26508 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:35.761615 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:35.763826 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:35.763417 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:35.772316 26580 raft_consensus.cc:1240] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:35.773021 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.772316 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.777158 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.777498 26622 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:35.778383 31802 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:35.779959 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.780601 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.780952 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.781234 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.782023 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.782442 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.782630 26576 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15.
I20260709 13:11:35.783519 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:35.784161 26581 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:35.786073 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.787810 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:35.788110 31703 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:35.788923 31703 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:35.792403 31703 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:35.797326 26476 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:35.799263 26651 raft_consensus.cc:2393] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 8: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:35.799922 31532 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 18 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:35.802654 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:35.803817 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:35.809576 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:35.807650 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:35.812153 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 60905us
I20260709 13:11:35.811082 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.814009 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:35.818504 26581 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 18.
I20260709 13:11:35.821314 26476 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:35.810299 26508 raft_consensus.cc:2393] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 12: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:35.684939 31817 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:35.802448 31842 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:11:35.995746 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.972834 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:36.027489 26653 raft_consensus.cc:2393] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:36.056777 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:36.087888 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 266657us
I20260709 13:11:36.088888 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:36.090396 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:36.104086 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 192373us
I20260709 13:11:35.855978 31769 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:36.112643 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:36.115486 26576 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:35.857937 31802 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:36.129863 26656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.046s	sys 0.117s
I20260709 13:11:35.857862 31710 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:36.133260 26656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.046s	sys 0.117s
W20260709 13:11:36.169701 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 416378us
I20260709 13:11:35.713792 31792 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.178992 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:35.802703 31850 consensus_queue.cc:1048] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.319s
I20260709 13:11:35.962311 31852 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:36.108487 31828 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.202950 30654 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.734108 31849 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.131338 31847 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:36.172865 31532 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:36.180835 31710 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.203577 30654 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.223361 31792 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:36.230536 31715 consensus_meta.cc:287] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 13:11:36.205241 31852 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:36.235172 31862 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:11:36.236485 31857 log.cc:927] Time spent T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:11:36.331270 27278 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:36.243652 31849 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.245993 31421 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.247402 31844 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.196355 31828 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.255518 31817 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:36.191802 31778 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:36.266386 31720 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:36.182134 31802 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.271711 31847 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:36.283113 31755 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.008s	sys 0.036s
I20260709 13:11:36.343734 30654 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:36.346772 31565 consensus_meta.cc:287] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
I20260709 13:11:36.369179 31669 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:36.364705 31755 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.008s	sys 0.037s
I20260709 13:11:36.383078 31852 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.385087 31828 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.389338 31710 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.391274 31802 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.364336 31778 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.365013 31720 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.395780 31720 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:36.396332 31687 consensus_meta.cc:287] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.000s
W20260709 13:11:36.451143 26503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.011s	sys 0.032s
W20260709 13:11:36.519905 26503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.012s	sys 0.032s
I20260709 13:11:36.513378 31873 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:36.523677 26503 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:11:36.451386 26549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.010s	sys 0.007s
I20260709 13:11:36.453538 26579 raft_consensus.cc:2410] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:36.457460 26510 raft_consensus.cc:1275] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:11:36.276201 26657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.016s	sys 0.026s
I20260709 13:11:36.481141 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:36.530087 26657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.016s	sys 0.026s
I20260709 13:11:36.530761 26658 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:36.483222 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:36.484970 27273 consensus_meta.cc:287] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.867s	user 0.010s	sys 0.001s
I20260709 13:11:36.534650 31669 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:36.535071 27273 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 8.
I20260709 13:11:36.536862 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:36.485644 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:36.399528 31778 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:36.398262 31847 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:36.513691 31532 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:36.541960 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 3124) took 1642 ms. Trace:
I20260709 13:11:36.542315 31532 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.542755 26584 rpcz_store.cc:276] 0709 13:11:34.899093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.899228 (+   135us) service_pool.cc:224] Handling call
0709 13:11:34.899547 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.618341 (+718794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.541361 (+923020us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b5400254254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:36.541738 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1545389312}
W20260709 13:11:36.517308 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 411781us
I20260709 13:11:36.546942 26476 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:36.550081 26509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59084 (request call id 3027) took 2144 ms. Trace:
I20260709 13:11:36.550781 31792 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:36.523490 31873 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.550653 26509 rpcz_store.cc:276] 0709 13:11:34.405355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.408757 (+  3402us) service_pool.cc:224] Handling call
0709 13:11:34.409015 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.520018 (+111003us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:34.530990 (+ 10972us) log.cc:844] Serialized 14 byte log entry
0709 13:11:34.731732 (+200742us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b1800438460. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f882983ea40 00007f88298394e4 00007f8829839455 00007f882c921060 00007f882c933716 00007f882c944287 00007f882c944208
0709 13:11:34.731941 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:34.732002 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:34.732058 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.549479 (+1817421us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000b40d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:36.549621 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.549888 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4733,"prepare.queue_time_us":10846,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2160,"raft.queue_time_us":165520,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":265043200}
I20260709 13:11:36.552522 31861 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:36.524956 26549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.011s	sys 0.007s
I20260709 13:11:36.554787 26502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55308 (request call id 784) took 1007 ms. Trace:
I20260709 13:11:36.555351 26502 rpcz_store.cc:276] 0709 13:11:35.547388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.547552 (+   164us) service_pool.cc:224] Handling call
0709 13:11:35.547908 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.691030 (+143122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:35.691061 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:35.691107 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:35.691142 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.554244 (+863102us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001842d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:36.554327 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.554562 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328711424}
I20260709 13:11:36.550029 26476 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:36.565351 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 393017us
I20260709 13:11:36.578399 31532 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.582360 26473 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:36.584091 31861 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:36.584937 31458 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.587476 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:36.588213 31458 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:36.585095 31861 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:36.590482 26506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.006s	sys 0.005s
I20260709 13:11:36.589325 31458 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:36.592986 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:36.593338 31458 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:36.596433 31876 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:36.597452 31687 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.597465 31876 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.581460 26476 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:36.598631 31557 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:36.599483 31438 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:36.600816 31861 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:36.600605 31438 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.601321 31861 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:36.603549 31438 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.605080 31544 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.605947 31544 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.608997 31544 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.609699 31544 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:36.610452 31544 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.611120 31676 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.612958 31544 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.613319 31528 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.614131 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:36.615633 31563 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:36.616357 31879 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:36.617347 31879 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.617111 27241 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:36.640805 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:36.642195 31532 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:36.642705 31532 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:36.643134 31532 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:36.650611 31879 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:36.653117 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:36.660843 31749 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:36.661705 31749 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.662637 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:36.663512 26476 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:36.664101 31749 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.665000 31792 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:36.653205 31811 raft_consensus.cc:3055] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:36.665742 31792 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 18 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:36.666026 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:36.600657 31687 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.667141 26652 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:36.600842 31876 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.666002 31811 raft_consensus.cc:740] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:36.675935 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:36.676548 31811 consensus_queue.cc:260] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:36.678619 27273 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
W20260709 13:11:36.666026 31838 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 1.129s	user 0.008s	sys 0.004s
I20260709 13:11:36.686635 31813 consensus_queue.cc:1059] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:11:36.689860 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 73084.4us
I20260709 13:11:36.709455 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:36.709815 31811 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:36.722844 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:36.721779 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:36.734834 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:36.736258 26658 raft_consensus.cc:2393] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 9: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:36.688253 31792 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:36.739012 26652 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:36.742491 31746 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 13:11:36.761134 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 75793.9us
I20260709 13:11:36.765162 31778 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:36.765739 31778 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:36.766150 31778 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:36.768332 26654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 2285) took 1277 ms. Trace:
I20260709 13:11:36.768764 26654 rpcz_store.cc:276] 0709 13:11:35.490927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.493982 (+  3055us) service_pool.cc:224] Handling call
0709 13:11:36.768016 (+1274034us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540025a3d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:36.768150 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298985856}
I20260709 13:11:36.770548 27269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34964 (request call id 832) took 2375 ms. Trace:
I20260709 13:11:36.770970 27269 rpcz_store.cc:276] 0709 13:11:34.394797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.394906 (+   109us) service_pool.cc:224] Handling call
0709 13:11:34.398500 (+  3594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.659447 (+1260947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.770046 (+1110599us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54006f1154. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:36.770328 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2883727232}
I20260709 13:11:36.773272 31854 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:36.774037 31854 raft_consensus.cc:697] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:36.774592 31861 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.775620 31854 consensus_queue.cc:237] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.777223 31778 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.778700 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:36.778782 26549 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:36.779621 31778 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:36.779799 26655 raft_consensus.cc:2393] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:36.780938 31861 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.783605 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:36.765188 26501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59080 (request call id 2658) took 1754 ms. Trace:
I20260709 13:11:36.786051 26501 rpcz_store.cc:276] 0709 13:11:34.979951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.980153 (+   202us) service_pool.cc:224] Handling call
0709 13:11:34.994274 (+ 14121us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:34.994705 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.994734 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:35.015183 (+ 20449us) log.cc:844] Serialized 52 byte log entry
0709 13:11:35.339655 (+324472us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:35.339900 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.340294 (+   394us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:36.665029 (+1324735us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:36.730201 (+ 65172us) raft_consensus.cc:1685] finished
0709 13:11:36.730223 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.733723 (+  3500us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4103,"raft.queue_time_us":1003,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":24913,"spinlock_wait_cycles":6273280,"thread_start_us":239124,"threads_started":1,"wal-append.queue_time_us":334140}
I20260709 13:11:36.790452 31873 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:36.790799 31889 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:11:36.792903 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:36.793709 26576 raft_consensus.cc:1275] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:36.785303 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:36.797636 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 83921.9us
I20260709 13:11:36.798172 27241 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:36.807601 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:36.803818 31544 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:36.808836 31544 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:36.809398 31544 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:36.817797 26548 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:36.820832 26652 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 18.
I20260709 13:11:36.823721 31764 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.825368 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:36.826701 31764 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.822602 31687 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:36.829533 31764 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.830281 31687 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:36.843112 31711 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.835610 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:36.845319 31690 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.846614 31779 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:36.820284 31813 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:36.845148 27277 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:36.854471 26474 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:36.854911 31604 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.855538 31604 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.858342 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:36.858554 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:36.860607 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 54354us
I20260709 13:11:36.860841 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:36.860994 31438 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:36.861819 26576 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 9.
I20260709 13:11:36.862104 31438 raft_consensus.cc:697] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:36.863435 31438 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.864605 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 3132) took 1434 ms. Trace:
W20260709 13:11:36.861361 26579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39940 (request call id 989) took 2814 ms (client timeout 2887 ms). Trace:
W20260709 13:11:36.868155 26579 rpcz_store.cc:269] 0709 13:11:34.047360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.047536 (+   176us) service_pool.cc:224] Handling call
0709 13:11:36.861125 (+2813589us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b5400021554. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:36.861286 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5463227776}
I20260709 13:11:36.868854 31749 raft_consensus.cc:3055] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:36.869484 31749 raft_consensus.cc:740] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:36.870882 31749 consensus_queue.cc:260] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.873037 31749 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:36.865120 26577 rpcz_store.cc:276] 0709 13:11:35.429958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.431166 (+  1208us) service_pool.cc:224] Handling call
0709 13:11:35.431431 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.618610 (+187179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.864013 (+1245403us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540032ebd4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:36.864367 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334638464}
I20260709 13:11:36.877727 31637 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:36.819608 31532 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:36.880157 27270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34964 (request call id 824) took 2688 ms (client timeout 1792 ms). Trace:
I20260709 13:11:36.880015 31458 consensus_queue.cc:1048] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:36.822522 31397 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:36.880710 27270 rpcz_store.cc:269] 0709 13:11:34.191205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.191328 (+   123us) service_pool.cc:224] Handling call
0709 13:11:36.879736 (+2688408us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54005ac8d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:36.879953 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310773632}
I20260709 13:11:36.844219 31687 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:36.910734 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 2287) took 1416 ms. Trace:
I20260709 13:11:36.911358 26659 rpcz_store.cc:276] 0709 13:11:35.491765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.493722 (+  1957us) service_pool.cc:224] Handling call
0709 13:11:36.877477 (+1383755us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54001d47d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:36.908455 (+ 30978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67895040}
I20260709 13:11:36.917738 31644 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:36.919838 31678 consensus_meta.cc:287] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 1.117s	user 0.006s	sys 0.015s
I20260709 13:11:36.920531 31678 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.925933 31532 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:36.930063 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:36.930116 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:36.942605 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:36.941373 26504 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:36.947404 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:36.954303 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:36.953951 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:36.925817 31604 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:36.962925 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 108722us
I20260709 13:11:36.957811 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:36.959028 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:36.967269 27277 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:36.959172 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:36.975235 31458 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.975875 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:36.976320 31675 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:36.977152 31675 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:36.977823 31855 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.978579 31855 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:36.979862 31675 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:36.982359 31824 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 1.887s	user 0.005s	sys 0.008s
W20260709 13:11:36.984437 31891 log.cc:927] Time spent T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:11:36.986910 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:36.992556 27274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46398 (request call id 1152) took 2210 ms. Trace:
I20260709 13:11:36.993055 27274 rpcz_store.cc:276] 0709 13:11:34.782416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.783037 (+   621us) service_pool.cc:224] Handling call
0709 13:11:34.783385 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.845761 (+ 62376us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:35.121957 (+276196us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.488095 (+366138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:35.504711 (+ 16616us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.504931 (+   220us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:35.504986 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.505092 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:36.991148 (+1486056us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b24000d47c8. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f88296c29c4 00007f88296c0acb 00007f882987bdc9 00007f882987ba55 00007f882987afb0 00007f882c4f1488 00007f882c4f1be8 00007f882c4c9398 00007f882c4c476a 00007f882c4c3bb6
0709 13:11:36.991926 (+   778us) raft_consensus.cc:1685] finished
0709 13:11:36.992087 (+   161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.992261 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92556,"prepare.queue_time_us":143798,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":78970,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":32419,"spinlock_wait_cycles":36969856,"thread_start_us":564974,"threads_started":2,"wal-append.queue_time_us":536570}
I20260709 13:11:36.995347 31678 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:36.978886 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45033.3us
I20260709 13:11:37.004539 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.006616 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:37.018636 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.024132 27269 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:37.021420 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.025767 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:36.980908 31855 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.029554 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.031880 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:37.033764 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.031502 26502 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:37.037966 26474 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:36.975922 31458 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.049685 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.051169 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.051465 31847 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:37.054814 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.055449 31847 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.056607 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.054862 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:37.051667 31458 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.071560 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.071976 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:37.073050 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.073889 27276 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 13: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:37.073942 31764 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:37.074827 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:37.075001 31764 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:37.075372 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.076138 27278 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:37.077483 31843 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.078011 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.078186 31843 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.078609 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.079017 26657 raft_consensus.cc:2410] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:11:37.078202 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.080700 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.075533 31764 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.081097 31843 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.081485 31764 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:37.077286 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.064857 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.088049 27278 raft_consensus.cc:2410] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:37.088690 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:37.089494 26501 raft_consensus.cc:2368] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14.
I20260709 13:11:37.091424 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:37.092379 27269 raft_consensus.cc:2393] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 12: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:37.095257 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.098035 26583 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:37.100975 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:37.094380 31856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.010s	sys 0.023s
I20260709 13:11:37.086087 31669 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:37.097853 31850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.017s	sys 0.001s
I20260709 13:11:37.112816 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.114250 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.116285 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.111528 26548 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:37.107290 31856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.011s	sys 0.024s
W20260709 13:11:37.113761 31850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.017s	sys 0.002s
I20260709 13:11:37.123270 31895 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:37.124497 31895 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.097954 31813 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:37.126063 31813 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.126962 31895 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:37.123360 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 101454us
I20260709 13:11:37.131757 31813 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.104936 31678 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:37.133956 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45778.6us
I20260709 13:11:37.136907 26476 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.141837 27278 raft_consensus.cc:1240] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:37.144970 26473 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:37.143654 31678 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:37.146979 31897 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:11:37.136349 31811 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.152109 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
W20260709 13:11:37.152657 31901 log.cc:927] Time spent T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:11:37.153661 26476 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:37.152211 26505 raft_consensus.cc:1240] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:37.155573 26473 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:37.165122 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.166747 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.158695 31861 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:11:37.182091 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 79411.6us
I20260709 13:11:37.184038 31599 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.184847 31599 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.186717 31746 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:37.187374 31746 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:37.187770 31746 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:37.188369 31644 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.188946 31644 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.189633 31854 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:37.190181 31854 raft_consensus.cc:697] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:37.191250 31644 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.191578 31854 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:37.192515 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 51596.8us
I20260709 13:11:37.193912 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:37.194173 26474 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.194739 26576 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:37.196063 31533 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:37.197448 26474 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:37.197867 30719 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:11:37.198210 31850 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:37.198683 31850 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:37.199129 31850 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:37.199255 30654 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:37.201632 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.202423 26577 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:37.203761 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.163509 31669 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:37.160020 31679 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:37.163241 31792 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:37.212405 26584 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:37.212639 31533 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:37.162700 31811 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.205827 31861 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:37.220853 31847 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.221757 26622 leader_election.cc:400] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14.
I20260709 13:11:37.221695 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.222504 31544 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:37.231230 31894 log.cc:927] Time spent T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.307s	user 0.004s	sys 0.001s
I20260709 13:11:37.225111 26622 leader_election.cc:403] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:37.218956 31792 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:37.224670 31604 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.219507 31856 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.240628 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.245901 26654 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:37.249980 31843 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:37.250692 31843 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.253733 31856 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.255931 31746 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.257198 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.243188 30654 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:37.261917 27276 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
W20260709 13:11:37.264514 31896 log.cc:927] Time spent T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:11:37.275130 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.274996 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.276062 26582 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:11:37.257608 31792 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.281018 31856 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.283327 31861 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.285106 31861 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:37.286480 26548 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.287461 31397 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:37.288265 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:37.288125 31397 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:37.290907 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 76573.1us
I20260709 13:11:37.242933 31604 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:37.291009 31907 log.cc:927] Time spent T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:11:37.295150 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 79804.2us
I20260709 13:11:37.297968 26585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 999) took 2380 ms. Trace:
I20260709 13:11:37.299924 31873 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:37.298432 26585 rpcz_store.cc:276] 0709 13:11:34.917632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.917826 (+   194us) service_pool.cc:224] Handling call
0709 13:11:34.918262 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.918737 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:34.935468 (+ 16731us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.476371 (+540903us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b180017ec60. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:36.867619 (+1391248us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b180017ec60. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882981ee07 00007f8832679ab9 00007f882983b69b 00007f882983993f 00007f882983bc02 00007f882c4c320b 00007f882c4c8d23 00007f882c4c923a 00007f882c933a2a
0709 13:11:36.961462 (+ 93843us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:37.045850 (+ 84388us) log.cc:844] Serialized 26 byte log entry
0709 13:11:37.079891 (+ 34041us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:37.079931 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.080027 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.297587 (+217560us) raft_consensus.cc:1685] finished
0709 13:11:37.297613 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.297766 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1118,"prepare.queue_time_us":26497,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":11935,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":24141,"spinlock_wait_cycles":118764544,"thread_start_us":78649,"threads_started":1,"wal-append.queue_time_us":2296328}
I20260709 13:11:37.301887 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.300559 31873 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.305217 31798 consensus_queue.cc:1059] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:37.306213 31629 raft_consensus.cc:3055] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:37.308924 26584 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:37.247740 31679 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.314268 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.317054 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.318123 26578 raft_consensus.cc:2393] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 16: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:37.316573 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.306596 31629 raft_consensus.cc:740] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:37.323913 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:37.326145 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.326689 26577 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:37.330245 31906 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:11:37.330796 31397 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.331295 31544 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.328207 31798 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:37.332508 31798 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.309716 31855 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:37.307068 31847 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:37.340682 26577 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 10.
I20260709 13:11:37.400406 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.333107 31687 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:37.309092 31873 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.359710 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:37.400931 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.400007 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.355588 31678 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.334141 31878 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:37.352623 31604 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.321200 31533 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.402134 26576 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:37.362684 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.348428 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.359023 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.344581 31599 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:37.356837 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.335623 31746 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.351578 31843 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.368402 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.362310 26549 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:37.410653 31855 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.400533 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.359182 31764 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.350178 31811 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:37.449704 30654 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14.
I20260709 13:11:37.416326 26476 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:37.408468 31798 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:37.399266 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.359795 31679 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:37.333220 31898 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.283s	user 0.000s	sys 0.004s
I20260709 13:11:37.342451 26503 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:37.452155 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 89928.7us
I20260709 13:11:37.408548 26579 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:37.430315 26581 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
W20260709 13:11:37.431257 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 100327us
I20260709 13:11:37.453768 26582 raft_consensus.cc:2393] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 14: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:37.437738 31878 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:37.440814 30719 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:37.361522 31629 consensus_queue.cc:260] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.402263 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.454960 26474 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:37.441620 26651 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:37.451499 31533 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.463424 26584 raft_consensus.cc:2410] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:37.463770 31533 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.442556 31749 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:37.456226 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.454095 26548 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.474934 26548 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:37.475708 26659 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:37.467217 26502 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:37.477979 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.477993 26505 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:11:37.480146 26549 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:37.481278 26476 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:37.482148 26476 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:37.454236 31854 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:37.489095 27243 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.494413 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.460390 31878 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:37.456441 31687 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:37.475482 31533 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:37.495703 26584 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 11.
I20260709 13:11:37.491261 30719 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.479303 31544 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:37.483922 31438 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:37.488197 31746 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:37.508200 26474 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.488970 31843 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:37.514842 31649 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:37.507735 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.515192 26582 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:37.490262 31678 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:37.517328 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.492609 31854 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.506080 31629 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:37.526022 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.525244 26548 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:37.528014 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.526517 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.530184 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.506886 31687 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:37.508772 31438 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:37.535651 31438 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:37.530427 26507 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:37.542838 30719 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:37.524958 31854 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:37.544510 31720 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:11:37.490964 31850 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.546686 31855 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.547283 31850 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:37.547755 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.547902 31687 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:37.550529 31532 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:37.551012 31532 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:37.551476 31532 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:37.519601 31843 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.552011 31843 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:37.524680 31746 raft_consensus.cc:697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:37.531883 26503 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:37.534179 26508 raft_consensus.cc:2410] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:11:37.565550 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.529816 31678 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:37.586896 31850 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:37.587667 31850 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.589742 31694 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:37.593833 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 74055.5us
I20260709 13:11:37.595562 31764 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.595642 26548 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.602651 26652 raft_consensus.cc:2410] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:11:37.602231 31746 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.607753 31855 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:37.623874 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.624594 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:37.628728 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.631047 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:37.609228 31687 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.639369 26548 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.638824 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.642545 26476 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:37.641399 31694 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:37.657794 26655 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:37.643057 31855 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:37.660876 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:37.665931 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:37.650553 31895 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:37.670379 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 191547us
I20260709 13:11:37.670419 31850 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.659696 31544 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:37.679116 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.678951 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.682988 27240 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:37.683131 31649 consensus_queue.cc:1048] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:37.683404 27243 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.684913 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.651258 31878 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.686379 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.687598 31873 consensus_queue.cc:1059] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:37.692281 31919 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:37.693068 31850 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:37.693804 31678 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.695091 31694 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:37.695804 31563 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:37.699023 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 134829us
I20260709 13:11:37.684947 31649 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:37.710747 30654 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:37.736174 30654 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:37.736330 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 77269.3us
I20260709 13:11:37.736734 30654 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:37.711526 31911 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:11:37.713850 31694 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.672236 31895 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:37.746043 26625 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.746316 31895 raft_consensus.cc:3060] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:37.748344 30719 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:37.748417 31532 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.739375 31687 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.741163 31563 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:37.739827 26549 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:37.676479 31843 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.736080 31649 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.738884 31438 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:37.762985 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 108404us
W20260709 13:11:37.761859 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 77329.5us
W20260709 13:11:37.763602 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 77326.5us
I20260709 13:11:37.766892 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:37.767325 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 88486.3us
I20260709 13:11:37.771565 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:37.772217 26651 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:37.772661 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.774989 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:37.759030 31687 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:37.778414 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.762547 31649 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:37.779065 30654 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.782398 26655 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:37.765232 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "108a6730154b42819badee4f37f31ad8"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36240
I20260709 13:11:37.765030 31764 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:11:37.785916 26652 raft_consensus.cc:606] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.786262 26652 raft_consensus.cc:614] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:37.793886 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.795310 27276 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:37.781662 31687 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:37.796020 31687 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:37.819144 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 45872.4us
I20260709 13:11:37.821974 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.823927 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.824832 27274 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:37.826000 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.827461 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:37.819557 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:37.835714 26584 raft_consensus.cc:1240] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:37.816123 31764 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:37.840919 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:37.841014 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 76435.3us
I20260709 13:11:37.844487 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.846359 30654 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.847307 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.847930 26581 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 16.
I20260709 13:11:37.850765 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.851008 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:37.852221 26581 raft_consensus.cc:2410] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:37.868100 31919 raft_consensus.cc:3055] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:37.868713 31919 raft_consensus.cc:740] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:37.870031 31813 consensus_queue.cc:1059] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:37.871192 31813 raft_consensus.cc:3055] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:37.871517 31813 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:37.872437 31813 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.877111 31930 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:37.926678 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 46104.6us
I20260709 13:11:37.875157 31679 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:37.932896 26651 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:37.949923 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.955816 31918 consensus_queue.cc:1059] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:37.958070 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.960309 26625 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.847955 31854 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:37.965726 31678 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:37.958637 31649 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:37.965941 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:37.966858 27277 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:37.967311 31843 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.967415 31854 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:37.967945 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 148503us
I20260709 13:11:37.958501 31878 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:37.958127 31694 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:37.960343 31918 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:37.970110 26625 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.968231 26502 raft_consensus.cc:2393] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 17: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:37.966490 31798 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:37.972842 31876 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:37.973798 27269 raft_consensus.cc:2368] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 16. Current term is 17.
I20260709 13:11:37.975968 26625 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.976945 31711 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:37.978636 31649 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:37.978785 26625 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:37.979902 31854 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.981637 26582 raft_consensus.cc:1240] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:37.998505 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 63221us
I20260709 13:11:37.985803 27240 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:38.002818 26578 raft_consensus.cc:2468] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:37.964931 31916 consensus_queue.cc:1048] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:38.013871 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.018250 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.021335 27274 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:38.022246 26583 raft_consensus.cc:1240] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:38.022724 27271 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:38.024818 27271 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:11:38.031554 31919 consensus_queue.cc:260] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.038489 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:38.039094 26651 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:38.039165 26549 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:38.043629 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 114204us
I20260709 13:11:38.043721 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:38.044525 27270 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:38.044438 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:37.957152 31895 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.053170 30654 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:38.052992 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:38.059911 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:38.060572 27271 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:38.061703 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:38.061510 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:38.072154 26582 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:38.077726 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.078401 26510 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:38.080809 31855 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:38.076324 30719 consensus_queue.cc:1059] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:38.082316 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:38.083560 31604 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:38.083814 26548 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:38.082116 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 103407us
I20260709 13:11:38.082543 31855 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:38.079555 27243 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.085242 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.043810 31919 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:38.090487 30719 raft_consensus.cc:3055] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:38.101068 30719 raft_consensus.cc:740] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:38.052716 31749 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:38.047001 31694 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:38.105433 26625 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:38.119534 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.121071 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:38.009756 31847 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:11:38.124049 26581 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:37.966529 31678 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.036026 31854 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.062510 31813 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:38.124877 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.080317 31532 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.127931 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.132712 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.088825 31544 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:38.134446 26503 raft_consensus.cc:1240] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:38.135150 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 57878.1us
I20260709 13:11:38.135640 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.099687 31855 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.132920 26507 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:38.136888 26473 leader_election.cc:400] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 16. Current term is 17.
I20260709 13:11:38.146196 26473 leader_election.cc:403] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:38.138123 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 53106.8us
I20260709 13:11:38.147738 26625 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:38.144753 26651 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:38.136987 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.155820 26502 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:38.149977 31397 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:11:38.160180 31895 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:38.161862 31637 raft_consensus.cc:2804] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:38.162428 31637 raft_consensus.cc:697] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:38.162371 31892 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:11:38.161402 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.173765 30654 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:38.174309 30654 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.174609 30654 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:38.169380 30719 consensus_queue.cc:260] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.179286 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.179942 26510 raft_consensus.cc:3060] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:38.182165 31637 consensus_queue.cc:237] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.187703 26577 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:38.187963 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.189605 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.191226 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:38.054102 31930 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.187852 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.136588 31749 raft_consensus.cc:697] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:38.151427 31855 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:38.136550 31927 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.197479 30719 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:38.163476 31921 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:38.209964 26504 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:38.197435 30654 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.136245 31764 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:38.173873 31669 raft_consensus.cc:3060] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:38.227164 26507 raft_consensus.cc:2468] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
W20260709 13:11:38.234776 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 87183.5us
I20260709 13:11:38.236011 26625 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.136482 31746 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:11:38.213649 27270 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
W20260709 13:11:38.215818 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 82371.7us
I20260709 13:11:38.238154 30654 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:38.200832 31916 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:38.207473 26581 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 17.
I20260709 13:11:38.257795 30654 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:38.223815 31764 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:38.260016 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 67778.8us
I20260709 13:11:38.229756 31911 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.247581 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:38.200026 31694 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.215096 31532 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:11:38.278513 26625 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.280869 26580 raft_consensus.cc:2393] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 11: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:38.248196 31916 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:38.248487 31942 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:38.230360 31687 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:38.274976 31900 log.cc:927] Time spent T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:38.273686 31764 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:38.238600 31927 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.291445 26625 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.301589 31694 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:38.302978 31935 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:11:38.304641 31629 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:38.293962 31924 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:38.307986 31924 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.310216 31924 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.275297 31911 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.314101 26576 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:38.315138 26582 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 17.
I20260709 13:11:38.285815 31916 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:38.316888 26510 raft_consensus.cc:2468] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:38.319033 27271 raft_consensus.cc:2468] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:38.323429 26625 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:38.324991 26625 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:38.325985 26510 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:38.327534 26625 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:38.328732 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 192705us
I20260709 13:11:38.287850 31749 consensus_queue.cc:237] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.331765 31930 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.285269 31942 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:38.329488 26548 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:38.335939 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 294381us
I20260709 13:11:38.336903 26548 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.338569 26548 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.339885 26548 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.344714 31694 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:38.341331 31924 raft_consensus.cc:2764] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:11:38.345817 31544 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:38.346905 31925 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:38.347303 26625 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.349018 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.351887 30719 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:38.352597 30719 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:38.353159 30719 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:38.353345 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:38.354156 27270 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:38.317370 31629 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:38.362004 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:38.371816 30654 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:38.372875 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 263562us
I20260709 13:11:38.335636 31942 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:38.379590 27270 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:38.351230 31678 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.381861 26622 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:38.394181 26578 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:38.395948 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:38.396431 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:38.399117 30719 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.380515 31949 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:38.355798 31930 consensus_queue.cc:1059] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:11:38.403740 30719 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:38.408319 26548 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:38.412623 30719 raft_consensus.cc:2804] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:38.391937 31854 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.381752 31951 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:38.414281 30719 raft_consensus.cc:697] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:38.414438 26548 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:38.415947 27271 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:38.417052 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.407685 31629 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:38.405964 31950 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:38.416579 31925 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:38.422462 26548 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:38.433630 31948 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:38.434144 31948 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.434490 31948 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:38.435333 31687 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.437546 31629 raft_consensus.cc:697] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:38.438560 31629 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.421449 31544 raft_consensus.cc:2804] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:38.442627 31544 raft_consensus.cc:697] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:38.443555 31544 consensus_queue.cc:237] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:38.448765 31938 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.187s	user 0.001s	sys 0.002s
I20260709 13:11:38.451866 31927 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.412195 31749 consensus_queue.cc:1059] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:11:38.457224 31669 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 16. Current term is 17.
W20260709 13:11:38.468446 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 46078.9us
I20260709 13:11:38.445091 31764 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:38.471372 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 124138us
I20260709 13:11:38.457979 31925 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:38.468989 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 87281us
I20260709 13:11:38.475569 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.477635 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.478308 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.478792 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.483791 31764 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:38.472263 31687 raft_consensus.cc:2804] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:38.484866 31687 raft_consensus.cc:697] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:38.475890 31925 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:38.485731 31649 raft_consensus.cc:3055] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:38.486183 31649 raft_consensus.cc:740] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:38.430897 30719 consensus_queue.cc:237] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.487118 31649 consensus_queue.cc:260] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.490187 31649 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:38.496264 31687 consensus_queue.cc:237] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.496285 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:38.483701 31911 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.513636 31438 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.516846 26625 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.520337 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:38.524870 26548 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.525482 27275 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:38.528229 26548 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:38.530282 27273 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:38.529736 31544 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:38.540496 31937 log.cc:927] Time spent T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.259s	user 0.002s	sys 0.000s
I20260709 13:11:38.543361 31921 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:38.544039 31921 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:38.549041 27271 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260709 13:11:38.550452 26623 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.553725 31944 consensus_queue.cc:1059] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:38.554179 31687 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:38.554947 31687 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:38.555312 31944 raft_consensus.cc:3055] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:38.555732 31944 raft_consensus.cc:740] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:38.558065 26583 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:38.556555 31944 consensus_queue.cc:260] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.553177 27243 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:38.563709 31919 raft_consensus.cc:2804] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:38.564237 31919 raft_consensus.cc:697] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:38.565189 31919 consensus_queue.cc:237] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.566208 31916 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.567523 31843 raft_consensus.cc:3055] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:38.567950 31843 raft_consensus.cc:740] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:38.568790 31843 consensus_queue.cc:260] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.616969 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:38.616833 31749 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:38.635957 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.636303 31749 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.631088 31925 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.618348 31843 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:38.612051 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:38.654784 26579 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15.
I20260709 13:11:38.576503 31854 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:38.575757 31532 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:38.603925 31932 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:38.610240 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:38.593477 31955 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:38.594552 26659 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:38.665293 31749 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:38.592921 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 120192us
I20260709 13:11:38.666494 26625 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.622555 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.574286 31911 consensus_queue.cc:1059] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:38.590194 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.673955 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:38.675597 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:38.676281 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:38.625654 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:38.585314 26503 raft_consensus.cc:2468] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 17.
I20260709 13:11:38.517760 31942 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.673493 31911 raft_consensus.cc:3055] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:38.677956 31911 raft_consensus.cc:740] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:38.678864 31911 consensus_queue.cc:260] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.679677 31942 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:38.680051 31911 raft_consensus.cc:3060] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:38.594311 31855 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.597903 31948 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.629935 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.600884 31949 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:38.609398 26578 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:38.669015 31944 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:38.635562 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:38.653394 31720 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:38.692931 31720 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.694770 31925 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.695458 31720 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:38.696110 31949 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:38.696642 31949 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.697885 31942 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:38.698513 31942 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:38.699563 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.700685 31942 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:38.700851 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.702507 26653 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:38.598553 26652 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:38.704869 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.676501 26583 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:38.674015 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:38.706679 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:38.707557 26583 raft_consensus.cc:1240] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:38.707901 26584 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:38.677351 26657 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:38.569335 31916 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:38.686736 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.709700 31948 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:38.709815 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:38.710754 26581 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
W20260709 13:11:38.633638 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 49139.6us
I20260709 13:11:38.710774 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:38.664330 31854 raft_consensus.cc:3055] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:38.698029 26585 raft_consensus.cc:1240] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:38.698685 31599 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:38.704938 26652 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:38.705579 26650 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:38.676949 31955 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:38.727119 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:38.686820 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:38.625587 26476 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:38.729089 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 103605us
I20260709 13:11:38.724050 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:38.713479 31854 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:38.725694 31954 raft_consensus.cc:3055] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:38.723302 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:38.729858 26476 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.731207 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:38.688512 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:38.734313 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.736136 27269 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:11:38.771234 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.778501 26654 raft_consensus.cc:2368] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14.
I20260709 13:11:38.778031 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:38.781535 26652 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:38.781456 26474 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:38.698725 31949 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:38.783675 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:38.785058 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:38.787575 26650 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:38.758090 31678 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:38.763187 31954 raft_consensus.cc:740] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:38.774412 31644 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:38.800465 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.808192 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.697902 31921 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:38.811309 26651 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 14.
I20260709 13:11:38.812150 26652 raft_consensus.cc:2393] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 16: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
W20260709 13:11:38.815506 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.819860 27241 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.822376 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:38.823253 26578 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:38.823488 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:38.799206 31949 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:38.824782 26625 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.827768 26651 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:38.788594 31629 consensus_queue.cc:1059] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:11:38.829761 26585 raft_consensus.cc:2393] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:38.777158 31792 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:11:38.830972 26549 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.832247 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:38.784482 31893 consensus_queue.cc:1059] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:11:38.844435 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36240
I20260709 13:11:38.844909 26549 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.845089 26652 raft_consensus.cc:606] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.841099 26656 raft_consensus.cc:1240] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:38.819518 31644 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:38.847787 26549 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.864647 26583 raft_consensus.cc:1240] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:38.865337 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.866822 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:38.872510 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:38.839025 31599 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:38.819258 31746 consensus_queue.cc:1059] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:11:38.878074 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 53501.8us
I20260709 13:11:38.879753 27241 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.875834 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:38.883102 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 96590.7us
I20260709 13:11:38.899427 26578 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 16.
I20260709 13:11:38.900861 26549 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:38.848882 31958 consensus_queue.cc:1059] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:11:38.903056 31919 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:38.903494 31958 raft_consensus.cc:3055] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:38.903954 31958 raft_consensus.cc:740] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:38.906656 26625 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.909628 26476 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:38.912901 26657 raft_consensus.cc:2468] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:38.922096 26658 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:38.864288 31687 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:38.924077 26655 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:38.933120 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:38.935503 26651 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:38.936432 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:38.873086 31920 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:38.862793 31949 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:38.932035 26625 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.938263 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.903712 31711 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:38.936456 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.947547 26506 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 13:11:38.948756 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.945133 30719 consensus_queue.cc:1059] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:11:38.958101 30719 raft_consensus.cc:3055] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:38.958568 30719 raft_consensus.cc:740] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:38.958669 26549 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:38.946537 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 165164us
I20260709 13:11:38.966284 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:38.925861 31925 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:38.965080 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:38.956858 26502 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:38.929373 31798 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:38.978031 26625 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.955760 31764 consensus_queue.cc:1059] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:11:38.942603 31544 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:39.007160 26625 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:38.949395 31916 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:38.937371 31746 consensus_queue.cc:1243] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer ef2886777a8f45e69e213b02a22ecec7 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:39.015771 30654 raft_consensus.cc:2749] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:11:39.016330 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 57770.6us
I20260709 13:11:38.958792 31669 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:38.985342 31924 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:39.001873 31678 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 17 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:39.040875 30719 consensus_queue.cc:260] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:39.054901 31959 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:11:39.062937 31921 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:39.070503 26509 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:39.034865 31847 raft_consensus.cc:2804] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:39.017745 31956 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:39.021582 31813 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:39.098598 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 137067us
I20260709 13:11:39.040122 31669 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.111541 30719 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:39.124853 31949 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.120810 31669 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:39.100660 31969 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:11:39.035298 31911 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:11:39.131989 26474 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:39.149145 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.162793 31965 log.cc:927] Time spent T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:11:39.165618 31966 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.177s	user 0.002s	sys 0.000s
W20260709 13:11:39.177994 31963 log.cc:927] Time spent T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:11:39.185269 31678 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:39.206140 31934 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:11:39.210772 31843 consensus_meta.cc:287] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 13:11:39.127430 31847 raft_consensus.cc:697] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:39.212982 31847 consensus_queue.cc:237] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.237908 26650 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 17.
W20260709 13:11:39.257419 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 125522us
I20260709 13:11:39.258558 26474 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:39.266731 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 250436us
I20260709 13:11:39.269125 26625 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:39.276695 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:39.197002 31936 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 13:11:39.278975 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 107339us
W20260709 13:11:39.318526 26475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.261734 31972 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:39.256738 31893 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:39.278718 31944 consensus_meta.cc:287] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.000s
I20260709 13:11:39.280110 31798 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:39.358140 26509 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:11:39.364398 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 67919.8us
I20260709 13:11:39.386679 31981 consensus_queue.cc:1059] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
W20260709 13:11:39.327672 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 57236.4us
I20260709 13:11:39.391132 31911 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:39.392568 26474 leader_election.cc:400] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14.
I20260709 13:11:39.392951 26474 leader_election.cc:403] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:39.405499 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.442925 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50523.5us
I20260709 13:11:39.444469 26581 raft_consensus.cc:1275] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:39.359256 31843 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.443796 26474 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.204.195:34711 timed out after 1.538s (SENT) [suppressed 13 similar messages]
I20260709 13:11:39.517486 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:39.518651 27277 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:39.393389 31798 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 16 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:39.442689 31924 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.532254 31973 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:39.533891 31991 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:39.448769 31976 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14.
I20260709 13:11:39.551610 31924 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.444078 31932 consensus_queue.cc:1059] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:11:39.506150 31843 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.557983 31843 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:39.355604 31893 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.560477 26504 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:39.505812 31855 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:39.554607 31924 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:39.581446 31798 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.520574 31920 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.589839 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 224648us
W20260709 13:11:39.598053 26473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.603132 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 154157us
I20260709 13:11:39.603920 27277 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:11:39.636732 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:39.596275 31920 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.646670 26580 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:39.638135 31687 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.644320 31850 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:11:39.656589 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 212797us
I20260709 13:11:39.658524 26474 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:39.691752 31792 raft_consensus.cc:3055] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:39.692271 31792 raft_consensus.cc:740] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:39.693713 31920 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:39.647200 31988 consensus_queue.cc:1048] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:11:39.653415 31893 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:39.699047 31911 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:39.700451 26474 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:39.701040 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:39.657127 31936 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:39.703490 31936 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:39.678015 31994 log.cc:927] Time spent T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:11:39.667343 31720 raft_consensus.cc:3055] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:11:39.684353 31669 consensus_meta.cc:287] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.003s
I20260709 13:11:39.725793 31992 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:11:39.719095 31678 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:39.707590 31720 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:39.733220 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:39.723064 31956 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:39.657971 31687 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.693149 31792 consensus_queue.cc:260] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.737424 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:39.720744 31669 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.745260 31720 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.745541 31792 raft_consensus.cc:3060] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:39.759378 31854 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.760571 31854 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:39.746876 32004 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.751127 26508 raft_consensus.cc:2393] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 16: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:39.762305 32004 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.764333 31986 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:39.737783 31678 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 14 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:39.766418 27278 raft_consensus.cc:1240] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:39.743096 31976 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:39.770366 32004 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:39.767474 27273 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:39.770136 31976 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.778483 31678 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.780714 31876 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:39.781162 31876 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:39.780066 31687 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:39.763006 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 147074us
I20260709 13:11:39.782379 31876 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.784127 31599 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.754707 26501 raft_consensus.cc:1240] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:39.787699 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:39.789038 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:39.722018 31993 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:11:39.752409 31970 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.657s	user 0.001s	sys 0.003s
I20260709 13:11:39.749321 31669 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:39.774745 31958 consensus_queue.cc:260] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:39.776736 31964 log.cc:927] Time spent T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.683s	user 0.002s	sys 0.003s
I20260709 13:11:39.790983 31936 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:39.748994 31971 log.cc:927] Time spent T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.745s	user 0.007s	sys 0.000s
I20260709 13:11:39.784786 31599 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.793532 31986 consensus_queue.cc:1059] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:11:39.810683 26654 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:39.811609 31986 raft_consensus.cc:3055] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:39.811987 31986 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:39.793725 31711 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 13:11:39.794023 32007 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:11:39.817271 31679 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:39.817883 31679 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.794667 26658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2303) took 1100 ms. Trace:
I20260709 13:11:39.818634 26658 rpcz_store.cc:276] 0709 13:11:38.694314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.701311 (+  6997us) service_pool.cc:224] Handling call
0709 13:11:38.921827 (+220516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.922654 (+   827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.794418 (+871764us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540039bcd0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c9288ad 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:39.794570 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506292480}
I20260709 13:11:39.820237 26658 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:39.796255 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:39.823382 26502 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:11:39.823765 26502 pending_rounds.cc:85] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 8
I20260709 13:11:39.823971 26502 pending_rounds.cc:107] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:11:39.824267 26502 raft_consensus.cc:2889] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:39.826716 31813 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:39.829864 26510 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:39.832527 31679 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:39.833180 27241 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.834223 26504 raft_consensus.cc:3055] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:39.834594 26504 raft_consensus.cc:740] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:39.835664 26504 consensus_queue.cc:260] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.836736 26504 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:39.836112 26405 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 7 to 8, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 8 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:39.799046 26656 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:39.800469 31958 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:39.801731 26577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 3155) took 1129 ms. Trace:
I20260709 13:11:39.842067 26577 rpcz_store.cc:276] 0709 13:11:38.671881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.679005 (+  7124us) service_pool.cc:224] Handling call
0709 13:11:38.679314 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.679710 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.679735 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.680226 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:11:38.785052 (+104826us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:38.805085 (+ 20033us) log.cc:844] Serialized 14 byte log entry
0709 13:11:38.805296 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.805385 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:39.557329 (+751944us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b18002653c0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:39.751650 (+194321us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:39.801480 (+ 49830us) raft_consensus.cc:1685] finished
0709 13:11:39.801502 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.801665 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22278,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":68,"raft.queue_time_us":2946,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":7223,"spinlock_wait_cycles":34913280,"thread_start_us":104385,"threads_started":1,"wal-append.queue_time_us":300201}
I20260709 13:11:39.804121 26509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:43670
I20260709 13:11:39.845046 26509 raft_consensus.cc:606] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:39.845417 26509 raft_consensus.cc:614] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:39.846256 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:39.806948 26659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2538) took 1137 ms. Trace:
I20260709 13:11:39.847036 26659 rpcz_store.cc:276] 0709 13:11:38.669779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.681709 (+ 11930us) service_pool.cc:224] Handling call
0709 13:11:38.692210 (+ 10501us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:38.725422 (+ 33212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.725459 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:38.726217 (+   758us) log.cc:844] Serialized 52 byte log entry
0709 13:11:38.805928 (+ 79711us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:39.031114 (+225186us) log.cc:844] Serialized 14 byte log entry
0709 13:11:39.360986 (+329872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.361058 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:39.748285 (+387227us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:39.806617 (+ 58332us) raft_consensus.cc:1685] finished
0709 13:11:39.806719 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.806864 (+   145us) inbound_call.cc:177] Queueing success response
0709 13:11:39.811865 (+  5001us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b180042ad80. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
Metrics: {"mutex_wait_us":21433,"prepare.queue_time_us":319758,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":110183,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":46848,"spinlock_wait_cycles":24434176,"thread_start_us":596121,"threads_started":3,"wal-append.queue_time_us":183046}
I20260709 13:11:39.848877 31954 consensus_queue.cc:260] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.850679 31954 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:39.862424 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:39.863201 26581 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:39.863634 26652 raft_consensus.cc:3055] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:39.863986 26652 raft_consensus.cc:740] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:39.864709 26652 consensus_queue.cc:260] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.868610 31993 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:39.809530 31599 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:39.869228 31993 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.794215 27276 raft_consensus.cc:1275] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:39.870081 26659 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:39.871712 31993 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:39.872249 26652 raft_consensus.cc:3060] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:39.865983 27243 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:39.880604 31932 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:39.880942 26656 raft_consensus.cc:1275] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:39.881170 31932 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.881716 31932 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:39.882807 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:39.885079 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:39.885674 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:39.885903 26655 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:39.886376 26656 raft_consensus.cc:2393] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 14: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:39.887058 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:39.887511 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:39.888154 26505 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:39.888585 31856 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.889075 31856 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.891538 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:39.891467 30654 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:39.812827 31986 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:39.797605 26653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2310) took 1101 ms. Trace:
I20260709 13:11:39.897002 26581 raft_consensus.cc:1275] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 13:11:39.898100 26579 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:39.891361 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:39.900439 26578 raft_consensus.cc:1240] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:39.903017 27241 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:39.915762 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:39.795948 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:39.924535 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:39.932022 26578 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:39.927634 26652 raft_consensus.cc:1275] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:39.928383 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:39.936919 30719 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:39.924218 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 46699.3us
I20260709 13:11:39.937407 30719 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:11:39.928769 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.932328 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:39.941041 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:39.944407 26659 raft_consensus.cc:1240] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:39.950083 31629 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.949890 31948 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:39.950448 31999 raft_consensus.cc:993] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: : Instructing follower ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:11:39.950613 31629 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.952598 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:39.953024 31629 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:39.932359 31856 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:39.954814 26509 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:39.955029 31856 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:39.956136 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:39.956949 31856 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:39.959988 26474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.962006 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:39.951001 31999 raft_consensus.cc:1081] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Signalling peer ef2886777a8f45e69e213b02a22ecec7 to start an election
I20260709 13:11:39.957329 31856 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.969733 26581 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:39.974268 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36240
I20260709 13:11:39.978137 26659 raft_consensus.cc:1240] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:39.984360 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:39.910374 26653 rpcz_store.cc:276] 0709 13:11:38.696227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.703420 (+  7193us) service_pool.cc:224] Handling call
0709 13:11:38.703713 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.728246 (+ 24533us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:39.002128 (+273882us) log.cc:844] Serialized 14 byte log entry
0709 13:11:39.136240 (+134112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:39.136303 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:39.136360 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.797233 (+660873us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b5400120f54. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:39.797297 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.797494 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8451,"prepare.queue_time_us":397127,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":10019,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4326,"spinlock_wait_cycles":55883648,"thread_start_us":291609,"threads_started":2,"wal-append.queue_time_us":418841}
I20260709 13:11:39.988030 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:39.992386 26650 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:39.990468 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:39.993548 30719 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:39.967779 26405 catalog_manager.cc:5697] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 6 to 9, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 9 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.789194 31976 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:40.000139 26583 raft_consensus.cc:2393] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 16: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:40.000289 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:39.925258 31991 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:40.012588 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.013087 26622 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:40.015278 26652 raft_consensus.cc:606] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:40.015688 26657 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:11:40.015709 26652 raft_consensus.cc:614] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:40.018345 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:40.020787 30654 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:40.022317 26578 raft_consensus.cc:1240] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:39.966717 31544 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.981950 31942 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:11:39.928350 31746 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:11:40.024089 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:39.998953 31856 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:40.032172 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.033273 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:40.037997 26548 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:40.041960 26580 raft_consensus.cc:2393] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 15: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:39.986649 31644 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:11:40.050767 26549 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:40.034057 31986 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:40.013492 31438 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:11:40.046249 31920 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:40.027184 31629 consensus_queue.cc:1048] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:11:40.032837 31921 consensus_queue.cc:1048] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:11:40.031262 31544 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.065971 31924 consensus_queue.cc:1048] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:11:40.126586 27240 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:40.133602 26504 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:40.104223 31749 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:40.109269 31604 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.073793 31997 consensus_queue.cc:1059] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
I20260709 13:11:40.138598 31989 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:40.107319 31951 consensus_queue.cc:1048] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:11:40.142751 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:40.146634 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 62691.6us
I20260709 13:11:40.149268 27270 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:40.135457 31936 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:40.124017 31949 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:40.154093 26548 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:40.141734 31532 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:11:40.139478 31749 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.189633 31544 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.153750 31989 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.193648 31998 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 13:11:40.195467 31911 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:40.197058 31749 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:40.197429 32011 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:40.147830 31604 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.167974 31976 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.226119 31976 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.230602 31989 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.230685 26625 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:40.231305 31998 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:40.187870 26476 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:40.232201 31629 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:40.232450 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 44665.1us
I20260709 13:11:40.233026 31792 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:40.232785 31629 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.233227 26476 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:40.199044 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45092.3us
I20260709 13:11:40.199398 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.238562 31855 raft_consensus.cc:493] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:40.240007 26476 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:40.246096 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 47937.5us
W20260709 13:11:40.186753 26473 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 731b96cedb5749df893a1de699717183. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.247478 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 104456us
I20260709 13:11:40.258319 26584 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:40.269091 26658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:36240
I20260709 13:11:40.269804 26658 raft_consensus.cc:606] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:40.274226 30654 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:40.274714 30654 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.281385 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.277627 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.165220 31932 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.283877 31438 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:40.187032 31981 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:11:40.244632 31992 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:40.185604 31949 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.246778 31604 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:40.273380 31944 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.239128 31855 raft_consensus.cc:515] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.250646 31955 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:40.272035 31678 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:40.306139 27278 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 14: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:40.306972 26501 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:40.285319 26584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36148
I20260709 13:11:40.309737 26584 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:40.310166 26584 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:40.314466 32006 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:40.314734 31854 consensus_meta.cc:287] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 13:11:40.315521 26503 raft_consensus.cc:2410] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 13:11:40.317267 32016 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:11:40.318553 32012 log.cc:927] Time spent T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:11:40.318981 31599 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.319491 31599 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.322952 31999 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:40.325670 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.326362 26576 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:40.309715 31944 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.330165 31669 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.330638 31669 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.331681 31944 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:40.333847 31936 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:40.339725 31855 leader_election.cc:290] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.309207 31955 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.342859 31955 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:40.346802 26655 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:40.347707 31629 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:40.358366 27243 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:40.357059 26659 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 16.
I20260709 13:11:40.324949 32006 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.362763 27241 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:40.363093 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.365092 26651 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
W20260709 13:11:40.369968 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 95534.6us
I20260709 13:11:40.370321 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.372526 26576 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
W20260709 13:11:40.374111 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.357815 31599 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.329276 31749 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.392789 31949 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:40.388677 31951 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:40.393661 32006 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:40.407886 31951 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.409086 31749 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:40.366704 31982 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:40.409807 31982 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.410205 31982 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:40.410328 31951 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:40.388785 31856 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.412894 26503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59084 (request call id 3076) took 1480 ms. Trace:
I20260709 13:11:40.413255 26503 rpcz_store.cc:276] 0709 13:11:38.932069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.936186 (+  4117us) service_pool.cc:224] Handling call
0709 13:11:40.412669 (+1476483us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54001842d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:40.412812 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3136096128}
I20260709 13:11:40.413733 31856 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.375130 31918 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:40.410499 30654 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:40.418381 31932 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.430096 31876 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:40.430621 26584 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.432605 26584 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:40.479756 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 210289us
I20260709 13:11:40.481630 31893 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:40.482481 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 204574us
I20260709 13:11:40.482282 31893 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.484885 27241 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:40.485404 31893 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.488416 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:40.494544 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.494799 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:40.495303 26655 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:40.498086 31982 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.502346 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.503741 26651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:36240
I20260709 13:11:40.504302 26651 raft_consensus.cc:606] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:40.504637 26651 raft_consensus.cc:614] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:40.505972 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:40.492673 31989 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:40.507494 31989 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:40.511268 26659 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:40.487823 31954 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.520509 31956 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:40.530629 26655 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:40.530889 26654 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15.
I20260709 13:11:40.508785 31989 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.532481 27241 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:40.535501 31932 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:40.536051 31932 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:40.537235 31932 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.542217 26503 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:11:40.542735 26503 pending_rounds.cc:85] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Aborting all ops after (but not including) 10
I20260709 13:11:40.543077 26503 pending_rounds.cc:107] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:11:40.543186 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:40.543396 26503 raft_consensus.cc:2889] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:40.544648 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:40.546926 26506 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:40.548147 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:40.550741 31992 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:40.551347 31992 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.553403 31982 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.519884 31954 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.553612 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:40.554168 26651 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:40.555229 26503 raft_consensus.cc:2393] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 17: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:40.563344 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.564471 26658 raft_consensus.cc:2393] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 13: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:40.541010 31678 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:40.558404 31992 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:40.578342 26651 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:11:40.579464 32037 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.580171 32037 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.580289 31678 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.581862 27241 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:40.582481 31678 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:40.582950 31933 raft_consensus.cc:2804] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:40.583513 31933 raft_consensus.cc:697] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:40.557073 32041 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:40.586881 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:40.587430 26507 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:40.584395 31933 consensus_queue.cc:237] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.587450 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:40.589516 31954 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.606158 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:40.582567 32037 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:40.616532 26507 raft_consensus.cc:2468] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:40.618347 26548 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:40.601706 26505 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 17.
I20260709 13:11:40.621151 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:40.631942 31998 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:40.646972 31998 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.632304 31920 raft_consensus.cc:2804] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:40.647468 31998 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:40.647702 31920 raft_consensus.cc:697] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:40.648792 31920 consensus_queue.cc:237] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.601471 31930 raft_consensus.cc:3055] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:40.652292 31930 raft_consensus.cc:740] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:40.657099 31930 consensus_queue.cc:260] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.658697 31930 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:40.683207 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.701021 27243 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:40.703428 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.696202 26405 catalog_manager.cc:5697] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 6 to 7, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 7 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.697751 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:40.707335 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.707767 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.708997 31919 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:40.713454 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.709445 31919 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.714802 31919 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:40.715992 26576 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:40.706944 31749 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.722033 31749 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.724642 31749 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.727550 31930 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.728181 31930 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.699771 31850 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:40.730576 31930 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.730381 31850 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:40.734025 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:40.755245 26476 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:40.763199 26576 raft_consensus.cc:1240] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:40.777066 31976 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:40.784144 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.785113 26577 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:40.787441 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.760267 31992 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:40.797785 26659 raft_consensus.cc:2393] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 15: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:40.795101 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.798352 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:40.801719 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7b25ba8d2644ceb86280e40ef3c8dc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.801864 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.802587 26659 raft_consensus.cc:2393] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:40.803215 26576 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 14: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:40.802951 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:40.805809 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:40.806943 26659 raft_consensus.cc:2393] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 14: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:40.807715 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:40.805785 26653 raft_consensus.cc:3055] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:40.809096 26653 raft_consensus.cc:740] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:40.810961 26659 raft_consensus.cc:1275] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:40.813594 26583 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:40.814814 26577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:40.815404 26577 raft_consensus.cc:3060] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:40.817037 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.817939 26656 raft_consensus.cc:2393] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 10: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:40.821622 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.822542 26651 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:40.826192 26651 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:40.828923 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:40.836351 31850 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:40.810176 26653 consensus_queue.cc:260] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.840517 26653 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:40.830173 26576 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 9.
I20260709 13:11:40.797622 31973 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:40.842155 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:40.843809 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.844348 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:40.848342 26651 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 10.
I20260709 13:11:40.848439 26505 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
W20260709 13:11:40.855659 27240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.858186 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:40.860121 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:40.858404 27243 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:40.863207 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:40.863857 27273 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:40.869180 26549 leader_election.cc:304] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:40.871155 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:40.883306 31992 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:40.884588 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:40.877235 26577 raft_consensus.cc:2468] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:11:40.888861 27240 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:40.891014 31813 raft_consensus.cc:2749] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:40.912410 32052 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:11:40.873440 31982 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:40.914966 27270 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:40.855015 31973 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.850023 31998 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:40.916918 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:40.920652 27273 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:40.921761 26549 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:40.925781 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.941421 26582 raft_consensus.cc:2368] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 17. Current term is 18.
I20260709 13:11:40.943801 27276 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:40.918721 31982 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.923700 31649 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:40.969305 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:40.972087 32056 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.277s	user 0.002s	sys 0.000s
I20260709 13:11:40.972733 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:40.983534 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:40.944672 31920 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:40.906188 31992 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:40.953281 31982 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:40.928926 31749 consensus_queue.cc:1048] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:11:40.964293 31649 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.997131 31792 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:11:41.006112 31649 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:41.009543 32055 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.190s	user 0.002s	sys 0.000s
I20260709 13:11:41.010320 31669 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.010694 31919 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.013015 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:41.003505 26473 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:40.994963 31920 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.036792 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:41.038561 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:41.039258 26581 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:41.042520 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:41.014451 31687 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.043298 32006 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:41.050325 32006 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.050797 32006 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:41.052882 26622 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.005s
W20260709 13:11:41.053334 26622 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.012s	sys 0.005s
I20260709 13:11:41.055982 26577 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:11:41.062294 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 571543us
I20260709 13:11:41.047602 26548 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:41.068217 27271 raft_consensus.cc:1240] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:41.070251 26548 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:41.026095 32036 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:41.042577 31920 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:41.079231 26622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.078933 26548 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:41.081738 26581 raft_consensus.cc:2468] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 16.
I20260709 13:11:41.041492 31919 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:41.075353 31749 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:41.103477 31458 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:41.086421 32029 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:11:41.105247 32058 log.cc:927] Time spent T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 13:11:41.109261 26653 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:41.091370 31986 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.071849 31687 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:41.104256 31458 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:41.135404 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:41.140313 27243 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:41.141553 31919 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:11:41.164482 31930 raft_consensus.cc:2804] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:41.166862 31458 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:41.122175 32065 log.cc:927] Time spent T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:11:41.132994 32054 log.cc:927] Time spent T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.442s	user 0.000s	sys 0.003s
I20260709 13:11:41.149593 31998 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 18 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:41.188503 32069 ts_tablet_manager.cc:933] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:41.117391 31649 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.173156 31930 raft_consensus.cc:697] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:11:41.199764 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.178982 31973 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.143139 31986 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.222047 27270 raft_consensus.cc:1240] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:41.220837 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 130988us
I20260709 13:11:41.184299 32006 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.182442 31982 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.229441 31956 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:11:41.232455 31687 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:41.241122 31649 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:41.251611 32075 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:41.223795 31992 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.252606 31930 consensus_queue.cc:237] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.253732 31720 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:41.254827 31986 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.256265 32075 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:11:41.261122 32006 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:41.250506 32062 log.cc:927] Time spent T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
W20260709 13:11:41.249122 32057 log.cc:927] Time spent T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.398s	user 0.003s	sys 0.000s
W20260709 13:11:41.263271 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 220860us
W20260709 13:11:41.264166 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 202138us
I20260709 13:11:41.267966 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:41.268734 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:41.270476 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:41.271948 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:41.272818 26501 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 10.
I20260709 13:11:41.277374 26580 raft_consensus.cc:2368] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14.
I20260709 13:11:41.280102 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:41.280918 27271 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:41.287024 26476 leader_election.cc:400] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14.
I20260709 13:11:41.287407 26476 leader_election.cc:403] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:41.284077 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:41.274046 31644 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:41.291095 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 212255us
I20260709 13:11:41.299752 26548 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:41.293272 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:41.302620 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:41.245609 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 80789.4us
I20260709 13:11:41.309458 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:41.310248 27271 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.297528 26510 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:41.309480 32006 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:41.323930 32006 raft_consensus.cc:493] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:41.324821 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 93270.7us
I20260709 13:11:41.305954 31792 raft_consensus.cc:3060] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.339267 26625 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:41.324355 32006 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:41.344249 27271 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:41.350137 26625 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:41.346843 26548 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:41.355314 31458 raft_consensus.cc:2804] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:41.366290 31982 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:41.376608 31999 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:41.361784 32074 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:41.379392 26625 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:41.450338 27243 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.462471 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 83192.7us
W20260709 13:11:41.473682 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 129208us
I20260709 13:11:41.354370 32069 tablet_copy_client.cc:323] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:11:41.448096 31986 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:41.470127 32073 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:41.480396 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:41.466904 31458 raft_consensus.cc:697] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:41.500865 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:41.501639 26510 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:41.501451 31458 consensus_queue.cc:237] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.506278 26501 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:41.492010 27275 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:41.477674 31920 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:41.517776 26654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54892 (request call id 2333) took 1640 ms (client timeout 1837 ms). Trace:
W20260709 13:11:41.524997 26654 rpcz_store.cc:269] 0709 13:11:39.876958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.891062 (+ 14104us) service_pool.cc:224] Handling call
0709 13:11:41.517533 (+1626471us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54001031d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:41.517689 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424537344}
I20260709 13:11:41.531297 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:41.534941 26548 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:41.535475 26510 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 18.
I20260709 13:11:41.521962 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:41.537014 26501 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:41.539296 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:41.540637 32006 raft_consensus.cc:515] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.542232 26585 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:41.546192 26580 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:41.485761 32073 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:41.550951 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 81467.1us
W20260709 13:11:41.520350 32045 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.825s	user 0.004s	sys 0.000s
I20260709 13:11:41.554715 26474 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
W20260709 13:11:41.555356 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 62174.3us
I20260709 13:11:41.557754 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:41.517498 31792 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 13. Current term is 14.
I20260709 13:11:41.559120 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:41.532668 31711 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:41.523442 31920 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:41.520534 31813 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:41.485944 31986 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.551843 32073 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:41.552574 31893 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:41.597863 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:41.560999 31854 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:41.590101 26548 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:41.555850 31687 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:41.614076 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:41.619395 26503 raft_consensus.cc:2468] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:41.625910 26548 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:41.560698 32070 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:11:41.600287 31792 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:11:41.630300 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 72678.2us
W20260709 13:11:41.634426 32045 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:11:41.598865 31720 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:11:41.618911 31687 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:41.595639 31813 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:41.638458 31998 raft_consensus.cc:2804] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:41.633778 31792 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:41.638777 31438 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:41.605249 31893 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.631654 32088 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:41.627022 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet 731b96cedb5749df893a1de699717183 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:11:41.649576 31687 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:41.666169 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:41.663995 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 104915us
I20260709 13:11:41.669057 27277 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:41.671800 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:41.661973 31438 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.673137 31993 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:41.681269 32082 log.cc:927] Time spent T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:11:41.662308 31792 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:41.667240 31644 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:41.672932 32088 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.695745 26507 raft_consensus.cc:1240] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:11:41.699788 26504 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:41.683945 31438 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:41.684087 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet 731b96cedb5749df893a1de699717183 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-731b96cedb5749df893a1de699717183
I20260709 13:11:41.690820 31854 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:41.713235 26580 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
W20260709 13:11:41.727054 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 101271us
I20260709 13:11:41.687611 31993 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.706108 32090 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:41.729126 32089 consensus_queue.cc:1059] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:11:41.753153 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:41.743646 32090 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.755995 31893 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.756397 32090 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.743559 31986 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.757020 31813 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:41.753202 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:41.739323 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:41.764815 27271 raft_consensus.cc:2368] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11.
I20260709 13:11:41.767467 26652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54892 (request call id 2336) took 1273 ms. Trace:
I20260709 13:11:41.746942 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:41.774547 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:41.775332 26576 raft_consensus.cc:2368] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 15. Current term is 16.
I20260709 13:11:41.775187 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:41.776728 26548 leader_election.cc:400] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11.
I20260709 13:11:41.777179 26548 leader_election.cc:403] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:11:41.777906 26476 leader_election.cc:400] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 15. Current term is 16.
I20260709 13:11:41.778862 26476 leader_election.cc:403] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:41.767976 26652 rpcz_store.cc:276] 0709 13:11:40.493785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.494266 (+   481us) service_pool.cc:224] Handling call
0709 13:11:40.494855 (+   589us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:40.500986 (+  6131us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:40.523516 (+ 22530us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.666764 (+143248us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:40.670573 (+  3809us) log.cc:844] Serialized 539 byte log entry
0709 13:11:40.671601 (+  1028us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:40.672366 (+   765us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.672678 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.672795 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.234042 (+561247us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18003afa80. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:41.519637 (+285595us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:41.767183 (+247546us) raft_consensus.cc:1685] finished
0709 13:11:41.767213 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.767378 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5589,"prepare.queue_time_us":25639,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":8690,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":5535,"spinlock_wait_cycles":54440448,"thread_start_us":110560,"threads_started":1,"wal-append.queue_time_us":162428}
I20260709 13:11:41.738970 31998 raft_consensus.cc:697] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 18 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:41.790889 31998 consensus_queue.cc:237] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:41.799755 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:41.802997 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:41.792109 26520 tablet_copy_source_session.cc:215] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:41.745260 31993 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.784230 31678 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:41.792981 31893 raft_consensus.cc:3060] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:11:41.816987 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 141297us
I20260709 13:11:41.820942 26474 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:41.818691 32089 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:41.815620 32100 raft_consensus.cc:2749] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899) with higher term. Message: Invalid argument: T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11.
I20260709 13:11:41.822240 31993 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:41.815197 31792 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:41.850971 32088 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.840101 32089 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.860514 26582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36148 (request call id 3187) took 1147 ms. Trace:
I20260709 13:11:41.861006 26582 rpcz_store.cc:276] 0709 13:11:40.712852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.713014 (+   162us) service_pool.cc:224] Handling call
0709 13:11:41.860261 (+1147247us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540032f0d4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92d2fa 00007f88318eeb17 00007f882ae696d4 00007f882ae69662 00007f882ae69591 00007f882ae6950c 00007f882ae687c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:41.860419 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521934592}
I20260709 13:11:41.861173 32073 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:41.833521 32070 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:41.873867 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:41.821058 31678 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.875711 26654 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:41.876794 31678 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.878350 31919 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:41.878952 31919 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.879259 31438 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:41.881850 31919 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:41.883236 31438 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:41.884800 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:41.888374 32070 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:41.888973 32053 log.cc:927] Time spent T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 1.060s	user 0.000s	sys 0.003s
I20260709 13:11:41.891119 32070 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:41.892987 31792 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:41.893508 32084 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.894093 32084 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:41.895129 32076 log.cc:927] Time spent T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.403s	user 0.002s	sys 0.000s
I20260709 13:11:41.898687 31687 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:41.845763 31976 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:41.902423 26658 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:41.903957 26583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36148 (request call id 3191) took 1144 ms. Trace:
I20260709 13:11:41.904340 26583 rpcz_store.cc:276] 0709 13:11:40.760107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.760605 (+   498us) service_pool.cc:224] Handling call
0709 13:11:40.761028 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.814467 (+ 53439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.903743 (+1089276us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b5400100254. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:41.903898 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119857408}
I20260709 13:11:41.905596 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:41.907892 31711 raft_consensus.cc:3055] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:41.908516 31711 raft_consensus.cc:740] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:41.913750 31893 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 15. Current term is 16.
I20260709 13:11:41.914403 26657 raft_consensus.cc:1275] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:41.915431 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:41.915697 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:41.918784 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:41.918958 32069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731b96cedb5749df893a1de699717183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.919468 26657 raft_consensus.cc:3060] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:41.921124 32101 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:11:41.924139 26652 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:41.928215 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:41.929472 26655 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15.
I20260709 13:11:41.899696 31955 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.935313 26549 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:41.942567 26510 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:41.944202 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:41.944926 26502 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:41.945922 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:41.946683 27271 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:41.946780 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:41.949322 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:41.968160 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:41.968165 26657 raft_consensus.cc:2468] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 11.
I20260709 13:11:41.973307 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:41.977051 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:41.977882 26658 raft_consensus.cc:3060] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:41.978482 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:41.980412 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:41.990962 26582 raft_consensus.cc:2368] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 15. Current term is 16.
I20260709 13:11:41.978003 26657 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:41.958575 31919 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:41.958451 32041 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:41.996345 26476 leader_election.cc:400] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 15. Current term is 16.
I20260709 13:11:42.000531 26476 leader_election.cc:403] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:11:41.962709 31813 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:41.948674 31991 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:11:41.971947 32091 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:42.003363 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 76181.8us
I20260709 13:11:41.948916 31955 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:41.988466 31687 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:42.008358 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:42.008978 26510 raft_consensus.cc:3060] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:11:42.010962 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:42.012005 26657 raft_consensus.cc:2393] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:42.012476 26625 leader_election.cc:400] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 17. Current term is 18.
I20260709 13:11:42.012820 26625 leader_election.cc:403] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:42.015578 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81721f0402d24cbfb7f52e0ba164247b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:42.017168 26657 raft_consensus.cc:2368] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11.
I20260709 13:11:42.019170 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:42.003511 32073 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:42.021286 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:42.024540 26585 raft_consensus.cc:2393] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 in current term 12: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:42.030405 26510 raft_consensus.cc:2468] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:42.032963 26657 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:41.949350 31711 consensus_queue.cc:260] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:42.037107 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:42.037690 26657 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:42.001786 31919 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.050333 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:42.051177 26654 raft_consensus.cc:2393] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 15: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:42.057915 27241 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:42.058791 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:42.059631 26656 raft_consensus.cc:2393] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 11: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:42.060273 31954 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:42.061329 31936 consensus_queue.cc:1048] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:42.061764 31954 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:42.065122 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:42.068212 31637 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:42.069108 31955 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:42.071285 32089 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:42.071703 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:42.072526 32084 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:42.073141 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:42.076602 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.078589 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:42.080386 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:42.080626 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:42.081216 27273 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 11.
I20260709 13:11:42.086253 31711 raft_consensus.cc:3060] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:42.081218 26505 raft_consensus.cc:2393] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 12: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:42.094367 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:42.099556 27270 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:42.108788 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:42.109266 26549 leader_election.cc:400] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 10. Current term is 11.
I20260709 13:11:42.110018 26549 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:42.111931 31920 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:42.112703 31920 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:42.113127 31920 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:42.117264 31936 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:42.113529 31920 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:42.113973 26548 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:42.115336 26584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36136 (request call id 2363) took 1438 ms. Trace:
I20260709 13:11:42.122658 26584 rpcz_store.cc:276] 0709 13:11:40.677221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.677412 (+   191us) service_pool.cc:224] Handling call
0709 13:11:40.678107 (+   695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:40.678513 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.678550 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.680042 (+  1492us) log.cc:844] Serialized 513 byte log entry
0709 13:11:40.698597 (+ 18555us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:40.698677 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.698787 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.971243 (+272456us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:42.110382 (+1139139us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b24002b9928. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f88296c29c4 00007f88296c0acb 00007f882987bdc9 00007f882987ba55 00007f882987afb0 00007f882c4f1488 00007f882c4f1be8 00007f882c4c9398 00007f882c4c476a 00007f882c4c3bb6
0709 13:11:42.114906 (+  4524us) raft_consensus.cc:1685] finished
0709 13:11:42.115104 (+   198us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.115265 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40640256,"thread_start_us":18110,"threads_started":1,"wal-append.queue_time_us":14060}
I20260709 13:11:42.116493 27241 leader_election.cc:304] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:42.111588 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:11:42.150524 26624 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.145481 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 121061us
I20260709 13:11:42.161053 26658 raft_consensus.cc:2468] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 18.
I20260709 13:11:42.059646 31919 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:42.096800 32036 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:42.165494 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 51606.6us
I20260709 13:11:42.195091 26657 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 16.
I20260709 13:11:42.197928 26549 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:42.166632 32010 raft_consensus.cc:2804] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:42.165752 31764 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 17. Current term is 18.
I20260709 13:11:42.206045 31976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46306 (request call id 7) took 3583 ms. Trace:
I20260709 13:11:42.206904 32023 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:42.209071 32083 log.cc:927] Time spent T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.708s	user 0.000s	sys 0.002s
I20260709 13:11:42.214136 26502 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 16.
I20260709 13:11:42.161073 31850 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:11:42.185408 32036 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:42.199299 31749 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:42.167560 31847 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:11:42.248072 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 233726us
I20260709 13:11:42.256199 27273 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:11:42.249856 32029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.010s	sys 0.044s
W20260709 13:11:42.258208 32029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.012s	sys 0.044s
I20260709 13:11:42.252482 31998 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:11:42.249269 31992 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025) with higher term. Message: Invalid argument: T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef for earlier term 15. Current term is 16.
I20260709 13:11:42.248430 32010 raft_consensus.cc:697] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:42.271584 27275 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
I20260709 13:11:42.278383 32010 consensus_queue.cc:237] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.281801 32105 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:42.282467 32105 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.283004 27276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46406 (request call id 1164) took 1016 ms. Trace:
I20260709 13:11:42.284834 32105 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:42.283515 27276 rpcz_store.cc:276] 0709 13:11:41.266689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.271975 (+  5286us) service_pool.cc:224] Handling call
0709 13:11:41.272365 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.272819 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.272860 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.278708 (+  5848us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.380096 (+101388us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:41.380142 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.380207 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.208283 (+828076us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:42.282641 (+ 74358us) raft_consensus.cc:1685] finished
0709 13:11:42.282671 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.282931 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":569,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":5076,"spinlock_wait_cycles":53786368,"thread_start_us":70320,"threads_started":1,"wal-append.queue_time_us":195910}
I20260709 13:11:42.289520 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:42.260798 31749 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:42.312738 26622 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:42.249040 32023 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.325356 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:42.238943 31976 rpcz_store.cc:276] 0709 13:11:38.622939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.626291 (+  3352us) service_pool.cc:224] Handling call
0709 13:11:39.101422 (+475131us) log.cc:844] Serialized 513 byte log entry
0709 13:11:39.814314 (+712892us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400353ed4. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c92f735 00007f88318efd29 00007f882ae6e1d4 00007f882ae6e162 00007f882ae6e091 00007f882ae6e00c 00007f882ae6d2c2 00007f882ac6448c 00007f882ac638c6 00007f882ac6326f
0709 13:11:42.205933 (+2391619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727374208}
W20260709 13:11:42.406785 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 81459.8us
I20260709 13:11:42.407820 26622 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:42.345225 32112 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:42.397910 32073 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:42.453439 26622 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:42.409873 31920 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.455367 32112 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.465066 32112 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:42.466102 31920 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:42.483342 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:42.491422 31932 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:11:42.492604 32120 log.cc:927] Time spent T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:11:42.492290 31932 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.496737 31932 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:42.496942 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:42.502637 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:42.503486 26582 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
W20260709 13:11:42.504514 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 51175.5us
I20260709 13:11:42.340171 32071 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 13:11:42.506016 26622 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:42.453651 32089 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:42.506590 32115 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:42.509264 32115 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:42.398819 32084 consensus_queue.cc:1059] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:11:42.511540 32084 raft_consensus.cc:3055] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:42.511950 32084 raft_consensus.cc:740] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:42.512842 32084 consensus_queue.cc:260] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:42.514051 32119 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 13:11:42.515668 32102 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:11:42.523624 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:42.509258 26622 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:42.524235 26584 raft_consensus.cc:1275] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:11:42.520334 32083 log.cc:927] Time spent T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:11:42.529822 26622 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:42.529608 32074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.034s	sys 0.073s
I20260709 13:11:42.641821 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:42.585760 32074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.035s	sys 0.073s
I20260709 13:11:42.531332 31986 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:42.545756 32084 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:42.655961 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:42.656852 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:42.584347 32073 raft_consensus.cc:2804] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:42.707192 32073 raft_consensus.cc:697] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:42.708034 32073 consensus_queue.cc:237] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:42.683506 32076 log.cc:927] Time spent T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:11:42.655900 31986 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.710271 26650 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:42.710577 31986 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:42.714263 32132 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:42.714812 32132 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:42.643275 31749 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:42.590003 31954 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:42.719801 31954 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.721850 31954 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:42.726859 26505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:42.727509 26505 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:42.729700 32132 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:42.701465 31711 consensus_meta.cc:287] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Time spent flushing consensus metadata: real 0.615s	user 0.018s	sys 0.002s
W20260709 13:11:42.704182 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 45506.9us
I20260709 13:11:42.705627 31678 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:42.729931 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:42.700987 32023 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:42.744928 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 472943us
I20260709 13:11:42.746999 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:42.760536 26655 raft_consensus.cc:1275] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:11:42.762254 26655 pending_rounds.cc:85] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Aborting all ops after (but not including) 9
I20260709 13:11:42.762547 26655 pending_rounds.cc:107] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:11:42.763213 26655 raft_consensus.cc:2889] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:42.766336 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:42.771246 26503 raft_consensus.cc:1275] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:42.780195 26503 raft_consensus.cc:1275] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:42.780385 26656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:42.697397 32006 leader_election.cc:290] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 10 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:42.783537 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:42.785871 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:42.786649 27276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edde491935742d4b076995932d10cc9" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:42.762501 31936 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:42.805936 31936 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:42.806357 31936 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:42.806135 31980 consensus_queue.cc:1048] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:42.762632 31678 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.783228 31932 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:42.729408 32112 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.783665 32023 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:11:42.833017 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 57787.7us
I20260709 13:11:42.844229 26548 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:42.848109 27243 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:42.851258 26654 raft_consensus.cc:2368] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 15. Current term is 16.
I20260709 13:11:42.854559 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:42.864732 27273 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:42.871542 26548 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:42.842270 31932 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:42.874771 31813 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:42.874905 31932 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:42.871162 31919 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:42.882262 32112 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:42.881834 31936 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.884585 31936 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:42.886752 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:42.887444 26579 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:42.890740 26548 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:42.898412 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:42.899210 26503 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:42.892367 31932 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:42.906255 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:42.853864 31986 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:42.911470 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 63598.2us
I20260709 13:11:42.909432 31932 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:42.896561 31813 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:42.906692 26584 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:42.913661 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:42.901033 31998 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:42.904367 31687 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:42.924355 27243 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:42.932363 31813 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:42.934396 32125 log.cc:927] Time spent T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:11:42.938587 31932 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:42.942813 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:42.949307 26503 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:42.959604 26548 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:42.971776 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 59519.3us
I20260709 13:11:42.972954 32006 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:42.957016 32105 consensus_queue.cc:1048] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:11:42.982431 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 59834.4us
I20260709 13:11:43.046308 31678 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:43.050585 32106 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.037s	user 0.000s	sys 0.006s
I20260709 13:11:43.063046 31986 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:43.049290 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2584) took 1050 ms. Trace:
W20260709 13:11:43.057392 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet e29f1967e75645cbb7842e14e0404518: Illegal state: Replica ef2886777a8f45e69e213b02a22ecec7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:43.079514 26549 leader_election.cc:400] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 15. Current term is 16.
I20260709 13:11:42.967361 31951 consensus_queue.cc:1048] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:11:43.101037 26655 rpcz_store.cc:276] 0709 13:11:41.999371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.999497 (+   126us) service_pool.cc:224] Handling call
0709 13:11:41.999799 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.763654 (+763855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.048965 (+285311us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b5400108954. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c929e01 00007f882c92883e 00007f88318ed419 00007f882ae64bd4 00007f882ae64b62 00007f882ae64a91 00007f882ae64a0c 00007f882ae63cc2 00007f882ac6448c 00007f882ac638c6
0709 13:11:43.049212 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748700544}
I20260709 13:11:43.104351 31951 consensus_queue.cc:1048] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:43.111922 26579 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 16.
I20260709 13:11:43.112677 31998 raft_consensus.cc:2764] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:11:43.138893 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:43.140969 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:43.142700 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:41.730496 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:43.132158 32069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46406 (request call id 1158) took 2192 ms. Trace:
I20260709 13:11:43.153787 26405 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 6 to 8, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 8 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:43.155162 32069 rpcz_store.cc:276] 0709 13:11:40.951360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.951552 (+   192us) service_pool.cc:224] Handling call
0709 13:11:41.189070 (+237518us) ts_tablet_manager.cc:934] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
0709 13:11:41.916966 (+727896us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:42.746601 (+829635us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:42.763652 (+ 17051us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:43.130793 (+367141us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:43.131355 (+   562us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:43.131949 (+   594us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:43.132034 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":11598,"tablet-copy.queue_time_us":190286,"thread_start_us":251113,"threads_started":2}
I20260709 13:11:43.156664 32069 tablet_copy_client.cc:806] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:43.157315 32069 tablet_copy_client.cc:670] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:43.159135 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:43.156543 26405 catalog_manager.cc:5697] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.161824 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:43.174014 26622 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:43.182271 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a3c5a4dbcb4d7f8b2517b3d86bcb00" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:43.182495 26474 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:43.187939 26650 raft_consensus.cc:1275] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:43.141301 32036 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:43.173731 31932 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:43.197490 26474 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:43.192431 31711 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:43.195740 31980 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.205221 31932 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:43.229507 31678 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:43.218920 31980 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:43.230839 31720 consensus_queue.cc:1048] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:11:43.299507 26625 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:43.304116 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 119358us
W20260709 13:11:43.363349 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 40a3c5a4dbcb4d7f8b2517b3d86bcb00: Illegal state: Replica b9c3761688a64982ae1c4aeb758e09ef is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:43.375064 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 177648us
W20260709 13:11:43.334728 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 143566us
I20260709 13:11:43.408480 26576 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:43.422897 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:43.378805 32111 raft_consensus.cc:2804] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:43.418111 32145 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:43.457532 26650 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:43.425354 32116 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:43.469132 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:43.491660 26502 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:43.446436 32124 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:11:43.471395 32091 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:43.466279 31920 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:11:43.520792 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 51742.6us
I20260709 13:11:43.527441 32112 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:43.528600 32112 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:43.528949 32112 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:11:43.532354 32151 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:11:43.516778 31980 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:43.540771 32171 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:43.465659 32145 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:43.512132 31932 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:43.468950 32116 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:43.559685 32111 raft_consensus.cc:697] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 16 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:43.611083 32111 consensus_queue.cc:237] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:43.613875 32162 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:43.614552 32162 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:43.616993 32162 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:43.541531 32171 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:43.619647 32171 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:43.626416 27273 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:43.627750 32145 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:43.628772 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:43.629931 32116 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:43.633525 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 66278.3us
I20260709 13:11:43.657246 26504 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:43.660153 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:43.663148 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:43.632967 32159 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:43.671106 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:43.650920 31920 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:43.692808 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:43.662163 31854 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:43.603101 32112 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:43.711879 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:43.656456 31850 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:11:43.732054 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 45117.7us
I20260709 13:11:43.733390 27269 raft_consensus.cc:1240] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:43.682284 32159 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:43.732345 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:43.735657 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:43.737818 27273 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:43.737927 27271 raft_consensus.cc:3060] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:43.739126 27243 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:43.701366 31920 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:43.720667 32173 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:43.787385 27273 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:43.799993 32170 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:43.800613 32170 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:43.802893 32170 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:43.804057 32173 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:43.806381 32173 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:43.808650 31687 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:43.814183 32069 tablet_copy_client.cc:538] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:43.818367 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:43.819340 31920 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:43.819656 32159 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:43.706750 31854 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:43.743562 31954 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:43.742347 31893 raft_consensus.cc:493] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:43.862449 31993 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:43.751493 27271 raft_consensus.cc:2468] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 16.
I20260709 13:11:43.904500 31854 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:43.875511 32177 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:43.926074 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:43.926631 27273 raft_consensus.cc:2393] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
W20260709 13:11:43.931262 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 188915us
I20260709 13:11:43.925122 31854 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.891265 31893 raft_consensus.cc:515] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:43.958433 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 224727us
I20260709 13:11:43.923568 31993 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:43.964294 27270 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:11:43.965443 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:43.932001 32177 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:43.957696 31854 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:43.973098 32136 log.cc:927] Time spent T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 1.107s	user 0.009s	sys 0.019s
I20260709 13:11:43.974597 26580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39940 (request call id 1080) took 1486 ms. Trace:
I20260709 13:11:43.975090 26580 rpcz_store.cc:276] 0709 13:11:42.487740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.487898 (+   158us) service_pool.cc:224] Handling call
0709 13:11:42.488263 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:42.488680 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.488733 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:42.489292 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.764915 (+275623us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:42.764984 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.765096 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.972501 (+1207405us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:43.974280 (+  1779us) raft_consensus.cc:1685] finished
0709 13:11:43.974309 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.974527 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1224,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":31716096,"thread_start_us":274856,"threads_started":1,"wal-append.queue_time_us":294118}
I20260709 13:11:43.978454 31993 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:43.981871 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:43.982597 26581 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:43.984154 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:43.989696 27270 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:43.995240 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:43.991078 32114 raft_consensus.cc:493] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:43.998149 32114 raft_consensus.cc:515] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.002453 27243 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:43.991895 26625 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:44.007694 26622 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.017339 32197 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:44.018118 32197 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.007124 32190 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.025367 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.013247 32148 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:44.039949 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 48191.5us
I20260709 13:11:44.009490 32168 consensus_queue.cc:1059] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:11:44.028167 32197 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.050004 31893 leader_election.cc:290] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.052213 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.053545 32200 raft_consensus.cc:493] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:44.054141 32200 raft_consensus.cc:515] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:44.061107 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 43486us
I20260709 13:11:44.038514 32115 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:44.111773 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.112112 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.040257 32199 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:44.047899 32090 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:44.112895 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.111843 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:44.050030 32189 log.cc:927] Time spent T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:11:44.115690 26659 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:44.115415 32115 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:44.129144 32115 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.030821 32190 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.135105 32190 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:44.139282 31854 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:44.142114 32114 leader_election.cc:290] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.145236 32069 tablet_bootstrap.cc:492] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
W20260709 13:11:44.151209 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 143592us
I20260709 13:11:44.137495 32090 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:44.123827 32168 raft_consensus.cc:3055] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:44.153475 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcf073468e44507a058097dedeaa5df" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.154742 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8792823e44557bace909d8b20d9eb" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.162286 32090 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.139277 32200 leader_election.cc:290] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.155200 32168 raft_consensus.cc:740] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:11:44.188441 32099 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.249s	user 0.009s	sys 0.005s
I20260709 13:11:44.197887 26625 leader_election.cc:304] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.191080 32177 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:44.195431 32099 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.255s	user 0.010s	sys 0.005s
I20260709 13:11:44.201418 32168 consensus_queue.cc:260] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.197369 31998 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:44.204093 31998 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.153294 32199 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.206357 31998 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.216025 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.200685 32084 raft_consensus.cc:2749] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:44.218699 26405 catalog_manager.cc:5697] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 8 to 10, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 10 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.208439 32199 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.220887 26405 catalog_manager.cc:5697] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 6 to 8, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 8 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.260490 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.257768 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.269021 26581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.270011 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.270207 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.270664 26583 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:44.271255 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a535a53cf0452f96a49f9aa849777a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.252027 31854 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:44.272171 31854 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.257388 32204 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:44.274144 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.274813 32204 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.275699 32091 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:44.276193 32091 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.269659 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.279407 26584 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 15.
I20260709 13:11:44.278235 32091 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:44.286314 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.286947 27270 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:44.292308 26474 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:44.294301 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.298404 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.300597 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.293905 32030 raft_consensus.cc:493] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:44.302486 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.302806 26650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.308768 32206 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:44.309357 32206 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.307324 32030 raft_consensus.cc:515] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.295980 32177 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:44.313990 32177 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:44.314464 32177 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:44.314548 32206 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:44.315156 32206 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:44.315685 32206 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.320115 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.323058 26405 catalog_manager.cc:5697] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 12, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 12 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.327497 32206 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:44.325464 26405 catalog_manager.cc:5697] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 5 to 6, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 6 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.277235 32204 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.295112 32115 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.338526 32115 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:44.339411 26654 raft_consensus.cc:1240] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting Update request from peer b9c3761688a64982ae1c4aeb758e09ef for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:44.340457 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.345602 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.346071 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
W20260709 13:11:44.327616 32155 log.cc:927] Time spent T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.811s	user 0.007s	sys 0.006s
I20260709 13:11:44.364689 31792 consensus_queue.cc:1059] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:44.315231 31854 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:44.365893 26655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2619) took 1256 ms. Trace:
I20260709 13:11:44.366277 31919 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:44.366868 31919 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.369125 31919 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:44.366317 26655 rpcz_store.cc:276] 0709 13:11:43.109294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.114752 (+  5458us) service_pool.cc:224] Handling call
0709 13:11:43.115118 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.116854 (+  1736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:43.116888 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:43.117334 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:11:43.298123 (+180789us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:43.378512 (+ 80389us) log.cc:844] Serialized 14 byte log entry
0709 13:11:43.419007 (+ 40495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.419087 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:44.192163 (+773076us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b18003a3a80. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c522 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:44.316499 (+124336us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b18003a3a80. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f88297b6c0a 00007f8832ef6219 00007f88307fd58f 00007f882983c571 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd
0709 13:11:44.327035 (+ 10536us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b4400022b4c. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f88296c4db1 00007f8829762c85 00007f88297636a2 00007f882c4d51db 00007f882c4d0aaf 00007f882c4c486e 00007f882c4c3bb6 00007f882c4c37d8 00007f882c4cd221 00007f882c4cd1d9 00007f882c4cd169
0709 13:11:44.365679 (+ 38644us) raft_consensus.cc:1685] finished
0709 13:11:44.365701 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:44.365827 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58573,"prepare.queue_time_us":80154,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":41867,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":7731,"spinlock_wait_cycles":23481216,"thread_start_us":180474,"threads_started":1,"wal-append.queue_time_us":347202}
I20260709 13:11:44.372251 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.372514 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.373034 32030 leader_election.cc:290] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.374578 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:44.375720 26622 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.376024 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.375662 26505 raft_consensus.cc:1275] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:44.376524 31986 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:44.383881 32177 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.386245 32177 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.390209 26473 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:44.391335 26473 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.393307 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.393702 31532 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:44.394212 31532 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.395470 26622 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.396399 31532 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.397490 32111 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:44.398828 32112 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:44.399982 32196 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:44.391356 32168 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.400665 32196 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:44.401897 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.395504 26508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.405808 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:44.406399 26504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.410315 26506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.410454 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203b3a179cc240e6ac8beb1d95728111" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.411499 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:44.411868 26508 raft_consensus.cc:2410] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:11:44.412225 27271 raft_consensus.cc:2393] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 12: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:44.408017 32100 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:44.413368 32133 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:44.413267 32100 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.413952 32133 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:44.415464 32100 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:44.410912 26506 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:44.420307 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.422931 31854 raft_consensus.cc:3055] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:44.423360 31854 raft_consensus.cc:740] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:44.424839 26655 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 12.
I20260709 13:11:44.424345 31854 consensus_queue.cc:260] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.432518 26474 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:44.435634 26476 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.441401 26476 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.418139 32133 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:44.442199 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:44.447016 26476 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:44.445602 32196 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:44.448172 26476 leader_election.cc:304] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.449177 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:44.450353 32006 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:44.450730 32006 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:44.451071 32006 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:44.453944 32170 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:44.454741 32170 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:44.455149 32170 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:44.455564 32170 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:44.457105 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.440156 32074 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:44.489921 26501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.490831 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:44.493364 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 45255.7us
I20260709 13:11:44.494652 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.496230 32162 raft_consensus.cc:2749] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:44.447996 32204 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:44.498720 26473 leader_election.cc:304] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:44.456658 31854 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.505657 32185 consensus_queue.cc:1059] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:11:44.486897 32177 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:44.492951 32196 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:44.510712 32086 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:44.521410 31678 raft_consensus.cc:2749] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:44.523283 32086 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:44.512063 26401 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34738 (request call id 299) took 19742 ms (client timeout 15000 ms). Trace:
I20260709 13:11:44.527107 32023 raft_consensus.cc:3055] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:44.527510 32023 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:44.528096 32196 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.528307 32023 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.529831 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.519654 26506 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:44.519970 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.522611 32204 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:44.518764 26405 catalog_manager.cc:5697] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.518821 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.532645 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.520831 32177 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:44.536396 26405 catalog_manager.cc:5697] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.538600 26476 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:44.539784 26476 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.489696 32074 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.541594 31893 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:44.542032 31893 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:44.542404 31893 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:44.542629 32074 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:44.547523 26405 catalog_manager.cc:5697] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 5 to 6, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 6 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.552066 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.525501 32086 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.534482 32177 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:44.559372 26476 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.561455 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.565219 26655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.569192 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.569453 26576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.569939 26622 leader_election.cc:304] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.570688 26502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.571007 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.574338 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.575564 26654 raft_consensus.cc:2410] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:11:44.565672 32074 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.576977 32103 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:44.576824 32074 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.551148 31678 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:44.585459 31956 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:44.557840 32023 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:44.596602 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.579684 31972 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:44.580180 32086 raft_consensus.cc:2749] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:44.605278 26657 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:11:44.608083 26456 auto_rebalancer.cc:629] Failed to schedule move for tablet 9b26ae30d0734e338bc81b8d9f963b67: Illegal state: Replica af1b5d6d444447b7a580afb4aff33320 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:44.577919 32103 consensus_queue.cc:1048] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:11:44.602645 31956 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:44.625988 32201 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:44.625741 31956 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:44.525735 26401 rpcz_store.cc:269] 0709 13:11:24.785753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.796972 (+ 11219us) service_pool.cc:224] Handling call
0709 13:11:44.511841 (+19714869us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:33.783731 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:33.786141 (+  2410us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:33.786235 (+    94us) write_op.cc:435] Acquired schema lock
0709 13:11:33.786257 (+    22us) tablet.cc:662] Decoding operations
0709 13:11:33.866984 (+ 80727us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:33.867112 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:33.867153 (+    41us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:11:33.883650 (+ 16497us) tablet.cc:701] Row locks acquired
0709 13:11:33.883705 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:11:33.883865 (+   160us) write_op.cc:270] Start()
0709 13:11:33.884010 (+   145us) write_op.cc:276] Timestamp: P: 1783602693883802 usec, L: 0
0709 13:11:33.884044 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:11:33.890234 (+  6190us) log.cc:844] Serialized 9876 byte log entry
0709 13:11:34.710035 (+819801us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b18002c1ee0. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f8832704de1 00007f88327115b1 00007f882983c3f3 00007f882983e7c1 00007f882983e779 00007f882983e709 00007f882983e6d1 00007f882983d9cd 000000000038f354 000000000038f199 00007f882981f83a
0709 13:11:35.588689 (+878654us) op_driver.cc:464] REPLICATION: finished
0709 13:11:36.260180 (+671491us) write_op.cc:301] APPLY: starting
0709 13:11:36.260292 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:36.603889 (+343597us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:36.603962 (+    73us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:37.280533 (+676571us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:37.281309 (+   776us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 13:11:37.281403 (+    94us) write_op.cc:312] APPLY: finished
0709 13:11:37.282671 (+  1268us) log.cc:844] Serialized 220 byte log entry
0709 13:11:37.515766 (+233095us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:37.547734 (+ 31968us) write_op.cc:454] Released schema lock
0709 13:11:37.547843 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:37.548423 (+   580us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:37.548451 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3563322,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":671170,"apply.run_cpu_time_us":96807,"apply.run_wall_time_us":1288183,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108677,"num_ops":25,"prepare.queue_time_us":412167,"prepare.run_cpu_time_us":17749,"prepare.run_wall_time_us":206914,"raft.queue_time_us":631869,"raft.run_cpu_time_us":31761,"raft.run_wall_time_us":286105,"replication_time_us":1704459,"spinlock_wait_cycles":11074432,"thread_start_us":1449332,"threads_started":5,"wal-append.queue_time_us":411223,"wal-append.run_cpu_time_us":27544,"wal-append.run_wall_time_us":2862417}]]}
I20260709 13:11:44.599220 32088 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:44.632658 32088 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.634909 32088 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:44.619160 31678 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.637990 31678 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.593084 32006 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.642370 26580 raft_consensus.cc:1240] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:44.602921 32199 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:44.643369 32006 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.646111 32074 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:44.586299 31919 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:11:44.655920 31678 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.660386 32170 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.661613 26510 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:44.662523 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.669438 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.676072 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:44.677384 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
W20260709 13:11:44.678160 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 50043.4us
I20260709 13:11:44.678864 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.698333 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.699047 26651 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 14.
I20260709 13:11:44.702222 32170 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:44.700361 26474 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:44.708343 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:44.709620 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:44.713585 31956 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.696058 32164 consensus_queue.cc:1059] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:11:44.715730 32164 raft_consensus.cc:3055] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:44.716156 32164 raft_consensus.cc:740] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:44.667209 31919 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:44.721395 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.727218 26476 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.738164 26654 raft_consensus.cc:1240] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Rejecting Update request from peer ef2886777a8f45e69e213b02a22ecec7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:44.740023 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 61236.4us
I20260709 13:11:44.740830 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.748039 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.775102 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.736948 31919 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.798885 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
W20260709 13:11:44.799950 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 125032us
I20260709 13:11:44.717175 32164 consensus_queue.cc:260] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.818640 32164 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:44.826978 32203 consensus_queue.cc:1059] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:44.828576 32203 raft_consensus.cc:3055] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:44.829098 32203 raft_consensus.cc:740] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:11:44.833016 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 48197.1us
I20260709 13:11:44.755390 32205 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:44.747328 31854 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:44.781459 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.786235 27275 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:44.787041 31955 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:44.850225 31955 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.852027 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.852341 31955 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.787516 32115 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:44.854362 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.854522 32115 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.783452 32173 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:44.861299 32115 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.864691 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.865435 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.866024 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:44.870323 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:44.871470 27241 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:44.872725 31997 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:44.873992 27241 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:44.874958 32165 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:44.875670 27241 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:44.876309 31919 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:44.876569 32161 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:44.878958 32161 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:44.784312 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.881991 26651 raft_consensus.cc:2393] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 13: Already voted for candidate af1b5d6d444447b7a580afb4aff33320 in this term.
I20260709 13:11:44.883174 27241 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:44.883975 32161 raft_consensus.cc:2749] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:44.883716 31893 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.874034 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:44.889890 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.890177 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:44.890198 26503 raft_consensus.cc:1240] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:44.892272 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:44.897445 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.897475 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:44.898880 31893 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.901245 32203 consensus_queue.cc:260] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:44.918275 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:44.903515 26578 raft_consensus.cc:2393] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b9c3761688a64982ae1c4aeb758e09ef in current term 16: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:44.913323 26549 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:44.758131 32177 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:44.930447 27241 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:44.930531 26622 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.931260 32205 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:44.932667 31997 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:44.934029 26549 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:44.938151 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 64796.7us
I20260709 13:11:44.938470 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.940822 32100 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:44.937472 32152 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:44.942994 26653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:44.943775 26578 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:11:44.944180 26578 pending_rounds.cc:85] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: Aborting all ops after (but not including) 9
I20260709 13:11:44.944542 26578 pending_rounds.cc:107] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:11:44.944864 26578 raft_consensus.cc:2889] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.935249 31998 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:44.942793 26549 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:44.918736 32203 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:44.968163 26622 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:44.978579 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:44.990588 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 47884.9us
I20260709 13:11:44.955796 32090 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:44.968215 31678 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:44.998054 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:44.977854 32177 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:44.990142 32103 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:45.022639 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:45.026270 32090 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:45.026880 32090 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:45.030227 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:45.032341 32090 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:45.036329 31678 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:45.036875 31678 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:45.050779 27271 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:45.052136 26578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:45.008128 32108 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.980695 31955 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:11:45.068733 26625 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:45.065570 32114 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:45.047097 32196 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:45.076172 26580 raft_consensus.cc:1275] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:45.081157 27277 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 16.
I20260709 13:11:45.093086 26506 raft_consensus.cc:1240] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Rejecting Update request from peer af1b5d6d444447b7a580afb4aff33320 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:45.076830 31999 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:45.084627 31986 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:45.088527 32187 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.071506 32115 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:11:45.131244 32221 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:45.126121 31955 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
W20260709 13:11:45.226001 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 71580.4us
I20260709 13:11:45.127172 32187 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:45.181802 32117 consensus_queue.cc:1048] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
W20260709 13:11:45.286105 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 53391.1us
I20260709 13:11:45.225963 32205 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:45.240830 31955 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:45.348984 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:45.383790 32224 log.cc:927] Time spent T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:11:45.403620 26654 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:11:45.437650 32226 log.cc:927] Time spent T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:11:45.451047 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 47528.7us
I20260709 13:11:45.444729 32187 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:45.458189 32196 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
W20260709 13:11:45.468950 32225 log.cc:927] Time spent T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:11:45.470816 32222 log.cc:927] Time spent T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
I20260709 13:11:45.479552 32069 tablet_bootstrap.cc:492] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:11:45.480504 32069 tablet_bootstrap.cc:492] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:11:45.481151 32069 ts_tablet_manager.cc:1403] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 1.336s	user 0.049s	sys 0.038s
I20260709 13:11:45.496562 32108 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:45.519798 31955 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:45.529366 26473 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:45.532738 32135 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:45.533298 32135 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:45.542516 32135 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:45.561142 31678 consensus_meta.cc:287] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: Time spent flushing consensus metadata: real 0.524s	user 0.004s	sys 0.008s
I20260709 13:11:45.561628 31678 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:45.565448 31678 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:45.581600 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:45.585458 32115 consensus_queue.cc:1059] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:45.586834 32115 raft_consensus.cc:3055] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:45.587980 32115 raft_consensus.cc:740] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:45.601686 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:45.609005 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:45.615299 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:45.585104 32069 raft_consensus.cc:359] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:45.649822 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43881.4us
I20260709 13:11:45.675133 26625 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:45.696592 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 47276.4us
I20260709 13:11:45.688570 32117 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:45.698014 32069 raft_consensus.cc:740] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:11:45.719799 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:45.675213 32115 consensus_queue.cc:260] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:45.728964 27277 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:11:45.811369 32236 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:11:45.798870 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 67229.3us
W20260709 13:11:45.817476 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 62412.9us
W20260709 13:11:45.829101 32235 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:11:45.817775 32230 log.cc:927] Time spent T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:11:45.819681 32115 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:45.853154 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 81388.8us
I20260709 13:11:45.871500 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d05596fdb0401faeb202a1f8740d44" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:45.874179 32237 log.cc:927] Time spent T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:45.745119 32069 consensus_queue.cc:260] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:45.876597 32069 ts_tablet_manager.cc:1434] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.395s	user 0.009s	sys 0.003s
W20260709 13:11:45.895609 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 180333us
I20260709 13:11:45.900530 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:45.905985 31972 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:45.914871 31893 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:11:45.917755 26501 raft_consensus.cc:1240] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Rejecting Update request from peer b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:45.925863 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-731b96cedb5749df893a1de699717183 received from {username='slave'} at 127.0.0.1:55308
I20260709 13:11:45.926457 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-731b96cedb5749df893a1de699717183 on tablet 731b96cedb5749df893a1de699717183 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:45.928361 32152 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:45.928962 32152 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:45.931365 32152 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:45.945804 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 142001us
W20260709 13:11:45.962077 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 110828us
W20260709 13:11:45.963146 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 48401.8us
I20260709 13:11:45.972007 31999 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.972594 31999 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:45.974711 31999 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:45.981727 26579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:11:45.982391 26579 raft_consensus.cc:606] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:45.983526 26548 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:45.991894 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:45.992764 26579 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:45.994179 26625 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:45.994467 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 251800us
I20260709 13:11:45.994990 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:45.996475 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:45.997043 26652 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 13.
I20260709 13:11:46.003496 27275 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 13: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:46.005766 26579 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:45.988977 32006 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:45.997118 32244 consensus_queue.cc:1059] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 13:11:46.022926 32234 log.cc:927] Time spent T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.192s	user 0.004s	sys 0.000s
I20260709 13:11:46.037358 31813 raft_consensus.cc:993] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:11:46.037916 31813 raft_consensus.cc:1081] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:11:46.041863 31711 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:46.042491 31711 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.042843 31711 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.045701 26549 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:46.047030 32185 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:46.047395 32185 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:46.047760 32185 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:46.033918 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:46.053611 27275 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:46.059104 26657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54888
I20260709 13:11:46.059680 26657 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:46.060019 26657 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:46.065274 32170 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:46.068517 32249 raft_consensus.cc:3055] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:46.069038 32249 raft_consensus.cc:740] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:46.071645 31972 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.074661 26659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "574d2707e806420dab53495563bd03aa"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:36240
I20260709 13:11:46.079658 32249 consensus_queue.cc:260] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:46.081240 32249 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:46.083418 26659 raft_consensus.cc:606] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:46.083909 26659 raft_consensus.cc:614] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:46.072232 31972 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:46.103777 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:36240
I20260709 13:11:46.104626 26652 raft_consensus.cc:606] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:46.105168 26652 raft_consensus.cc:614] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:46.113890 27270 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:46.103605 26657 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:46.118280 26652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ecc61d0190444bea318620b6a278926"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:36240
I20260709 13:11:46.119278 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:46.119464 26652 raft_consensus.cc:606] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:46.119884 26579 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:46.097045 32185 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:46.120838 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:46.121433 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:46.160316 26652 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 13.
I20260709 13:11:46.121724 32135 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:46.122378 26657 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:46.123538 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:46.163208 26579 raft_consensus.cc:3055] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:46.163540 26579 raft_consensus.cc:740] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:46.163887 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:46.164515 26507 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:46.117461 31972 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:46.131266 27270 raft_consensus.cc:1217] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:11:46.165702 27270 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 LEARNER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:46.164242 26579 consensus_queue.cc:260] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:46.170864 26579 raft_consensus.cc:3060] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:46.102741 31711 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:46.129662 26509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
mode: GRACEFUL
new_leader_uuid: "ef2886777a8f45e69e213b02a22ecec7"
 from {username='slave'} at 127.0.0.1:43670
I20260709 13:11:46.175973 26509 raft_consensus.cc:606] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Received request to transfer leadership to TS ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:46.176373 26509 raft_consensus.cc:614] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:46.168974 32196 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:46.182540 26408 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 14 to 16, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 16 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.184554 26408 catalog_manager.cc:5697] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 11 to 12, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 12 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.187057 32185 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:46.186667 26408 catalog_manager.cc:5697] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 14 to 17, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 17 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.188717 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:46.188076 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:46.178359 32196 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.211336 27277 raft_consensus.cc:2393] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 13: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:46.200377 26408 catalog_manager.cc:5697] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.202513 26579 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 17.
I20260709 13:11:46.205359 26651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:36240
I20260709 13:11:46.216506 26651 raft_consensus.cc:606] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:46.216924 26651 raft_consensus.cc:614] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:46.216568 26408 catalog_manager.cc:5697] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.199373 26507 raft_consensus.cc:2468] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 17.
I20260709 13:11:46.220153 26657 raft_consensus.cc:2368] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14.
I20260709 13:11:46.219650 26625 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:46.215560 32196 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.232556 26549 leader_election.cc:400] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14.
I20260709 13:11:46.233068 26549 leader_election.cc:403] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:11:46.237072 26405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34748 (request call id 321) took 40753 ms (client timeout 15000 ms). Trace:
I20260709 13:11:46.227619 26408 catalog_manager.cc:5697] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 11, term changed from 12 to 18, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193), NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 18 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.241350 26657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
mode: GRACEFUL
new_leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:36240
I20260709 13:11:46.241954 26657 raft_consensus.cc:606] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Received request to transfer leadership to TS b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:46.242272 26657 raft_consensus.cc:614] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:46.224053 32229 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.224287 32117 raft_consensus.cc:2804] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:46.240178 26408 catalog_manager.cc:5697] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:46.237514 26405 rpcz_store.cc:269] 0709 13:11:05.572649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.585651 (+ 13002us) service_pool.cc:224] Handling call
0709 13:11:46.232107 (+40646456us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:45.379800 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:45.446082 (+ 66282us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:45.451246 (+  5164us) write_op.cc:435] Acquired schema lock
0709 13:11:45.452360 (+  1114us) tablet.cc:662] Decoding operations
0709 13:11:45.474906 (+ 22546us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:45.474988 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:45.475007 (+    19us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:11:45.475753 (+   746us) tablet.cc:701] Row locks acquired
0709 13:11:45.475775 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:11:45.475904 (+   129us) write_op.cc:270] Start()
0709 13:11:45.476032 (+   128us) write_op.cc:276] Timestamp: P: 1783602705475851 usec, L: 0
0709 13:11:45.476046 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:11:45.540637 (+ 64591us) log.cc:844] Serialized 4811 byte log entry
0709 13:11:45.942822 (+402185us) op_driver.cc:464] REPLICATION: finished
0709 13:11:46.062165 (+119343us) write_op.cc:301] APPLY: starting
0709 13:11:46.062250 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:46.099530 (+ 37280us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:46.099621 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:46.115616 (+ 15995us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:46.115867 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:11:46.115922 (+    55us) write_op.cc:312] APPLY: finished
0709 13:11:46.116237 (+   315us) log.cc:844] Serialized 113 byte log entry
0709 13:11:46.117131 (+   894us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:46.117262 (+   131us) write_op.cc:454] Released schema lock
0709 13:11:46.117316 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:46.127134 (+  9818us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:46.127169 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5306095,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":119096,"apply.run_cpu_time_us":15391,"apply.run_wall_time_us":64937,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54311,"num_ops":12,"prepare.queue_time_us":551461,"prepare.run_cpu_time_us":20129,"prepare.run_wall_time_us":312858,"raft.queue_time_us":64657,"raft.run_cpu_time_us":25388,"raft.run_wall_time_us":72284,"replication_time_us":466627,"thread_start_us":486222,"threads_started":4,"wal-append.queue_time_us":162177}]]}
I20260709 13:11:46.249603 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:11:46.251595 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:46.246569 26408 catalog_manager.cc:5697] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 13, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 13 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.258319 32111 raft_consensus.cc:993] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: : Instructing follower b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:11:46.258785 32111 raft_consensus.cc:1081] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Signalling peer b1f40e8672c549d3b4be7862ac07b7e2 to start an election
I20260709 13:11:46.239223 32099 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.256057 26408 catalog_manager.cc:5697] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.263506 32117 raft_consensus.cc:697] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 17 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:46.264077 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:46.264451 32117 consensus_queue.cc:237] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:46.269598 27277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ecc61d0190444bea318620b6a278926"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:11:46.270147 27277 raft_consensus.cc:493] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:46.270488 27277 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:46.275084 26408 catalog_manager.cc:5697] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 15, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 15 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.279207 26408 catalog_manager.cc:5697] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 11 to 14, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 14 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.282264 26408 catalog_manager.cc:5697] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 15, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 15 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.285871 31711 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:46.293870 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01228e22d88047b6bc2f5a6b74aa2b51" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:46.294500 27270 raft_consensus.cc:3060] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.273630 32229 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:46.305032 32229 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:46.308871 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:46.309656 26585 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 16.
I20260709 13:11:46.318257 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:46.318950 26507 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 17.
I20260709 13:11:46.321085 27277 raft_consensus.cc:515] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:46.321913 26622 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:46.283869 26408 catalog_manager.cc:5697] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 11, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 11 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.325680 26408 catalog_manager.cc:5697] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 12 to 16, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 16 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.327374 27270 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:46.337854 26622 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:46.344405 32229 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:46.344679 32116 raft_consensus.cc:2804] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:46.344911 32229 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.345309 32116 raft_consensus.cc:697] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:46.345410 32229 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:46.346196 32116 consensus_queue.cc:237] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:46.349120 27277 leader_election.cc:290] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:46.351730 26408 catalog_manager.cc:5697] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.352715 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:46.353389 26651 raft_consensus.cc:3055] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:46.353984 26651 raft_consensus.cc:740] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:46.351603 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecc61d0190444bea318620b6a278926" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:46.357473 26580 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:46.353505 26408 catalog_manager.cc:5697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 10 to 14, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 14 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.360936 26408 catalog_manager.cc:5697] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 8 to 14, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 14 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.357013 26651 consensus_queue.cc:260] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:46.364639 26651 raft_consensus.cc:3060] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:46.367339 26580 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
W20260709 13:11:46.370438 32258 log.cc:927] Time spent T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:11:46.373188 26408 catalog_manager.cc:5697] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 4 to 14, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 14 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.375011 26408 catalog_manager.cc:5697] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 12, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 12 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.376717 26408 catalog_manager.cc:5697] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.378021 26408 catalog_manager.cc:5697] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 11 to 16, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 16 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.379618 26408 catalog_manager.cc:5697] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 10, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 10 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.380149 27243 leader_election.cc:304] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:46.381035 26408 catalog_manager.cc:5697] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.382472 26408 catalog_manager.cc:5697] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.383796 26408 catalog_manager.cc:5697] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 8 to 10, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 10 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.372795 32099 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 for earlier term 13. Current term is 14.
I20260709 13:11:46.381742 31954 raft_consensus.cc:2804] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:46.393954 31954 raft_consensus.cc:697] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:46.385125 26408 catalog_manager.cc:5697] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 13 to 15, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 15 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.395521 26651 raft_consensus.cc:2468] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:46.396560 26408 catalog_manager.cc:5697] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 13 to 18, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 18 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.394848 31954 consensus_queue.cc:237] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:46.398030 26408 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.402868 26408 catalog_manager.cc:5697] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 5 to 17, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 17 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.410677 26408 catalog_manager.cc:5697] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.411000 32196 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:46.411988 26408 catalog_manager.cc:5697] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 6 to 12, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 12 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.416224 26408 catalog_manager.cc:5697] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 14, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 14 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.417980 26408 catalog_manager.cc:5697] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 6 to 11, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 11 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.418128 26579 raft_consensus.cc:2468] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 14.
I20260709 13:11:46.421748 32229 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:46.424408 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:46.424959 26507 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:46.430189 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:46.430800 26582 raft_consensus.cc:3060] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:46.431671 26507 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 18.
I20260709 13:11:46.434697 32196 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:46.435091 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:46.435690 26580 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.438450 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:46.440774 26657 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.443260 26580 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 14.
I20260709 13:11:46.444903 26476 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:46.445725 32196 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:46.448973 26582 raft_consensus.cc:2468] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 18.
I20260709 13:11:46.451252 26408 catalog_manager.cc:5697] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 12 to 13, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 13 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.461198 26408 catalog_manager.cc:5697] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 11, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 11 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.468369 26408 catalog_manager.cc:5697] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 10 to 14, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 14 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.450167 32196 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 14 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:46.474293 26408 catalog_manager.cc:5697] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.461869 26625 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:46.475596 26408 catalog_manager.cc:5697] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.477919 26657 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 14.
I20260709 13:11:46.474293 32196 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:46.459618 32229 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:46.481794 32229 raft_consensus.cc:2804] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:46.482473 32229 raft_consensus.cc:697] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 18 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:46.485450 26408 catalog_manager.cc:5697] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 11 to 14, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 14 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:46.488194 26408 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 8 to 13, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 13 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.483564 32229 consensus_queue.cc:237] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:46.616609 31854 raft_consensus.cc:1064] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:11:46.622851 31854 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:46.644161 32263 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:46.692816 26657 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:46.693084 26579 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:46.694712 31678 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:46.697154 32196 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:46.703085 27275 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:46.706207 31678 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:46.711620 26507 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:46.713586 32229 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:46.738117 26582 raft_consensus.cc:1275] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:46.742708 32229 consensus_queue.cc:1048] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:46.882228 27277 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:46.874065 32116 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.889459 32116 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:46.938879 32116 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:46.895617 31972 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.953681 26584 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:46.956686 26585 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:46.952024 26579 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:46.961493 32135 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:46.974680 26580 raft_consensus.cc:1275] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:46.961841 32229 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:46.963765 31954 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:11:47.038882 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 89559.3us
I20260709 13:11:47.055567 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:47.060446 26652 raft_consensus.cc:1275] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:47.065884 26503 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 17.
I20260709 13:11:47.070313 31954 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:47.071300 31954 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:47.074061 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:47.075692 27277 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 16.
I20260709 13:11:47.079259 31919 consensus_queue.cc:1048] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:47.082751 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:47.083734 26507 raft_consensus.cc:2393] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 17: Already voted for candidate b9c3761688a64982ae1c4aeb758e09ef in this term.
I20260709 13:11:47.088932 26659 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:47.100971 31954 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:47.102480 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:47.111284 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:47.111927 31711 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:47.112375 31711 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.112744 31711 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:47.118335 26507 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:47.103160 27277 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:47.132392 32116 consensus_queue.cc:1048] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:47.137703 32135 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:47.140259 26580 raft_consensus.cc:1275] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:47.196970 31711 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:47.222230 31711 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:47.232379 26659 raft_consensus.cc:2368] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 17. Current term is 18.
I20260709 13:11:47.253048 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:47.239140 31711 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:11:47.292642 32233 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.293407 32233 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:47.322407 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:47.323594 26507 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:11:47.337620 27241 leader_election.cc:400] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 17. Current term is 18.
I20260709 13:11:47.339913 27241 leader_election.cc:403] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:47.342625 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 57917.9us
I20260709 13:11:47.343377 31936 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:47.346083 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:47.347162 32164 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:47.347683 32164 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.348081 32164 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:47.310726 32233 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:47.378352 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:47.390040 32164 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:47.401307 32164 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:47.403891 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:47.404757 26507 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:47.405287 26654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:47.417793 26507 raft_consensus.cc:2468] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 16.
W20260709 13:11:47.444541 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 216073us
I20260709 13:11:47.452893 27240 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:47.461750 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:47.462455 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:47.462528 26507 raft_consensus.cc:3060] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:47.576141 31936 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711) with higher term. Message: Invalid argument: T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 for earlier term 17. Current term is 18.
I20260709 13:11:47.577973 26651 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:47.465487 31954 raft_consensus.cc:2804] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:47.581852 31954 raft_consensus.cc:697] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:47.583154 31954 consensus_queue.cc:237] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:47.593685 26402 catalog_manager.cc:5697] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 4 to 11, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 11 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:47.604509 32229 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:47.605356 32229 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:47.607061 26402 catalog_manager.cc:5697] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.610431 26402 catalog_manager.cc:5697] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 7 to 13, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 13 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.615283 32115 consensus_queue.cc:1048] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:47.633040 27277 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 18.
I20260709 13:11:47.632970 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:47.641098 26507 raft_consensus.cc:2468] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 18.
I20260709 13:11:47.607800 32229 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:47.643630 26503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef" is_pre_election: true
I20260709 13:11:47.661206 26503 raft_consensus.cc:2368] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 15. Current term is 16.
I20260709 13:11:47.645582 26402 catalog_manager.cc:5697] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 6 to 7, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 7 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.703795 26622 leader_election.cc:400] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 15. Current term is 16.
I20260709 13:11:47.704154 26622 leader_election.cc:403] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:47.734066 26402 catalog_manager.cc:5697] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 7 to 12, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 12 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:47.735829 26402 catalog_manager.cc:5697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 5 to 11, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 11 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:47.759545 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 57104.2us
I20260709 13:11:47.760599 26622 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
W20260709 13:11:47.771203 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 64624us
I20260709 13:11:47.762498 26402 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:47.781592 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 55694.5us
I20260709 13:11:47.784183 32273 raft_consensus.cc:3060] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:11:47.790261 32269 log.cc:927] Time spent T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:11:47.777204 32116 raft_consensus.cc:2804] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:47.771229 26408 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34738 (request call id 300) took 3229 ms. Trace:
I20260709 13:11:47.805683 26402 catalog_manager.cc:5697] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 8 to 9, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 9 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.809154 26402 catalog_manager.cc:5697] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 7 to 12, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 12 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:47.859097 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 93982.6us
I20260709 13:11:47.797549 26408 rpcz_store.cc:276] 0709 13:11:44.541936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.542987 (+  1051us) service_pool.cc:224] Handling call
0709 13:11:47.770997 (+3228010us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:46.634487 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:46.635108 (+   621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:46.635148 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:11:46.635166 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:46.637829 (+  2663us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:46.637905 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:46.637934 (+    29us) tablet.cc:685] Acquiring locks for 40 operations
0709 13:11:46.640567 (+  2633us) tablet.cc:701] Row locks acquired
0709 13:11:46.640586 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:46.640729 (+   143us) write_op.cc:270] Start()
0709 13:11:46.640845 (+   116us) write_op.cc:276] Timestamp: P: 1783602706640678 usec, L: 0
0709 13:11:46.640864 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:11:46.642132 (+  1268us) log.cc:844] Serialized 15749 byte log entry
0709 13:11:46.675732 (+ 33600us) op_driver.cc:464] REPLICATION: finished
0709 13:11:46.697468 (+ 21736us) write_op.cc:301] APPLY: starting
0709 13:11:46.701683 (+  4215us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:46.737185 (+ 35502us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:46.737285 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:47.304348 (+567063us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:47.304893 (+   545us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=80,key_file_lookups=80,delta_file_lookups=0,mrs_lookups=0
0709 13:11:47.304970 (+    77us) write_op.cc:312] APPLY: finished
0709 13:11:47.305887 (+   917us) log.cc:844] Serialized 340 byte log entry
0709 13:11:47.323311 (+ 17424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.324037 (+   726us) write_op.cc:454] Released schema lock
0709 13:11:47.324128 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:47.333963 (+  9835us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.333997 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13536,"reported_tablets":47,"spinlock_wait_cycles":21376,"child_traces":[["op",{"apply.queue_time_us":21484,"apply.run_cpu_time_us":56304,"apply.run_wall_time_us":636402,"cfile_cache_hit":162,"cfile_cache_hit_bytes":171407,"num_ops":40,"prepare.queue_time_us":31694,"prepare.run_cpu_time_us":7462,"prepare.run_wall_time_us":20460,"replication_time_us":34714,"spinlock_wait_cycles":5376,"thread_start_us":59668,"threads_started":2}]]}
W20260709 13:11:47.915306 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47929us
I20260709 13:11:47.913196 32273 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907) with higher term. Message: Invalid argument: T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af1b5d6d444447b7a580afb4aff33320 for earlier term 15. Current term is 16.
W20260709 13:11:47.981035 32307 log.cc:927] Time spent T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
I20260709 13:11:48.029047 32116 raft_consensus.cc:697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 18 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:48.041632 32116 consensus_queue.cc:237] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:48.053160 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 259623us
I20260709 13:11:48.056229 26503 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:48.058032 31919 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:48.208814 26659 raft_consensus.cc:1275] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:48.211441 31919 consensus_queue.cc:1048] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:48.249899 26408 catalog_manager.cc:5697] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 11 to 12, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.259027 26408 catalog_manager.cc:5697] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:48.328023 26402 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48166 (request call id 198) took 14285 ms (client timeout 15000 ms). Trace:
I20260709 13:11:48.344484 26408 catalog_manager.cc:5697] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.355669 26408 catalog_manager.cc:5697] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 6 to 12, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 12 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
I20260709 13:11:48.357321 26408 catalog_manager.cc:5697] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 15 to 16, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 16 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.361847 26408 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 9 to 12, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 12 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.363951 26408 catalog_manager.cc:5697] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 12 to 17, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 17 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } }
W20260709 13:11:48.328464 26402 rpcz_store.cc:269] 0709 13:11:34.042492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.042687 (+   195us) service_pool.cc:224] Handling call
0709 13:11:48.327919 (+14285232us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:48.019031 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:48.019646 (+   615us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:48.019694 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:11:48.019712 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:48.020642 (+   930us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:48.020762 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:48.020792 (+    30us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:11:48.021586 (+   794us) tablet.cc:701] Row locks acquired
0709 13:11:48.021631 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:11:48.021804 (+   173us) write_op.cc:270] Start()
0709 13:11:48.021954 (+   150us) write_op.cc:276] Timestamp: P: 1783602708021728 usec, L: 0
0709 13:11:48.021975 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:11:48.022689 (+   714us) log.cc:844] Serialized 3628 byte log entry
0709 13:11:48.156968 (+134279us) op_driver.cc:464] REPLICATION: finished
0709 13:11:48.186572 (+ 29604us) write_op.cc:301] APPLY: starting
0709 13:11:48.186679 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:48.196125 (+  9446us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:48.196236 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:48.210088 (+ 13852us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:48.210328 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 13:11:48.210376 (+    48us) write_op.cc:312] APPLY: finished
0709 13:11:48.210655 (+   279us) log.cc:844] Serialized 89 byte log entry
0709 13:11:48.217735 (+  7080us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.225723 (+  7988us) write_op.cc:454] Released schema lock
0709 13:11:48.225778 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:48.226432 (+   654us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.226467 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":169114,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":26022,"apply.run_cpu_time_us":12558,"apply.run_wall_time_us":39833,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41765,"num_ops":9,"prepare.queue_time_us":128710,"prepare.run_cpu_time_us":4068,"prepare.run_wall_time_us":50738,"replication_time_us":99678,"thread_start_us":146678,"threads_started":2}]]}
I20260709 13:11:48.452602 26406 catalog_manager.cc:5697] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.459550 26406 catalog_manager.cc:5697] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 12 to 13, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 13 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.469061 26406 catalog_manager.cc:5697] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 12 to 13, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 13 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.505512 26406 catalog_manager.cc:5697] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 7 to 8, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 8 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:48.538566 26406 catalog_manager.cc:5697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 11 to 12, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 12 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:48.541154 26406 catalog_manager.cc:5697] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:48.605059 26509 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:48.625077 26408 catalog_manager.cc:5697] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 13 to 16, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 16 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:48.659685 32276 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:48.663101 26509 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:48.687971 27275 raft_consensus.cc:1275] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:48.698032 32276 consensus_queue.cc:1048] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:48.700243 26406 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34762 (request call id 324) took 7601 ms. Trace:
I20260709 13:11:48.703891 26406 rpcz_store.cc:276] 0709 13:11:41.113731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.122113 (+  8382us) service_pool.cc:224] Handling call
0709 13:11:48.700160 (+7578047us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:48.557057 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:48.557638 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:48.557672 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:11:48.557690 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:48.558424 (+   734us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:48.558478 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:48.558505 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:48.559005 (+   500us) tablet.cc:701] Row locks acquired
0709 13:11:48.559023 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:48.559152 (+   129us) write_op.cc:270] Start()
0709 13:11:48.559256 (+   104us) write_op.cc:276] Timestamp: P: 1783602708559108 usec, L: 0
0709 13:11:48.559279 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:11:48.560308 (+  1029us) log.cc:844] Serialized 2470 byte log entry
0709 13:11:48.567718 (+  7410us) op_driver.cc:464] REPLICATION: finished
0709 13:11:48.570502 (+  2784us) write_op.cc:301] APPLY: starting
0709 13:11:48.570584 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:48.575971 (+  5387us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:48.576054 (+    83us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:48.579364 (+  3310us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:48.579549 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:11:48.579590 (+    41us) write_op.cc:312] APPLY: finished
0709 13:11:48.579816 (+   226us) log.cc:844] Serialized 65 byte log entry
0709 13:11:48.581179 (+  1363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.581290 (+   111us) write_op.cc:454] Released schema lock
0709 13:11:48.581330 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:48.581692 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.581718 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1898525,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":2556,"apply.run_cpu_time_us":7732,"apply.run_wall_time_us":11148,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25092,"num_ops":6,"prepare.queue_time_us":101,"prepare.run_cpu_time_us":3360,"prepare.run_wall_time_us":5996,"replication_time_us":8301,"spinlock_wait_cycles":13696}]]}
I20260709 13:11:48.708881 26582 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:48.713935 27270 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:48.716336 32196 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:48.718420 32196 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:48.757320 32196 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:48.784927 27270 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:11:48.824277 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47063.2us
I20260709 13:11:48.834815 26392 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 731b96cedb5749df893a1de699717183 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:48.839319 26584 raft_consensus.cc:2955] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:48.861804 26407 catalog_manager.cc:5697] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 10 to 12, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 12 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.926357 26407 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 8 to 10, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 10 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:48.959393 26406 catalog_manager.cc:5697] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:48.990890 26406 catalog_manager.cc:5697] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 12 to 13, VOTER af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) evicted. New cstate: current_term: 18 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.999841 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:49.099256 26407 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34762 (request call id 323) took 27648 ms (client timeout 15000 ms). Trace:
I20260709 13:11:49.104701 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 731b96cedb5749df893a1de699717183 with delete_type TABLET_DATA_TOMBSTONED (TS af1b5d6d444447b7a580afb4aff33320 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:48850
W20260709 13:11:49.104570 26407 rpcz_store.cc:269] 0709 13:11:21.430912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.431428 (+   516us) service_pool.cc:224] Handling call
0709 13:11:49.079249 (+27647821us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:48.941027 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:48.941575 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:48.941614 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:11:48.941632 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:48.942063 (+   431us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:48.942117 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:48.942143 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:48.942470 (+   327us) tablet.cc:701] Row locks acquired
0709 13:11:48.942484 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:11:48.942619 (+   135us) write_op.cc:270] Start()
0709 13:11:48.942735 (+   116us) write_op.cc:276] Timestamp: P: 1783602708942576 usec, L: 0
0709 13:11:48.942767 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:11:48.945070 (+  2303us) log.cc:844] Serialized 925 byte log entry
0709 13:11:48.947022 (+  1952us) op_driver.cc:464] REPLICATION: finished
0709 13:11:48.947252 (+   230us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b540013f454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c892571 00007f882c924e28 00007f883035f581 00007f883035ed58 00007f88303639f1 00007f88303639a9 00007f8830363939 00007f8830363901 00007f8830362b2d 000000000038f354 000000000038f199
0709 13:11:48.947466 (+   214us) write_op.cc:301] APPLY: starting
0709 13:11:48.947540 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:48.948838 (+  1298us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:48.948859 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:48.950105 (+  1246us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:48.950282 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:11:48.950328 (+    46us) write_op.cc:312] APPLY: finished
0709 13:11:48.950522 (+   194us) log.cc:844] Serialized 33 byte log entry
0709 13:11:48.950705 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.950789 (+    84us) write_op.cc:454] Released schema lock
0709 13:11:48.950827 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:48.951215 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.951242 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":88377,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":252,"apply.run_cpu_time_us":3701,"apply.run_wall_time_us":3711,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":4885,"prepare.run_wall_time_us":6376,"replication_time_us":4135,"spinlock_wait_cycles":3731328}]]}
I20260709 13:11:49.127355 26582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e"
dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39748
I20260709 13:11:49.128062 26582 raft_consensus.cc:606] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
W20260709 13:11:49.136749 26404 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48166 (request call id 197) took 36910 ms (client timeout 15000 ms). Trace:
W20260709 13:11:49.145390 26404 rpcz_store.cc:269] 0709 13:11:12.226402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.241009 (+ 14607us) service_pool.cc:224] Handling call
0709 13:11:49.136469 (+36895460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13631,"reported_tablets":35}
I20260709 13:11:49.189270 32333 tablet_replica.cc:333] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:11:49.190505 32333 raft_consensus.cc:2243] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.191241 32333 raft_consensus.cc:2272] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.232208 32333 ts_tablet_manager.cc:1916] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:11:49.263727 26403 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34748 (request call id 322) took 19458 ms (client timeout 15000 ms). Trace:
W20260709 13:11:49.273710 26403 rpcz_store.cc:269] 0709 13:11:29.874741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.885324 (+ 10583us) service_pool.cc:224] Handling call
0709 13:11:49.263499 (+19378175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":645366,"reported_tablets":47}
I20260709 13:11:49.268770 26401 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 10 to 12, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 12 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:49.281853 26401 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 10 to 14, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 14 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:49.303040 27270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
mode: GRACEFUL
new_leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:53692
I20260709 13:11:49.303735 27270 raft_consensus.cc:606] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Received request to transfer leadership to TS b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:49.317413 32333 ts_tablet_manager.cc:1929] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:11:49.285145 26401 catalog_manager.cc:5697] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 13 to 14, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 14 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:49.318106 32333 log.cc:1199] T 731b96cedb5749df893a1de699717183 P af1b5d6d444447b7a580afb4aff33320: Deleting WAL directory at /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/wals/731b96cedb5749df893a1de699717183
I20260709 13:11:49.327977 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:49.330027 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:49.332464 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 731b96cedb5749df893a1de699717183 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:11:49.331820 26401 catalog_manager.cc:5697] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:49.346807 26401 catalog_manager.cc:5697] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:49.359778 26401 catalog_manager.cc:5697] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:49.444103 32185 raft_consensus.cc:993] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:11:49.444648 32185 raft_consensus.cc:1081] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:11:49.446990 26657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:54888
I20260709 13:11:49.447737 26657 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:49.448143 26657 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:49.450338 26402 catalog_manager.cc:5697] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:49.454764 26402 catalog_manager.cc:5697] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 12 to 13, leader changed from af1b5d6d444447b7a580afb4aff33320 (127.24.204.195) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 13 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:49.461200 26401 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34748 (request call id 323) took 3396 ms. Trace:
I20260709 13:11:49.461637 26401 rpcz_store.cc:276] 0709 13:11:46.064319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.069876 (+  5557us) service_pool.cc:224] Handling call
0709 13:11:46.105745 (+ 35869us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b540013f454. stack: 00007f882980a343 00007f882980a240 00007f88291991d4 00007f8832ed7304 00007f8832ed7299 00007f882c893090 00007f882c931f3a 00007f88326e81cc 00007f88327e637e 00007f8830ca72a4 00007f8830ca7232 00007f8830ca7161 00007f8830ca70dc 00007f8830ca6392 00007f882ac6448c 00007f882ac638c6
0709 13:11:49.461128 (+3355383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:49.372513 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:49.373244 (+   731us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:49.373281 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:11:49.373302 (+    21us) tablet.cc:662] Decoding operations
0709 13:11:49.374092 (+   790us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:49.374147 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:49.374178 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:49.374709 (+   531us) tablet.cc:701] Row locks acquired
0709 13:11:49.374725 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:11:49.374883 (+   158us) write_op.cc:270] Start()
0709 13:11:49.375009 (+   126us) write_op.cc:276] Timestamp: P: 1783602709374835 usec, L: 0
0709 13:11:49.375027 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:11:49.375676 (+   649us) log.cc:844] Serialized 2470 byte log entry
0709 13:11:49.378157 (+  2481us) op_driver.cc:464] REPLICATION: finished
0709 13:11:49.378567 (+   410us) write_op.cc:301] APPLY: starting
0709 13:11:49.378649 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:49.381989 (+  3340us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:49.382106 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:49.389439 (+  7333us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:49.389680 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:11:49.389733 (+    53us) write_op.cc:312] APPLY: finished
0709 13:11:49.390007 (+   274us) log.cc:844] Serialized 65 byte log entry
0709 13:11:49.390783 (+   776us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.390907 (+   124us) write_op.cc:454] Released schema lock
0709 13:11:49.390961 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:49.406152 (+ 15191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.406186 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10902,"reported_tablets":47,"spinlock_wait_cycles":26261632,"child_traces":[["op",{"apply.queue_time_us":232,"apply.run_cpu_time_us":8469,"apply.run_wall_time_us":27541,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25092,"num_ops":6,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":3478,"prepare.run_wall_time_us":4478,"replication_time_us":3015}]]}
I20260709 13:11:49.520190 26402 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48166 (request call id 199) took 1058 ms. Trace:
W20260709 13:11:49.538239 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 51128.3us
I20260709 13:11:49.520637 26402 rpcz_store.cc:276] 0709 13:11:48.462160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.462345 (+   185us) service_pool.cc:224] Handling call
0709 13:11:49.489438 (+1027093us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.489472 (+    34us) write_op.cc:454] Released schema lock
0709 13:11:49.520105 (+ 30633us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:49.479234 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:49.479733 (+   499us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:49.479784 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:11:49.479812 (+    28us) tablet.cc:662] Decoding operations
0709 13:11:49.480221 (+   409us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:49.480273 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:49.480298 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:49.480616 (+   318us) tablet.cc:701] Row locks acquired
0709 13:11:49.480635 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:49.480775 (+   140us) write_op.cc:270] Start()
0709 13:11:49.480892 (+   117us) write_op.cc:276] Timestamp: P: 1783602709480732 usec, L: 0
0709 13:11:49.480915 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:11:49.481546 (+   631us) log.cc:844] Serialized 925 byte log entry
0709 13:11:49.483965 (+  2419us) op_driver.cc:464] REPLICATION: finished
0709 13:11:49.484395 (+   430us) write_op.cc:301] APPLY: starting
0709 13:11:49.484476 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:49.485895 (+  1419us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:49.485999 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:49.487644 (+  1645us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:49.487820 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:11:49.487873 (+    53us) write_op.cc:312] APPLY: finished
0709 13:11:49.488082 (+   209us) log.cc:844] Serialized 33 byte log entry
0709 13:11:49.488245 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.488335 (+    90us) write_op.cc:454] Released schema lock
0709 13:11:49.488379 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":33413,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":243,"apply.run_cpu_time_us":4265,"apply.run_wall_time_us":4265,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":2594,"prepare.run_wall_time_us":4494,"replication_time_us":2930}]]}
I20260709 13:11:49.562070 26657 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:49.573151 26643 tablet_service.cc:1558] Processing DeleteTablet for tablet 731b96cedb5749df893a1de699717183 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 12 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:48850
I20260709 13:11:49.574024 26657 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:49.576176 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:49.576833 26582 raft_consensus.cc:3055] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:49.577150 26582 raft_consensus.cc:740] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:49.578004 26582 consensus_queue.cc:260] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:49.579190 26582 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:49.602594 26393 catalog_manager.cc:5028] TS af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): tablet 731b96cedb5749df893a1de699717183 (table test-workload [id=da66e59da99c4a47861232a8cf9fe043]) successfully deleted
I20260709 13:11:49.609920 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
I20260709 13:11:49.610579 26510 raft_consensus.cc:3060] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:49.659260 32292 raft_consensus.cc:993] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: : Instructing follower b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:11:49.659873 32292 raft_consensus.cc:1081] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Signalling peer b9c3761688a64982ae1c4aeb758e09ef to start an election
I20260709 13:11:49.660059 26510 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:49.661900 26507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa"
dest_uuid: "b9c3761688a64982ae1c4aeb758e09ef"
 from {username='slave'} at 127.0.0.1:55308
I20260709 13:11:49.662443 26507 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:49.662750 26622 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:49.672221 32312 raft_consensus.cc:2804] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:49.672858 32312 raft_consensus.cc:697] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:49.673799 32312 consensus_queue.cc:237] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:49.662761 26507 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:49.750483 26582 raft_consensus.cc:2468] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:49.762136 26507 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:49.810264 26408 catalog_manager.cc:5697] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 11 to 12, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 12 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:49.811992 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:49.812243 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:49.812633 26652 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:49.812847 27275 raft_consensus.cc:3055] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:49.813211 27275 raft_consensus.cc:740] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:49.813972 27275 consensus_queue.cc:260] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:49.815049 27275 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:49.840175 26507 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Requested vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:49.841279 26652 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 14.
I20260709 13:11:49.858409 27275 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9c3761688a64982ae1c4aeb758e09ef in term 14.
I20260709 13:11:49.860548 26473 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef; no voters: 
I20260709 13:11:49.862353 31854 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:49.862905 31854 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 14 LEADER]: Becoming Leader. State: Replica: b9c3761688a64982ae1c4aeb758e09ef, State: Running, Role: LEADER
I20260709 13:11:49.863806 31854 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:49.881408 26408 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: term changed from 13 to 14, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193). New cstate: current_term: 14 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:50.266536 26657 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:50.299043 27275 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:50.299180 26579 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:50.301431 26510 raft_consensus.cc:1275] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:50.303815 32337 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:50.305361 32337 consensus_queue.cc:1048] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:50.306020 31854 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:50.330981 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:50.378350 26622 consensus_peers.cc:597] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a3ba69234d6417b968d15d31d856dbf. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:50.408542 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 46242.3us
I20260709 13:11:50.411947 26582 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:50.438573 32312 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:50.456303 26509 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:50.466766 32337 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:50.533993 26659 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:50.536350 31893 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:50.564513 32353 raft_consensus.cc:2955] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:50.571028 26582 raft_consensus.cc:2955] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:50.649133 26401 catalog_manager.cc:5697] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index -1 to 10, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 14 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:50.652863 26510 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:50.683862 26509 raft_consensus.cc:2955] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
W20260709 13:11:50.709676 26473 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a72cbe5dad8844a08aa3bf83d8f3ad27. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.712332 26580 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:50.714350 32359 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:50.723338 26659 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:50.724999 32352 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:50.785795 32359 raft_consensus.cc:2955] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:50.797667 26580 raft_consensus.cc:2955] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:50.806816 26657 consensus_queue.cc:237] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:50.824672 26659 raft_consensus.cc:2955] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:50.906742 26580 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:50.909997 32337 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:50.922178 26507 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:50.938133 26401 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index -1 to 12, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 16 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:50.940716 32358 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:11:50.948041 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a158e3bdc954edd8dde2444100459ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.975775 32353 raft_consensus.cc:2955] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:50.979226 26507 raft_consensus.cc:2955] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:51.011293 26582 raft_consensus.cc:2955] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:51.018126 26658 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:51.046988 32373 ts_tablet_manager.cc:933] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:51.039942 26401 catalog_manager.cc:5697] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 8, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 10 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.050537 26579 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:51.053426 26507 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:51.054118 32358 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:51.056728 26622 consensus_peers.cc:597] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 -> Peer b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899): Couldn't send request to peer b1f40e8672c549d3b4be7862ac07b7e2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7672ae1d65b4497686627cb041189424. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:51.064142 32358 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:51.105132 32373 tablet_copy_client.cc:323] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:11:51.109534 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 7a3ba69234d6417b968d15d31d856dbf from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:11:51.110221 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 7a3ba69234d6417b968d15d31d856dbf from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-7a3ba69234d6417b968d15d31d856dbf
I20260709 13:11:51.128911 32353 raft_consensus.cc:2955] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:51.142652 26669 tablet_copy_source_session.cc:215] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:51.167361 26507 raft_consensus.cc:2955] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:51.167682 26579 raft_consensus.cc:2955] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } } }
I20260709 13:11:51.183523 26401 catalog_manager.cc:5697] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index -1 to 9, NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) added. New cstate: current_term: 14 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.190757 32373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a3ba69234d6417b968d15d31d856dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.276654 32378 ts_tablet_manager.cc:933] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:51.381455 32378 tablet_copy_client.cc:323] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.193:37907
I20260709 13:11:51.382500 32373 tablet_copy_client.cc:806] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:51.398027 32373 tablet_copy_client.cc:670] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
W20260709 13:11:51.405511 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 81549.2us
I20260709 13:11:51.410053 26520 tablet_copy_service.cc:140] P b9c3761688a64982ae1c4aeb758e09ef: Received BeginTabletCopySession request for tablet a72cbe5dad8844a08aa3bf83d8f3ad27 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:55308)
I20260709 13:11:51.410631 26520 tablet_copy_service.cc:161] P b9c3761688a64982ae1c4aeb758e09ef: Beginning new tablet copy session on tablet a72cbe5dad8844a08aa3bf83d8f3ad27 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:55308: session id = b1f40e8672c549d3b4be7862ac07b7e2-a72cbe5dad8844a08aa3bf83d8f3ad27
I20260709 13:11:51.417872 32380 ts_tablet_manager.cc:933] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:51.420724 26520 tablet_copy_source_session.cc:215] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:51.430713 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:51.432411 32373 tablet_copy_client.cc:538] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:51.434312 32378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a72cbe5dad8844a08aa3bf83d8f3ad27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.443424 32380 tablet_copy_client.cc:323] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:11:51.445742 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 2a158e3bdc954edd8dde2444100459ef from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:11:51.446274 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 2a158e3bdc954edd8dde2444100459ef from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-2a158e3bdc954edd8dde2444100459ef
I20260709 13:11:51.445761 32373 tablet_bootstrap.cc:492] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:11:51.459538 26669 tablet_copy_source_session.cc:215] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:51.508462 32380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a158e3bdc954edd8dde2444100459ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.520184 32378 tablet_copy_client.cc:806] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:51.524660 32378 tablet_copy_client.cc:670] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:51.534935 32378 tablet_copy_client.cc:538] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:51.543188 32380 tablet_copy_client.cc:806] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:51.543829 32380 tablet_copy_client.cc:670] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:51.579566 27270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10"
dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
mode: GRACEFUL
new_leader_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:53692
I20260709 13:11:51.580225 27270 raft_consensus.cc:606] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Received request to transfer leadership to TS af1b5d6d444447b7a580afb4aff33320
I20260709 13:11:51.582403 32380 tablet_copy_client.cc:538] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:51.597795 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:51.598814 32383 ts_tablet_manager.cc:933] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: Initiating tablet copy from peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:51.600018 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:51.604852 32380 tablet_bootstrap.cc:492] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:11:51.622970 32336 raft_consensus.cc:993] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: : Instructing follower af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:11:51.625463 31919 raft_consensus.cc:1081] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Signalling peer af1b5d6d444447b7a580afb4aff33320 to start an election
I20260709 13:11:51.627763 26658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10"
dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
 from {username='slave'} at 127.0.0.1:39256
I20260709 13:11:51.628289 26658 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:51.628638 26658 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:51.610633 32378 tablet_bootstrap.cc:492] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:11:51.651981 26658 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:51.659554 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:51.660302 26658 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:51.652443 32383 tablet_copy_client.cc:323] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Beginning tablet copy session from remote peer at address 127.24.204.195:34711
I20260709 13:11:51.660182 26580 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:51.663654 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6a5d55926746d28b7b8b8862f40c10" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:51.664251 27277 raft_consensus.cc:3055] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:51.664577 27277 raft_consensus.cc:740] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:51.665983 27277 consensus_queue.cc:260] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:51.668154 27277 raft_consensus.cc:3060] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:51.682955 26669 tablet_copy_service.cc:140] P af1b5d6d444447b7a580afb4aff33320: Received BeginTabletCopySession request for tablet 7672ae1d65b4497686627cb041189424 from peer b1f40e8672c549d3b4be7862ac07b7e2 ({username='slave'} at 127.0.0.1:39256)
I20260709 13:11:51.683545 26669 tablet_copy_service.cc:161] P af1b5d6d444447b7a580afb4aff33320: Beginning new tablet copy session on tablet 7672ae1d65b4497686627cb041189424 from peer b1f40e8672c549d3b4be7862ac07b7e2 at {username='slave'} at 127.0.0.1:39256: session id = b1f40e8672c549d3b4be7862ac07b7e2-7672ae1d65b4497686627cb041189424
I20260709 13:11:51.684584 26580 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:51.686085 26625 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:51.688234 32346 raft_consensus.cc:2804] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:51.688762 32346 raft_consensus.cc:697] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:51.689707 32346 consensus_queue.cc:237] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:51.692327 26669 tablet_copy_source_session.cc:215] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:51.700894 27277 raft_consensus.cc:2468] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 15.
I20260709 13:11:51.725045 32383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7672ae1d65b4497686627cb041189424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.744064 26408 catalog_manager.cc:5697] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 14 to 15, leader changed from b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 15 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.775574 32373 tablet_bootstrap.cc:492] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:51.778595 32373 tablet_bootstrap.cc:492] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:11:51.790923 32373 ts_tablet_manager.cc:1403] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.345s	user 0.037s	sys 0.011s
I20260709 13:11:51.840195 32373 raft_consensus.cc:359] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:51.850204 32373 raft_consensus.cc:740] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:11:51.855908 32373 consensus_queue.cc:260] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:51.863682 32373 ts_tablet_manager.cc:1434] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:11:51.959439 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-7a3ba69234d6417b968d15d31d856dbf received from {username='slave'} at 127.0.0.1:39256
I20260709 13:11:51.959933 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-7a3ba69234d6417b968d15d31d856dbf on tablet 7a3ba69234d6417b968d15d31d856dbf with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:51.963740 32383 tablet_copy_client.cc:806] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:51.964385 32383 tablet_copy_client.cc:670] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:51.973862 27275 raft_consensus.cc:1217] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:11:51.980674 32380 tablet_bootstrap.cc:492] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:52.026084 32383 tablet_copy_client.cc:538] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:52.033861 32380 tablet_bootstrap.cc:492] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:11:52.035017 32380 ts_tablet_manager.cc:1403] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.430s	user 0.038s	sys 0.019s
I20260709 13:11:52.046890 32383 tablet_bootstrap.cc:492] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap starting.
I20260709 13:11:52.063020 32380 raft_consensus.cc:359] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:52.064173 32380 raft_consensus.cc:740] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:11:52.065057 32380 consensus_queue.cc:260] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:52.084496 32380 ts_tablet_manager.cc:1434] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:11:52.087350 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-2a158e3bdc954edd8dde2444100459ef received from {username='slave'} at 127.0.0.1:39256
I20260709 13:11:52.087797 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-2a158e3bdc954edd8dde2444100459ef on tablet 2a158e3bdc954edd8dde2444100459ef with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:52.123960 32378 tablet_bootstrap.cc:492] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:52.129408 32378 tablet_bootstrap.cc:492] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:11:52.135159 32378 ts_tablet_manager.cc:1403] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.525s	user 0.051s	sys 0.000s
I20260709 13:11:52.138700 32378 raft_consensus.cc:359] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:52.145346 32378 raft_consensus.cc:740] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:11:52.153807 32378 consensus_queue.cc:260] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:52.157110 32378 ts_tablet_manager.cc:1434] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:11:52.168937 32383 tablet_bootstrap.cc:492] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:52.169988 32383 tablet_bootstrap.cc:492] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: Bootstrap complete.
I20260709 13:11:52.170706 32383 ts_tablet_manager.cc:1403] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent bootstrapping tablet: real 0.124s	user 0.030s	sys 0.015s
I20260709 13:11:52.187297 26520 tablet_copy_service.cc:342] P b9c3761688a64982ae1c4aeb758e09ef: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-a72cbe5dad8844a08aa3bf83d8f3ad27 received from {username='slave'} at 127.0.0.1:55308
I20260709 13:11:52.187855 26520 tablet_copy_service.cc:434] P b9c3761688a64982ae1c4aeb758e09ef: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-a72cbe5dad8844a08aa3bf83d8f3ad27 on tablet a72cbe5dad8844a08aa3bf83d8f3ad27 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:52.187841 32383 raft_consensus.cc:359] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:52.188980 32383 raft_consensus.cc:740] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Initialized, Role: LEARNER
I20260709 13:11:52.202735 32383 consensus_queue.cc:260] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:52.224400 32383 ts_tablet_manager.cc:1434] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:11:52.226580 26669 tablet_copy_service.cc:342] P af1b5d6d444447b7a580afb4aff33320: Request end of tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-7672ae1d65b4497686627cb041189424 received from {username='slave'} at 127.0.0.1:39256
I20260709 13:11:52.227020 26669 tablet_copy_service.cc:434] P af1b5d6d444447b7a580afb4aff33320: ending tablet copy session b1f40e8672c549d3b4be7862ac07b7e2-7672ae1d65b4497686627cb041189424 on tablet 7672ae1d65b4497686627cb041189424 with peer b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:52.238771 26579 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:52.242321 32312 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:52.316309 27275 raft_consensus.cc:1217] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:11:52.356285 27277 raft_consensus.cc:1217] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 13:11:52.358960 27275 raft_consensus.cc:1275] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:52.372097 32346 consensus_queue.cc:1048] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:52.574174 32346 raft_consensus.cc:1064] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:11:52.580924 27277 raft_consensus.cc:1217] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:11:52.583248 32346 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:52.604454 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:52.622658 27277 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:52.629736 32328 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:52.638748 26580 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:52.640715 32312 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:52.649780 26507 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:52.651576 32312 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:52.755565 32400 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 13:11:52.774686 32401 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.111s	user 0.000s	sys 0.003s
I20260709 13:11:52.779049 32358 raft_consensus.cc:2955] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:11:52.769502 32403 log.cc:927] Time spent T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: Append to log took a long time: real 0.103s	user 0.002s	sys 0.000s
I20260709 13:11:52.786244 27275 raft_consensus.cc:2955] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:52.793107 26509 raft_consensus.cc:2955] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:52.820230 25395 tablet_server.cc:179] TabletServer@127.24.204.193:0 shutting down...
I20260709 13:11:52.824937 26408 catalog_manager.cc:5697] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef reported cstate change: config changed from index 10 to 11, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:11:52.834395 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 74248.1us
W20260709 13:11:52.856253 26548 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:11:52.910655 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43995.3us
W20260709 13:11:52.952322 26548 consensus_peers.cc:597] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:52.954998 26548 consensus_peers.cc:597] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:52.955608 26548 consensus_peers.cc:597] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:52.956137 26548 consensus_peers.cc:597] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:52.958901 26580 raft_consensus.cc:2955] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:11:53.010309 26548 consensus_peers.cc:597] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.032100 27240 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.032744 27240 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.033385 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 64195.6us
W20260709 13:11:53.034417 27240 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.047842 27240 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.048398 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.042464 26548 consensus_peers.cc:597] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:53.099581 32196 raft_consensus.cc:1064] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
I20260709 13:11:53.108960 32328 raft_consensus.cc:1064] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
W20260709 13:11:53.154942 27240 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.170665 26548 consensus_peers.cc:597] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.212051 27240 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.213310 27240 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.238114 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 148469us
W20260709 13:11:53.264582 26622 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.265430 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.266119 26622 consensus_peers.cc:597] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:53.272838 32419 raft_consensus.cc:1064] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: attempting to promote NON_VOTER b1f40e8672c549d3b4be7862ac07b7e2 to VOTER
W20260709 13:11:53.276262 27240 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:53.275925 32419 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:53.276988 27240 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.292563 26622 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.295246 26622 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.295928 26622 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:53.309092 32196 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:53.271095 32328 consensus_queue.cc:237] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:53.353251 27240 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.397094 26622 consensus_peers.cc:597] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.411108 26622 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.413012 26622 consensus_peers.cc:597] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.444144 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47648.5us
W20260709 13:11:53.445123 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 195836us
W20260709 13:11:53.450413 26548 consensus_peers.cc:597] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.452803 26548 consensus_peers.cc:597] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.459473 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 158548us
I20260709 13:11:53.461108 26659 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:53.470057 26584 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:11:53.456411 26548 consensus_peers.cc:597] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.477524 26622 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:53.484618 32424 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:11:53.503275 32407 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
W20260709 13:11:53.505841 26548 consensus_peers.cc:597] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.528661 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:53.529990 26580 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:53.539762 32424 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:53.546236 26580 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:53.552115 27277 raft_consensus.cc:1275] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:53.555233 27275 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEARNER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:53.558516 32419 consensus_queue.cc:1048] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:11:53.593164 27275 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 LEARNER]: Refusing update from remote peer b9c3761688a64982ae1c4aeb758e09ef: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:53.607173 32387 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:11:53.608640 32359 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:53.609594 32423 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 13:11:53.670398 26622 consensus_peers.cc:597] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.667554 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 72318.9us
I20260709 13:11:53.727622 26652 consensus_queue.cc:237] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:53.736853 32409 raft_consensus.cc:493] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:53.747272 32409 raft_consensus.cc:515] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:53.777949 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 165326us
I20260709 13:11:53.795418 32409 leader_election.cc:290] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:53.809966 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:53.810523 27273 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:53.816458 26580 raft_consensus.cc:1275] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:53.814206 32358 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:11:53.843631 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe9b36ae60941888203dd2967005c27" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:53.837994 32359 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:53.866544 32407 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:53.867218 26476 leader_election.cc:304] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:53.867148 32407 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:53.868062 32387 raft_consensus.cc:2749] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:53.868784 32419 raft_consensus.cc:2955] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:53.870874 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:53.871027 32407 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:53.861295 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:53.876417 32359 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:53.879136 32359 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:53.881405 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:53.880373 25395 tablet_replica.cc:333] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:53.884038 25395 raft_consensus.cc:2243] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.884578 32413 consensus_queue.cc:1048] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:53.884814 32387 raft_consensus.cc:493] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:53.877946 27271 raft_consensus.cc:2955] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:53.896803 32404 raft_consensus.cc:493] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:53.897409 32404 raft_consensus.cc:515] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:53.898774 32414 raft_consensus.cc:2955] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:53.902374 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b945492abb95467c8e66b0f6d8842bc7" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:53.905182 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941b69cce0d24bb9a4f60558447429c4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:53.894546 32387 raft_consensus.cc:515] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:53.907991 32404 leader_election.cc:290] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:53.909206 32387 leader_election.cc:290] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:53.917192 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:53.919420 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:53.930943 32413 raft_consensus.cc:2955] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:53.921838 25395 raft_consensus.cc:2272] T 203b3a179cc240e6ac8beb1d95728111 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.941226 25395 tablet_replica.cc:333] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:53.940675 26584 raft_consensus.cc:2955] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:53.923965 26476 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:53.925993 32404 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:53.942255 25395 raft_consensus.cc:2243] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.945609 26579 raft_consensus.cc:2955] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:53.958117 27277 raft_consensus.cc:2955] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:53.958010 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93f34ef8a541ecba8b1a0dc7ea5a2a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:53.963042 32196 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:53.963853 32196 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.012820 25395 raft_consensus.cc:2272] T fb7b25ba8d2644ceb86280e40ef3c8dc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.016613 32196 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.019654 32196 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:53.955045 32387 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:54.021651 32196 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:54.041877 32387 raft_consensus.cc:493] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:54.042495 32387 raft_consensus.cc:515] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.049006 32196 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.053661 32196 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:54.054177 32196 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:54.070647 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574d2707e806420dab53495563bd03aa" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.074991 32409 raft_consensus.cc:493] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:54.075819 32409 raft_consensus.cc:515] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:53.957192 32404 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:54.101730 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.103235 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.103909 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.111390 32196 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.115140 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce4b86f29b4456dba024f24f29091e4" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.120512 32404 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.122282 27274 raft_consensus.cc:2955] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.123203 32409 leader_election.cc:290] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.125622 26473 leader_election.cc:304] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:54.126187 32455 raft_consensus.cc:493] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:54.127964 32196 raft_consensus.cc:493] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
W20260709 13:11:54.118414 32448 log.cc:927] Time spent T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:54.131985 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a158e3bdc954edd8dde2444100459ef" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.131317 27275 raft_consensus.cc:2955] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.133733 26659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.116866 25395 tablet_replica.cc:333] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.142113 32196 raft_consensus.cc:515] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:54.174976 32455 raft_consensus.cc:515] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.178627 32196 leader_election.cc:290] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.188975 32454 raft_consensus.cc:2749] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:54.190104 32437 log.cc:927] Time spent T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:54.210002 25395 raft_consensus.cc:2243] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.207967 26474 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.198091 32387 leader_election.cc:290] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.127444 32424 raft_consensus.cc:2955] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.237725 32409 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:54.238273 32407 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:11:54.244086 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 101866us
I20260709 13:11:54.250031 32409 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:54.250698 32407 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:54.253788 25395 raft_consensus.cc:2272] T 93a535a53cf0452f96a49f9aa849777a P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.256763 25395 tablet_replica.cc:333] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.259411 25395 raft_consensus.cc:2243] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.261656 25395 raft_consensus.cc:2272] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.267079 26580 raft_consensus.cc:2955] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
W20260709 13:11:54.279978 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 72132.2us
I20260709 13:11:54.287011 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.289001 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.216145 32455 leader_election.cc:290] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.292207 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.293181 32359 raft_consensus.cc:493] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:54.292851 26401 catalog_manager.cc:5697] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 8 to 9, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.293748 32359 raft_consensus.cc:515] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.294800 26401 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 12 to 13, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "b9c3761688a64982ae1c4aeb758e09ef" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.294958 32461 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:54.299394 32461 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.304406 32409 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.293215 26476 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.295861 32359 leader_election.cc:290] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.321547 32458 raft_consensus.cc:493] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:54.332453 32458 raft_consensus.cc:515] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:54.322049 32387 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:54.335502 32387 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:54.322646 32455 raft_consensus.cc:493] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:54.325925 32459 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:54.337538 32387 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.339205 32459 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.348237 32459 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.338858 32458 leader_election.cc:290] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.339365 32455 raft_consensus.cc:515] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.354586 32407 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.355074 32359 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:54.356271 26476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 63110.7us
I20260709 13:11:54.362092 32196 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:54.362922 32196 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.365846 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7a3ba69234d6417b968d15d31d856dbf with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:54.343676 32461 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.365366 26403 catalog_manager.cc:5697] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 reported cstate change: config changed from index 11 to 12, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 14 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.373713 32455 leader_election.cc:290] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.341611 32414 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:54.388813 32414 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:54.389421 32414 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: NON_VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: true } }
I20260709 13:11:54.402648 26657 raft_consensus.cc:2955] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.411509 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.414495 32196 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.416386 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b4ddf1aa104699a71886717f8e24b6" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.417061 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887e9161abf4ffe869e9d1cc636b7da" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.419456 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffd86793fb4eab863861f1047dec1e" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.421459 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.431717 25395 tablet_replica.cc:333] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
W20260709 13:11:54.432829 26473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 294211us
I20260709 13:11:54.455523 26473 leader_election.cc:304] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:54.443670 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b4bf10cd16491e8819a9dce5192276" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.458703 25395 raft_consensus.cc:2243] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.468053 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.471266 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.474558 26473 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.474371 25395 raft_consensus.cc:2272] T 731b96cedb5749df893a1de699717183 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.480518 26579 raft_consensus.cc:2955] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.485514 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.487922 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.489503 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa7e0062a14868b29dc1a9144f41c8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.490119 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b1aac0e4d18474e899d9c60448999fc" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.495724 32464 raft_consensus.cc:2749] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:54.500759 32404 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:11:54.501442 32404 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:54.503614 32404 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.504590 32460 raft_consensus.cc:493] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:54.505116 32460 raft_consensus.cc:515] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.506721 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e51f289426cf4543b1a962ba324beea3" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.507304 32460 leader_election.cc:290] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.508342 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.508929 32460 raft_consensus.cc:493] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:54.509578 32460 raft_consensus.cc:515] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.509932 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c46a2e31548b4665b067897f6ebe9bf9" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.511741 32460 leader_election.cc:290] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.512296 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fdbcbb3a7ce412c93c07413fe11793f" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.468495 32414 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.520092 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.520413 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.517246 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd8d698474498090aabe4448aa2a2b" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.525889 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.526882 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f94c193a504bc1b0601e54e3ec5f9a" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.514045 32460 raft_consensus.cc:493] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:54.527993 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b9da52e1c04100a4d56d1cfce9e2a2" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.529645 32460 raft_consensus.cc:515] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:54.530411 32462 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:54.532541 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.533243 26476 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.534286 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.535789 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.536358 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.536705 32414 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:54.537108 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71037b41f3ef4e33946b5099bf7adb3d" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.538074 32460 leader_election.cc:290] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:54.538549 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7672ae1d65b4497686627cb041189424" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.538707 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb26f1d881541f898a5a148f7f74144" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.540537 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108a6730154b42819badee4f37f31ad8" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.542985 25395 tablet_replica.cc:333] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.543859 25395 raft_consensus.cc:2243] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.543732 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3ba69234d6417b968d15d31d856dbf" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.544716 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.545200 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.545202 26474 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:11:54.557816 26474 raft_consensus.cc:2686] T 4887e9161abf4ffe869e9d1cc636b7da P b9c3761688a64982ae1c4aeb758e09ef: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:54.558774 25395 raft_consensus.cc:2272] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.559038 26474 leader_election.cc:304] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.561441 32414 raft_consensus.cc:2749] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:54.562538 26476 leader_election.cc:304] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.570665 32414 raft_consensus.cc:2749] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:54.565388 26473 raft_consensus.cc:687] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P b9c3761688a64982ae1c4aeb758e09ef: failed to submit failure detected task: Service unavailable: Thread pool token was shut down
I20260709 13:11:54.585963 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a5091904e646e8b76c8f9103e029b5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.588685 32414 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:11:54.589541 32455 raft_consensus.cc:493] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1f40e8672c549d3b4be7862ac07b7e2)
I20260709 13:11:54.589347 32414 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.590111 32455 raft_consensus.cc:515] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.591897 32414 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.592109 32455 leader_election.cc:290] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:54.594429 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b74cbdc379342d4832425ebe52bbac5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.595242 26474 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.595767 27275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78e2d37ffa144e9ae8e64979146f436" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.596439 26474 leader_election.cc:304] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.598351 32387 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:54.598410 32460 raft_consensus.cc:2749] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:54.601217 26474 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.601953 32462 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:54.603041 26474 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.603729 32462 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:54.612080 26473 leader_election.cc:304] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.613040 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:54.616549 26473 leader_election.cc:304] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.624455 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:54.626418 26473 leader_election.cc:304] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:54.629019 32462 raft_consensus.cc:2749] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:54.620316 32404 raft_consensus.cc:2749] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:54.631108 32464 raft_consensus.cc:2749] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:54.632443 26473 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:54.633203 32404 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:54.634366 26473 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.635144 32404 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:54.639041 26473 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.639722 32404 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:54.640601 26473 leader_election.cc:304] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.641376 32404 raft_consensus.cc:2749] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:54.642359 26473 leader_election.cc:304] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.645144 32462 raft_consensus.cc:2749] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:54.644778 25395 tablet_replica.cc:333] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
W20260709 13:11:54.655203 26474 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 50399.4us
I20260709 13:11:54.655324 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb5488a21bd418b96b52a8ab8a2e669" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.656091 26474 leader_election.cc:304] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:54.657486 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aaf3bb8d83488a81bc031ffda595a5" candidate_uuid: "b9c3761688a64982ae1c4aeb758e09ef" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:54.663793 26474 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.664283 26473 leader_election.cc:304] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.664561 25395 raft_consensus.cc:2243] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.666767 32455 raft_consensus.cc:2749] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:54.668180 26474 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.669855 32455 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:54.670528 32455 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:54.671348 26474 leader_election.cc:304] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:54.672143 32455 raft_consensus.cc:2749] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:54.674579 25395 raft_consensus.cc:2272] T 8f3c8f39cbe14359a810de00ced87a46 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.675467 26474 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9c3761688a64982ae1c4aeb758e09ef; no voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2
I20260709 13:11:54.677811 32464 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:54.700001 32455 raft_consensus.cc:2749] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:54.713056 25395 tablet_replica.cc:333] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.714010 25395 raft_consensus.cc:2243] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.725005 25395 raft_consensus.cc:2272] T 479f20ff71c04b8ea8eea5b4f8c922ff P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:54.747644 26392 catalog_manager.cc:4755] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7a3ba69234d6417b968d15d31d856dbf: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:11:54.768328 25395 tablet_replica.cc:333] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.769376 25395 raft_consensus.cc:2243] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.776093 26402 catalog_manager.cc:5697] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: config changed from index 9 to 10, b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } attrs { replace: true } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.781452 25395 raft_consensus.cc:2272] T 9b1aac0e4d18474e899d9c60448999fc P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.835961 25395 tablet_replica.cc:333] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.836943 25395 raft_consensus.cc:2243] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.838160 25395 raft_consensus.cc:2272] T b0f9b412be4742fc99eac55c24c89cf8 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.841748 25395 tablet_replica.cc:333] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.842742 25395 raft_consensus.cc:2243] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.843379 25395 raft_consensus.cc:2272] T 63f94c193a504bc1b0601e54e3ec5f9a P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.846293 25395 tablet_replica.cc:333] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.847162 25395 raft_consensus.cc:2243] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.847975 25395 raft_consensus.cc:2272] T b945492abb95467c8e66b0f6d8842bc7 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.851120 25395 tablet_replica.cc:333] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.851915 25395 raft_consensus.cc:2243] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.852584 25395 raft_consensus.cc:2272] T c46a2e31548b4665b067897f6ebe9bf9 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.858220 25395 tablet_replica.cc:333] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.861323 25395 raft_consensus.cc:2243] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.863958 25395 raft_consensus.cc:2272] T 057c1e97d7fb407aaf9cf119a0b63a37 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.866966 25395 tablet_replica.cc:333] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.867871 25395 raft_consensus.cc:2243] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.870679 26658 consensus_queue.cc:237] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:54.876266 25395 raft_consensus.cc:2272] T 7a3ba69234d6417b968d15d31d856dbf P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.879033 26580 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:54.879379 25395 tablet_replica.cc:333] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.880704 32412 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:54.882222 27277 raft_consensus.cc:1275] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:54.880421 25395 raft_consensus.cc:2243] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.883773 25395 raft_consensus.cc:2272] T 9b26ae30d0734e338bc81b8d9f963b67 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.886539 25395 tablet_replica.cc:333] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.887437 25395 raft_consensus.cc:2243] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.888073 25395 raft_consensus.cc:2272] T 23a5091904e646e8b76c8f9103e029b5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.890931 25395 tablet_replica.cc:333] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.891902 25395 raft_consensus.cc:2243] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.892517 25395 raft_consensus.cc:2272] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.896665 25395 tablet_replica.cc:333] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.897622 25395 raft_consensus.cc:2243] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.898690 25395 raft_consensus.cc:2272] T e29f1967e75645cbb7842e14e0404518 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.899720 32412 raft_consensus.cc:2955] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.901714 25395 tablet_replica.cc:333] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.902781 25395 raft_consensus.cc:2243] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.903523 25395 raft_consensus.cc:2272] T 941b69cce0d24bb9a4f60558447429c4 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.903630 26579 raft_consensus.cc:2955] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.906515 25395 tablet_replica.cc:333] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.907459 25395 raft_consensus.cc:2243] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.908178 25395 raft_consensus.cc:2272] T 5ce4b86f29b4456dba024f24f29091e4 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.910928 25395 tablet_replica.cc:333] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.911829 25395 raft_consensus.cc:2243] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.913173 25395 raft_consensus.cc:2272] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.928656 32424 consensus_queue.cc:1048] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:54.938123 26401 catalog_manager.cc:5697] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: config changed from index 10 to 11, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New cstate: current_term: 14 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.941671 25395 tablet_replica.cc:333] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.950433 27277 raft_consensus.cc:2955] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } } }
I20260709 13:11:54.958389 25395 raft_consensus.cc:2243] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.962030 25395 raft_consensus.cc:2272] T ffb5488a21bd418b96b52a8ab8a2e669 P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.965003 25395 tablet_replica.cc:333] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.971366 25395 raft_consensus.cc:2243] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.972517 25395 raft_consensus.cc:2272] T 274eefdb88c143849b4b07f0d6ffcdc0 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.984205 25395 tablet_replica.cc:333] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.991709 26393 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7672ae1d65b4497686627cb041189424 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:54.992563 25395 raft_consensus.cc:2243] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.993265 25395 raft_consensus.cc:2272] T 6cb26f1d881541f898a5a148f7f74144 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.996107 25395 tablet_replica.cc:333] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:54.996976 25395 raft_consensus.cc:2243] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.997702 25395 raft_consensus.cc:2272] T 71037b41f3ef4e33946b5099bf7adb3d P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.014724 25395 tablet_replica.cc:333] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.015556 25395 raft_consensus.cc:2243] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.016248 25395 raft_consensus.cc:2272] T b1b4bf10cd16491e8819a9dce5192276 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.018951 25395 tablet_replica.cc:333] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.019747 25395 raft_consensus.cc:2243] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.039047 25395 raft_consensus.cc:2272] T 66cd76ef163447878430c4633d13a427 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.041831 25395 tablet_replica.cc:333] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.042639 25395 raft_consensus.cc:2243] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.043473 25395 raft_consensus.cc:2272] T 2a158e3bdc954edd8dde2444100459ef P b9c3761688a64982ae1c4aeb758e09ef [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.066337 25395 tablet_replica.cc:333] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.067144 25395 raft_consensus.cc:2243] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.067767 25395 raft_consensus.cc:2272] T ebe9b36ae60941888203dd2967005c27 P b9c3761688a64982ae1c4aeb758e09ef [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.070602 25395 tablet_replica.cc:333] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.071542 25395 raft_consensus.cc:2243] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.072273 25395 raft_consensus.cc:2272] T 20b4ddf1aa104699a71886717f8e24b6 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.075042 25395 tablet_replica.cc:333] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.075753 25395 raft_consensus.cc:2243] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.076391 25395 raft_consensus.cc:2272] T a78e2d37ffa144e9ae8e64979146f436 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.099099 25395 tablet_replica.cc:333] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.102380 25395 raft_consensus.cc:2243] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.103070 25395 raft_consensus.cc:2272] T 6daa7e0062a14868b29dc1a9144f41c8 P b9c3761688a64982ae1c4aeb758e09ef [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.109843 25395 tablet_replica.cc:333] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.110602 25395 raft_consensus.cc:2243] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.111557 25395 raft_consensus.cc:2272] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.114391 25395 tablet_replica.cc:333] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.115152 25395 raft_consensus.cc:2243] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.115845 25395 raft_consensus.cc:2272] T 7672ae1d65b4497686627cb041189424 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.138487 25395 tablet_replica.cc:333] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.139417 25395 raft_consensus.cc:2243] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.140345 25395 raft_consensus.cc:2272] T a7aaf3bb8d83488a81bc031ffda595a5 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.148413 25395 tablet_replica.cc:333] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.149187 25395 raft_consensus.cc:2243] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.165923 25395 raft_consensus.cc:2272] T 54cd8d698474498090aabe4448aa2a2b P b9c3761688a64982ae1c4aeb758e09ef [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.168560 25395 tablet_replica.cc:333] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.169394 25395 raft_consensus.cc:2243] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.170178 25395 raft_consensus.cc:2272] T 30ffd86793fb4eab863861f1047dec1e P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.172770 25395 tablet_replica.cc:333] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.173473 25395 raft_consensus.cc:2243] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.186681 25395 raft_consensus.cc:2272] T e14f699cfba34b90b5f92484e9fd0ddc P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.189495 25395 tablet_replica.cc:333] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.190254 25395 raft_consensus.cc:2243] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.191349 25395 raft_consensus.cc:2272] T 4b57a114025342d2bdfb15a7bb13db93 P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.197665 25395 tablet_replica.cc:333] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.198443 25395 raft_consensus.cc:2243] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.202617 25395 raft_consensus.cc:2272] T 108a6730154b42819badee4f37f31ad8 P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.266914 25395 tablet_replica.cc:333] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.279161 25395 raft_consensus.cc:2243] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.283632 25395 raft_consensus.cc:2272] T 574d2707e806420dab53495563bd03aa P b9c3761688a64982ae1c4aeb758e09ef [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.286513 25395 tablet_replica.cc:333] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.310364 25395 raft_consensus.cc:2243] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.311501 25395 raft_consensus.cc:2272] T f79cbcb2b1924d9c9e584d9a32e92bfa P b9c3761688a64982ae1c4aeb758e09ef [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.320327 25395 tablet_replica.cc:333] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.321094 25395 raft_consensus.cc:2243] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.332857 25395 raft_consensus.cc:2272] T 9b74cbdc379342d4832425ebe52bbac5 P b9c3761688a64982ae1c4aeb758e09ef [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.341676 25395 tablet_replica.cc:333] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.342667 25395 raft_consensus.cc:2243] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.343600 25395 raft_consensus.cc:2272] T e51f289426cf4543b1a962ba324beea3 P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.346765 25395 tablet_replica.cc:333] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.355302 25395 raft_consensus.cc:2243] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.356206 25395 raft_consensus.cc:2272] T 41780cfc14f24065b0d12741153c5b15 P b9c3761688a64982ae1c4aeb758e09ef [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.359195 25395 tablet_replica.cc:333] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef: stopping tablet replica
I20260709 13:11:55.359980 25395 raft_consensus.cc:2243] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.360672 25395 raft_consensus.cc:2272] T 7fdbcbb3a7ce412c93c07413fe11793f P b9c3761688a64982ae1c4aeb758e09ef [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:55.405436 26548 consensus_peers.cc:597] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:55.426716 32447 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:55.427332 32447 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:55.429921 32447 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:55.431834 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:11:55.434863 26548 leader_election.cc:336] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.435349 26548 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:55.436242 32447 raft_consensus.cc:2749] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:55.482962 26622 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:55.554594 32434 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:55.555241 32434 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:55.566504 26548 consensus_peers.cc:597] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:55.571996 32434 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:55.574007 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
W20260709 13:11:55.598825 27240 leader_election.cc:336] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.599503 27240 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:55.601112 32472 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:55.670590 26548 consensus_peers.cc:597] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.675885 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.691185 26622 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.697815 26548 consensus_peers.cc:597] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.702045 26622 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.781699 26622 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.837946 27240 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.846521 27240 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.850648 26548 consensus_peers.cc:597] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.851444 26548 consensus_peers.cc:597] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.851902 26548 consensus_peers.cc:597] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.878512 27240 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.879263 27240 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.902001 26392 catalog_manager.cc:4755] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7672ae1d65b4497686627cb041189424: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:55.919606 26622 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.939546 26548 consensus_peers.cc:597] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:55.991662 32472 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:55.992337 32472 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:55.995723 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:55.996416 26580 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 18.
I20260709 13:11:56.001261 27243 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.004070 32463 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:56.004566 32463 raft_consensus.cc:493] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.004961 32463 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:56.030128 26622 consensus_peers.cc:597] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.034825 27240 leader_election.cc:336] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.036893 32477 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.037753 32477 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.044523 32420 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.045235 32420 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.052109 32412 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.052763 32412 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.054950 32412 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:56.055790 32472 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:56.066982 26548 leader_election.cc:336] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.083773 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:56.085207 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:56.086787 32420 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:56.098935 32483 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.099735 32483 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.102097 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.103382 32483 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.104372 26549 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.114516 32478 raft_consensus.cc:2749] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:56.100127 32477 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.121965 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.122694 26657 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:56.127828 27241 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:56.128726 32483 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:56.129135 32483 raft_consensus.cc:493] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.129491 32483 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.133947 32477 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.134642 32477 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.137147 32477 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:56.138720 32484 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.141350 32484 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.144690 32484 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.147526 32483 raft_consensus.cc:515] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.154615 32483 leader_election.cc:290] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.163335 32483 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.163936 32483 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.166193 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479f20ff71c04b8ea8eea5b4f8c922ff" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:56.166563 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.166761 26652 raft_consensus.cc:3060] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.167251 32483 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.173830 26657 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:56.178805 26652 raft_consensus.cc:2468] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:11:56.182233 32478 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.182745 27241 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:56.182785 32478 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.184064 27241 leader_election.cc:304] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:56.185143 32478 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.184909 32434 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:56.185727 32483 raft_consensus.cc:2804] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:56.186254 32483 raft_consensus.cc:697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
W20260709 13:11:56.186906 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 46739.3us
I20260709 13:11:56.187215 32483 consensus_queue.cc:237] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.185753 32434 raft_consensus.cc:493] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.193616 32434 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.196491 32463 raft_consensus.cc:515] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.199364 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.215476 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.208927 32434 raft_consensus.cc:515] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.223877 32434 leader_election.cc:290] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:56.225721 26548 leader_election.cc:336] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.236030 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f3c8f39cbe14359a810de00ced87a46" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:56.236835 26652 raft_consensus.cc:3060] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.241751 32477 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.242519 32477 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.245985 32477 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.268802 32463 leader_election.cc:290] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 19 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:56.249333 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 168538us
I20260709 13:11:56.276979 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:56.301679 27274 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 10.
I20260709 13:11:56.312541 32480 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.313230 32480 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.316359 32480 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:56.278963 27240 leader_election.cc:336] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.286201 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "731b96cedb5749df893a1de699717183" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:56.317553 26580 raft_consensus.cc:3060] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:56.318001 27240 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.318571 27240 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.325006 26580 raft_consensus.cc:2468] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 19.
I20260709 13:11:56.325601 32477 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.326236 32477 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.299293 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.316819 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:56.326445 27243 leader_election.cc:304] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.327353 26579 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 17.
I20260709 13:11:56.327647 32463 raft_consensus.cc:2804] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:56.328604 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.330148 32463 raft_consensus.cc:697] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 19 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:56.330816 32480 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:56.331287 32480 raft_consensus.cc:493] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.331152 32463 consensus_queue.cc:237] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.332139 32480 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:56.292749 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 64768us
I20260709 13:11:56.346385 32447 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.347015 32447 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.354295 32486 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.354908 32486 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.358546 32447 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:56.359275 32477 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.357095 32486 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:56.375782 26548 consensus_peers.cc:597] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.376283 26548 leader_election.cc:336] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.379101 32479 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.379184 26548 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.379879 32479 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.382475 32479 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:56.383471 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:56.391038 26652 raft_consensus.cc:2468] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
W20260709 13:11:56.383421 27240 leader_election.cc:336] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:56.393707 27240 leader_election.cc:336] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:56.394582 27240 leader_election.cc:336] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.395063 27240 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.396641 32479 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:56.398964 32484 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.399230 32478 raft_consensus.cc:2749] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:56.399494 32484 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.404915 32484 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.399328 26401 catalog_manager.cc:5697] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 14 to 15, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 15 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.405774 32484 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.406383 32484 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.413003 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.413664 26657 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 16.
I20260709 13:11:56.414913 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.415159 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:56.415514 26657 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 14.
I20260709 13:11:56.415894 26580 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 16.
I20260709 13:11:56.418365 32484 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.419662 27241 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:56.421519 26549 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.423588 32477 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:56.423974 32477 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.424325 32477 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.422243 32483 raft_consensus.cc:2804] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:56.425469 32483 raft_consensus.cc:697] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:56.357007 32480 raft_consensus.cc:515] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.426429 32483 consensus_queue.cc:237] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.428081 32480 leader_election.cc:290] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:56.429026 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b26ae30d0734e338bc81b8d9f963b67" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:56.429618 26580 raft_consensus.cc:3060] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:56.433176 26548 leader_election.cc:336] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.433719 26548 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:56.434723 26548 consensus_peers.cc:597] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.436564 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.437395 26657 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:56.437887 32447 raft_consensus.cc:2749] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:56.440882 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.441484 26580 raft_consensus.cc:2468] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 18.
I20260709 13:11:56.441653 26657 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 16.
I20260709 13:11:56.445497 26625 leader_election.cc:304] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.446285 32487 raft_consensus.cc:2804] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:56.446883 32487 raft_consensus.cc:697] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 18 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
W20260709 13:11:56.447443 27240 leader_election.cc:336] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:56.448184 27240 leader_election.cc:336] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.447824 32487 consensus_queue.cc:237] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:56.448838 27240 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.449934 27241 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:56.450776 32479 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:56.450863 27241 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.451246 32479 raft_consensus.cc:493] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.451645 32479 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:56.454190 32463 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:56.454623 32463 raft_consensus.cc:493] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.454993 32463 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.441540 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.461145 32447 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:56.461598 32447 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.441705 32477 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.462073 32447 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:56.463083 26622 leader_election.cc:336] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.463955 32477 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:56.449235 27240 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.466151 27240 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.470044 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29f1967e75645cbb7842e14e0404518" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:56.470880 26652 raft_consensus.cc:3060] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.465154 26622 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
W20260709 13:11:56.476598 26622 leader_election.cc:336] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.477200 26622 leader_election.cc:304] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.491072 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:56.496340 26652 raft_consensus.cc:2468] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 15.
I20260709 13:11:56.465682 32479 raft_consensus.cc:515] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.502416 32479 leader_election.cc:290] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.502534 32463 raft_consensus.cc:515] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.506330 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:56.506928 26580 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.510727 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f9b412be4742fc99eac55c24c89cf8" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
W20260709 13:11:56.511343 27240 leader_election.cc:336] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.514078 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:56.517218 27274 raft_consensus.cc:2393] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 17: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:56.483017 32480 raft_consensus.cc:2749] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:56.491192 32482 raft_consensus.cc:2749] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:56.524355 26548 leader_election.cc:336] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:56.525381 26548 leader_election.cc:336] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.523509 32412 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.531179 26580 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 17.
I20260709 13:11:56.531271 26657 raft_consensus.cc:3060] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:56.533545 26549 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.537976 26657 raft_consensus.cc:2468] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:56.538606 32477 raft_consensus.cc:2804] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:56.539129 32477 raft_consensus.cc:697] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 15 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:56.539937 32477 consensus_queue.cc:237] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:11:56.542423 27240 leader_election.cc:336] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:56.543414 27240 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.544071 27240 leader_election.cc:336] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:56.544471 27240 leader_election.cc:336] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:56.544898 27240 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.545362 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:56.546854 32479 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:56.555119 27241 leader_election.cc:304] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.530800 32412 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.556257 32484 raft_consensus.cc:2804] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:56.556818 32484 raft_consensus.cc:697] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:56.557893 32412 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:56.559092 32484 consensus_queue.cc:237] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.559899 32481 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.560442 32481 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.564150 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a72cbe5dad8844a08aa3bf83d8f3ad27" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:56.564724 26657 raft_consensus.cc:3060] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.570619 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:56.571326 26657 raft_consensus.cc:2468] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 17.
I20260709 13:11:56.571440 26579 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 16.
I20260709 13:11:56.572398 27241 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.562476 32481 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:56.574249 32434 raft_consensus.cc:2804] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:56.570302 26548 leader_election.cc:304] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.576972 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:56.577898 26579 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:56.579659 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:56.585269 26548 consensus_peers.cc:597] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.585902 26548 leader_election.cc:336] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.588056 26625 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.566395 32463 leader_election.cc:290] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.596992 32478 raft_consensus.cc:2749] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:56.614709 26549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 49642.4us
I20260709 13:11:56.589135 32480 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:56.590979 32434 raft_consensus.cc:697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:56.593470 32481 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:56.646452 32447 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.648998 32447 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:56.622619 32480 raft_consensus.cc:493] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.657896 32480 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.662881 32434 consensus_queue.cc:237] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:56.665091 27240 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.636883 32481 raft_consensus.cc:493] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.666074 32481 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:56.673972 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 87121.3us
W20260709 13:11:56.677261 26622 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.675834 32477 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.683511 32477 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.694237 32477 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:56.710112 32480 raft_consensus.cc:515] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.712172 32481 raft_consensus.cc:515] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.713107 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274eefdb88c143849b4b07f0d6ffcdc0" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:56.725765 32463 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.725942 26580 raft_consensus.cc:3060] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.726377 32463 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.728072 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057c1e97d7fb407aaf9cf119a0b63a37" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:56.728648 27270 raft_consensus.cc:3060] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:56.729797 26403 catalog_manager.cc:5697] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 17 to 18, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 18 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.730436 32480 leader_election.cc:290] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:11:56.732776 32463 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:11:56.733135 26548 leader_election.cc:336] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.746778 32481 leader_election.cc:290] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:11:56.762868 26548 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.766889 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:56.767603 27271 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 16.
I20260709 13:11:56.783499 32482 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:11:56.783764 27240 leader_election.cc:336] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.784118 32482 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.786497 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.742352 26657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:11:56.787371 26657 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:56.744946 27270 raft_consensus.cc:2468] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 11.
W20260709 13:11:56.746107 25395 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 26531)
I20260709 13:11:56.735690 26402 catalog_manager.cc:5697] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 14 to 15, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 15 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.786783 32482 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:56.789014 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 64965.7us
I20260709 13:11:56.789151 27241 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.790766 32434 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:56.791287 32434 raft_consensus.cc:493] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.791500 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f699cfba34b90b5f92484e9fd0ddc" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:56.791783 32434 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.792133 26579 raft_consensus.cc:3060] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:56.799836 32495 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:56.802270 26657 raft_consensus.cc:1275] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:56.802484 32495 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.802942 32495 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.803787 26579 raft_consensus.cc:2468] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:56.805155 26625 leader_election.cc:304] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.805068 32463 consensus_queue.cc:1048] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:56.809959 32481 raft_consensus.cc:2804] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:56.810477 32481 raft_consensus.cc:697] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:56.736727 26580 raft_consensus.cc:2468] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 17.
I20260709 13:11:56.811599 32481 consensus_queue.cc:237] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.812034 26548 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.813743 32494 raft_consensus.cc:2804] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:56.814313 32494 raft_consensus.cc:697] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:56.818253 26625 leader_election.cc:304] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7; no voters: 
W20260709 13:11:56.819748 27240 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.822384 32420 raft_consensus.cc:2804] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:56.823910 32420 raft_consensus.cc:697] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 17 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:56.825111 32420 consensus_queue.cc:237] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:11:56.827374 32495 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.824764 32494 consensus_queue.cc:237] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:56.832388 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 48851.2us
W20260709 13:11:56.854534 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.854992 26622 leader_election.cc:336] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:56.855811 26622 leader_election.cc:336] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.856391 32483 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.856681 26622 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.857081 32483 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.858837 32499 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.859484 32499 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.864459 32499 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:56.866173 27240 leader_election.cc:336] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.867174 32483 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:56.869611 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:56.870450 27270 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 12.
I20260709 13:11:56.873759 26403 catalog_manager.cc:5697] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 12 to 13, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 13 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.875694 26403 catalog_manager.cc:5697] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 18 to 19, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 19 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.877784 32495 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:56.877328 26403 catalog_manager.cc:5697] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 14 to 15, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 15 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.884822 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.885094 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b57a114025342d2bdfb15a7bb13db93" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:56.885704 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:56.886298 26652 raft_consensus.cc:1275] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:56.886435 26579 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:11:56.885751 27270 raft_consensus.cc:3060] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.900027 26579 raft_consensus.cc:1275] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 19 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:56.898550 32483 consensus_queue.cc:1048] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:11:56.897533 27270 raft_consensus.cc:2468] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef2886777a8f45e69e213b02a22ecec7 in term 17.
I20260709 13:11:56.903424 27243 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:56.904248 32483 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:56.904706 32483 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:56.904776 32506 raft_consensus.cc:2749] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:56.905157 32483 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:56.904325 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 48532.5us
W20260709 13:11:56.906144 26622 consensus_peers.cc:597] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.907096 32494 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:56.907536 32494 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
W20260709 13:11:56.907600 26622 leader_election.cc:336] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:56.907980 26548 leader_election.cc:336] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.907989 32494 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:56.884579 26403 catalog_manager.cc:5697] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 16 to 17, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 17 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.913938 32434 raft_consensus.cc:515] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:56.915951 26580 raft_consensus.cc:1275] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:56.916226 32434 leader_election.cc:290] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:11:56.920308 26548 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:56.921921 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79cbcb2b1924d9c9e584d9a32e92bfa" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:11:56.922536 26652 raft_consensus.cc:3060] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.930274 26402 catalog_manager.cc:5697] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 10 to 11, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 11 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.925635 32495 raft_consensus.cc:2804] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:56.940815 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:11:56.941601 27270 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
I20260709 13:11:56.925899 32506 consensus_queue.cc:1048] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:11:56.946702 26652 raft_consensus.cc:2468] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:11:56.949934 27241 leader_election.cc:304] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:56.925681 32463 consensus_queue.cc:1048] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:11:56.953531 32494 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:56.961544 26548 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.975126 32494 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:11:56.968832 27240 leader_election.cc:336] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:56.976450 32484 raft_consensus.cc:2804] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:56.977483 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "ef2886777a8f45e69e213b02a22ecec7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:56.972702 32483 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:57.002540 26622 leader_election.cc:336] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:57.003484 26622 leader_election.cc:336] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:57.012692 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:11:57.020501 32483 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
I20260709 13:11:57.021342 27274 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef2886777a8f45e69e213b02a22ecec7 in current term 13: Already voted for candidate b1f40e8672c549d3b4be7862ac07b7e2 in this term.
I20260709 13:11:57.021206 26579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:57.021978 26579 raft_consensus.cc:2393] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f40e8672c549d3b4be7862ac07b7e2 in current term 13: Already voted for candidate ef2886777a8f45e69e213b02a22ecec7 in this term.
I20260709 13:11:56.949294 32495 raft_consensus.cc:697] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 17 LEADER]: Becoming Leader. State: Replica: ef2886777a8f45e69e213b02a22ecec7, State: Running, Role: LEADER
I20260709 13:11:57.027568 32481 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:57.044793 32481 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b9c3761688a64982ae1c4aeb758e09ef)
I20260709 13:11:57.045269 32481 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:57.047358 26548 consensus_peers.cc:597] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.047991 26548 leader_election.cc:336] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:57.050529 32495 consensus_queue.cc:237] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:57.062036 26548 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef2886777a8f45e69e213b02a22ecec7; no voters: b1f40e8672c549d3b4be7862ac07b7e2, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:57.063573 32477 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:11:57.073421 26622 leader_election.cc:336] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:57.060043 32484 raft_consensus.cc:697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:57.095498 32484 consensus_queue.cc:237] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:57.097041 26622 leader_election.cc:336] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:57.097941 26622 leader_election.cc:336] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:57.100322 27240 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.100929 27240 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.101672 27240 leader_election.cc:336] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:57.102108 27240 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:11:57.083261 32481 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:57.105119 32479 raft_consensus.cc:2749] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:57.114261 32481 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:11:57.164232 26401 catalog_manager.cc:5697] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 12 to 13, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 13 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:57.172905 26622 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.210980 27274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cd76ef163447878430c4633d13a427" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:11:57.212955 27274 raft_consensus.cc:3060] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:57.233536 26658 raft_consensus.cc:1275] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:57.233887 26657 raft_consensus.cc:1275] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:57.238372 26584 raft_consensus.cc:1275] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:57.241698 26657 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:57.248261 26584 raft_consensus.cc:1275] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:57.249994 26401 catalog_manager.cc:5697] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 16 to 17, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 17 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.252449 32483 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:57.254005 32479 consensus_queue.cc:1048] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:57.257894 32477 consensus_queue.cc:1048] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:57.259516 32516 consensus_queue.cc:1048] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:11:57.260900 26622 leader_election.cc:336] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:57.300698 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 67200.6us
I20260709 13:11:57.317143 27274 raft_consensus.cc:2468] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
I20260709 13:11:57.337010 32487 consensus_queue.cc:1048] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:57.378509 26401 catalog_manager.cc:5697] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 14 to 15, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 15 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:57.386572 27240 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.462951 26584 raft_consensus.cc:1275] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:57.473320 27275 raft_consensus.cc:1275] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:57.477811 32480 consensus_queue.cc:1048] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:57.485884 26622 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:57.515934 32481 raft_consensus.cc:2804] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:57.516842 32481 raft_consensus.cc:697] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:11:57.521363 32481 consensus_queue.cc:237] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:57.531515 32494 consensus_queue.cc:1048] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:11:57.553678 26392 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 122302us
W20260709 13:11:57.557081 26392 catalog_manager.cc:4755] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7a3ba69234d6417b968d15d31d856dbf: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:11:57.568117 26548 consensus_peers.cc:597] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.579150 27274 raft_consensus.cc:1275] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Refusing update from remote peer ef2886777a8f45e69e213b02a22ecec7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:11:57.601979 26622 consensus_peers.cc:597] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.611720 26401 catalog_manager.cc:5697] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 reported cstate change: term changed from 16 to 17, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194). New cstate: current_term: 17 leader_uuid: "ef2886777a8f45e69e213b02a22ecec7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.613912 32447 consensus_queue.cc:1048] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:57.642815 26657 raft_consensus.cc:1275] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:11:57.645694 26622 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.645900 26548 consensus_peers.cc:597] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.663599 32434 consensus_queue.cc:1048] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:57.700839 26403 catalog_manager.cc:5697] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 12 to 13, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 13 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:57.751109 27240 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.789103 25395 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 26531)
W20260709 13:11:57.860507 26548 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111) [suppressed 366 similar messages]
W20260709 13:11:57.867091 26548 consensus_peers.cc:597] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:57.968303 27270 raft_consensus.cc:1275] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:57.970307 32481 consensus_queue.cc:1048] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:11:58.000200 26622 consensus_peers.cc:597] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:58.047411 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.058936 26548 consensus_peers.cc:597] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.175359 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 55157.5us
W20260709 13:11:58.179690 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 58974.3us
W20260709 13:11:58.187078 27240 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.188172 26622 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.210572 26548 consensus_peers.cc:597] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.220522 26548 consensus_peers.cc:597] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.221002 26548 consensus_peers.cc:597] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.314697 26548 consensus_peers.cc:597] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.362185 27240 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.407421 26622 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.412665 26548 consensus_peers.cc:597] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.417660 27240 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.495639 26548 consensus_peers.cc:597] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.568436 26622 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.583191 27240 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.636632 27240 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.677436 27240 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.736842 26548 consensus_peers.cc:597] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.781082 26622 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.790010 25395 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 26531)
W20260709 13:11:58.796696 27240 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.805514 26548 consensus_peers.cc:597] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.828516 26622 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.943725 27240 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.970232 26548 consensus_peers.cc:597] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.971311 27240 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.966601 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.986135 27240 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:59.033079 26622 consensus_peers.cc:597] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:59.097846 26622 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:59.099893 27240 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:59.157531 26622 consensus_peers.cc:597] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:59.193401 32545 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.193961 32545 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:59.197956 26580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7" is_pre_election: true
I20260709 13:11:59.198606 26580 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:11:59.200040 27243 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: 
I20260709 13:11:59.200922 32541 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:59.201310 32541 raft_consensus.cc:493] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.201632 32541 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:59.233786 32545 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
W20260709 13:11:59.236917 27240 leader_election.cc:336] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:59.253278 32541 raft_consensus.cc:515] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:11:59.276461 32541 leader_election.cc:290] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907)
W20260709 13:11:59.283429 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 63988us
I20260709 13:11:59.287273 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41780cfc14f24065b0d12741153c5b15" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef2886777a8f45e69e213b02a22ecec7"
I20260709 13:11:59.287923 26585 raft_consensus.cc:3060] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:59.291903 27240 leader_election.cc:336] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:59.301501 26585 raft_consensus.cc:2468] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:11:59.315600 27243 leader_election.cc:304] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7; no voters: b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:11:59.322583 32546 raft_consensus.cc:2804] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:59.324611 32546 raft_consensus.cc:697] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:11:59.325664 32546 consensus_queue.cc:237] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:11:59.330817 27240 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:59.367358 26403 catalog_manager.cc:5697] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 12 to 14, leader changed from b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 14 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:59.452361 27240 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:59.640959 26548 consensus_peers.cc:597] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:59.709754 26392 catalog_manager.cc:4755] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7a3ba69234d6417b968d15d31d856dbf: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:11:59.739113 26585 raft_consensus.cc:1275] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:59.740927 32540 consensus_queue.cc:1048] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:11:59.790834 25395 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 26531)
W20260709 13:11:59.813767 26622 consensus_peers.cc:597] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:59.839913 27240 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:59.843919 27240 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.903118 26548 consensus_peers.cc:597] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:59.963377 27240 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:59.998567 26622 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:00.018960 26622 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:00.086370 26548 consensus_peers.cc:597] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:00.125242 27240 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:00.392175 26548 consensus_peers.cc:597] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:00.401602 26548 consensus_peers.cc:597] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:00.566915 26622 consensus_peers.cc:597] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:00.583005 26548 consensus_peers.cc:597] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:00.584838 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:00.660709 26548 consensus_peers.cc:597] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:00.702096 26548 consensus_peers.cc:597] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:00.710256 27240 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:00.763669 26622 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:00.779209 27240 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:00.791364 25395 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 26531)
W20260709 13:12:00.917665 26548 consensus_peers.cc:597] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:00.971469 27240 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.012274 26548 consensus_peers.cc:597] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.063009 26548 consensus_peers.cc:597] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.260737 26548 consensus_peers.cc:597] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.314931 26548 consensus_peers.cc:597] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.317442 26548 consensus_peers.cc:597] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.360354 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 251866us
W20260709 13:12:01.406013 26622 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.407001 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.407522 26622 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.437742 26622 consensus_peers.cc:597] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.506880 27240 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.506316 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 47463.5us
W20260709 13:12:01.517729 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 52918.5us
W20260709 13:12:01.535195 26622 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.560084 26622 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.569657 26622 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.604809 27240 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.669466 27240 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.711078 27240 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.717123 27240 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:01.791862 25395 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 26531)
W20260709 13:12:01.899472 26622 consensus_peers.cc:597] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.898166 27240 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.903918 27240 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:01.947387 27240 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:01.971072 27240 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:02.002912 27240 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.211655 26548 consensus_peers.cc:597] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.283449 26622 consensus_peers.cc:597] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.356756 27299 debug-util.cc:398] Leaking SignalData structure 0x7b08003331c0 after lost signal to thread 25398
W20260709 13:12:02.358106 27299 debug-util.cc:398] Leaking SignalData structure 0x7b080026d040 after lost signal to thread 26442
W20260709 13:12:02.359695 27299 debug-util.cc:398] Leaking SignalData structure 0x7b080025bbe0 after lost signal to thread 26609
W20260709 13:12:02.361025 27299 debug-util.cc:398] Leaking SignalData structure 0x7b080025ce40 after lost signal to thread 26683
W20260709 13:12:02.381834 27299 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7360 after lost signal to thread 27302
W20260709 13:12:02.387374 26622 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.422777 27240 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.524660 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 109357us
W20260709 13:12:02.573083 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 137911us
W20260709 13:12:02.574846 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 49133.4us
W20260709 13:12:02.642794 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 52778.8us
W20260709 13:12:02.670521 26622 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.731269 27240 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:02.766305 26548 consensus_peers.cc:597] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.792342 25395 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 26531)
W20260709 13:12:02.857266 27240 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.861799 26622 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111) [suppressed 431 similar messages]
W20260709 13:12:02.881785 26548 consensus_peers.cc:597] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.888549 26548 consensus_peers.cc:597] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.016157 26548 consensus_peers.cc:597] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.056046 26548 consensus_peers.cc:597] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.067265 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.148902 27240 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.173243 27240 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:03.260190 26548 consensus_peers.cc:597] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.299588 26622 consensus_peers.cc:597] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:03.313242 26548 consensus_peers.cc:597] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.352300 26622 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.455343 27240 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.480512 26548 consensus_peers.cc:597] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.503285 26548 consensus_peers.cc:597] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.553187 26548 consensus_peers.cc:597] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.688530 27240 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.732981 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.737659 26622 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.755308 26548 consensus_peers.cc:597] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:03.792834 25395 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 26531)
W20260709 13:12:03.857456 26392 catalog_manager.cc:4755] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7a3ba69234d6417b968d15d31d856dbf: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:12:03.879179 26548 consensus_peers.cc:597] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.012880 26548 consensus_peers.cc:597] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.064086 27240 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.082638 26622 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.089424 27240 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.097936 26622 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.138134 27240 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.154917 27240 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:04.196993 26622 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.210752 27240 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.224495 26622 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.276278 26622 consensus_peers.cc:597] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.307933 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 51788us
W20260709 13:12:04.314328 27240 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:04.499629 27240 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:04.535481 27240 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.591261 27240 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:04.698403 26622 consensus_peers.cc:597] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.793406 25395 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 26531)
W20260709 13:12:04.801553 27240 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.817811 27240 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.890575 26622 consensus_peers.cc:597] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:04.912962 26548 consensus_peers.cc:597] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.017086 27240 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:05.022841 26622 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.269358 27240 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.306139 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:05.319239 26548 consensus_peers.cc:597] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.345105 26622 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.467511 26548 consensus_peers.cc:597] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.560453 26548 consensus_peers.cc:597] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:05.631042 27240 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.642186 26548 consensus_peers.cc:597] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:05.652590 26548 consensus_peers.cc:597] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:05.684417 26548 consensus_peers.cc:597] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:05.701180 26622 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:05.793902 25395 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 26531)
W20260709 13:12:05.807147 26548 consensus_peers.cc:597] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:05.889869 27240 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.032429 26548 consensus_peers.cc:597] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.076669 26622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:45899, user_credentials={real_user=slave}} blocked reactor thread for 214426us
W20260709 13:12:06.106168 26548 consensus_peers.cc:597] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.149950 26548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 43849.4us
W20260709 13:12:06.157531 27240 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.218083 26622 consensus_peers.cc:597] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:06.222167 26548 consensus_peers.cc:597] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.252274 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 44681.9us
W20260709 13:12:06.301663 26548 consensus_peers.cc:597] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.307163 27240 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.325747 26622 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.352275 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.426301 27240 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:06.436431 26548 consensus_peers.cc:597] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.609349 26622 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.624889 27240 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.629175 26622 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.629926 26622 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.649960 27240 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.719154 26548 consensus_peers.cc:597] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.758785 27240 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.794123 27240 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.794368 25395 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 26531)
W20260709 13:12:06.841812 26622 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:06.925825 27240 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:06.948597 26622 consensus_peers.cc:597] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:07.031984 27240 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:07.063488 27240 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:07.250909 26622 consensus_peers.cc:597] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:07.261327 26622 consensus_peers.cc:597] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:07.327602 27240 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:07.362255 27240 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:07.486922 27240 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:07.511585 26622 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:07.595620 27240 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:07.668507 26548 consensus_peers.cc:597] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:07.737035 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:07.795348 25395 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 26531)
W20260709 13:12:07.810674 26548 consensus_peers.cc:597] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:07.875700 27240 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111) [suppressed 437 similar messages]
W20260709 13:12:07.880400 27240 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:07.934784 26548 consensus_peers.cc:597] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:07.980082 26548 consensus_peers.cc:597] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.077483 26548 consensus_peers.cc:597] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:08.207734 26548 consensus_peers.cc:597] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.285262 27240 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.302856 26622 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.327239 26548 consensus_peers.cc:597] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.335207 26622 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:08.348657 26548 consensus_peers.cc:597] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.407827 27240 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:08.603997 26548 consensus_peers.cc:597] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.611894 27240 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.641690 26622 consensus_peers.cc:597] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:08.730437 26622 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.738994 26548 consensus_peers.cc:597] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.771413 26548 consensus_peers.cc:597] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.795905 25395 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 26531)
W20260709 13:12:08.859014 26548 consensus_peers.cc:597] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:08.870487 27240 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.006258 27240 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:09.044222 27240 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.146989 27240 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.151857 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.163254 26622 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.168212 27240 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.170583 27240 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.207391 26548 consensus_peers.cc:597] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.252909 26622 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.344830 26622 consensus_peers.cc:597] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.362309 26622 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.482434 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 104242us
W20260709 13:12:09.492779 26548 consensus_peers.cc:597] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.496958 26622 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.517958 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 59248.4us
W20260709 13:12:09.654975 27240 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:09.692899 27240 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.752969 26622 consensus_peers.cc:597] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.819594 27240 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:09.869755 27240 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:09.952548 27240 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:10.019573 26548 consensus_peers.cc:597] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:10.020994 26622 consensus_peers.cc:597] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:10.032179 27240 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:10.037074 27240 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:10.186829 27240 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:10.250990 26548 consensus_peers.cc:597] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:10.244837 26622 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:10.339890 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:10.423781 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 72935.3us
W20260709 13:12:10.533964 26548 consensus_peers.cc:597] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:10.588018 26548 consensus_peers.cc:597] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:10.701995 26548 consensus_peers.cc:597] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:10.734274 26622 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:10.757808 26548 consensus_peers.cc:597] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:10.801019 27240 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:10.882655 25395 tablet_server.cc:196] TabletServer@127.24.204.193:0 shutdown complete.
W20260709 13:12:10.955163 26622 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.024691 27240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:37907, user_credentials={real_user=slave}} blocked reactor thread for 68209.8us
W20260709 13:12:11.089844 26548 consensus_peers.cc:597] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.098778 26548 consensus_peers.cc:597] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.102736 27241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:34711, user_credentials={real_user=slave}} blocked reactor thread for 71847.3us
W20260709 13:12:11.125092 27243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 92040.1us
W20260709 13:12:11.217525 27240 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:11.233923 26548 consensus_peers.cc:597] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:11.234797 25395 tablet_server.cc:179] TabletServer@127.24.204.194:0 shutting down...
W20260709 13:12:11.247853 26548 consensus_peers.cc:597] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.258177 26622 consensus_peers.cc:597] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:11.260779 26625 consensus_peers.cc:597] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.262611 26625 consensus_peers.cc:597] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.272668 26548 consensus_peers.cc:597] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.308145 26622 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.351631 27240 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.367372 26625 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.385972 26625 consensus_peers.cc:597] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.387923 26625 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.405076 26625 consensus_peers.cc:597] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.420989 27243 consensus_peers.cc:597] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.441780 27240 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.457456 26625 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.475870 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:11.481639 25395 tablet_replica.cc:333] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
W20260709 13:12:11.482525 27243 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.483403 25395 raft_consensus.cc:2243] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.484381 25395 raft_consensus.cc:2272] T fb7b25ba8d2644ceb86280e40ef3c8dc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.488895 25395 tablet_replica.cc:333] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.489902 25395 raft_consensus.cc:2243] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.490581 25395 raft_consensus.cc:2272] T 731b96cedb5749df893a1de699717183 P ef2886777a8f45e69e213b02a22ecec7 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.502214 26625 consensus_peers.cc:597] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.506469 27243 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.513612 25395 tablet_replica.cc:333] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.514747 25395 raft_consensus.cc:2243] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.515760 25395 raft_consensus.cc:2272] T 93a535a53cf0452f96a49f9aa849777a P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.518906 25395 tablet_replica.cc:333] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.526340 25395 raft_consensus.cc:2243] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.527979 25395 raft_consensus.cc:2272] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.542959 25395 tablet_replica.cc:333] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
W20260709 13:12:11.528916 27243 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.550544 25395 raft_consensus.cc:2243] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:12:11.550339 27240 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:11.551841 25395 raft_consensus.cc:2272] T 4887e9161abf4ffe869e9d1cc636b7da P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.555075 26625 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.563447 25395 tablet_replica.cc:333] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.564462 25395 raft_consensus.cc:2243] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.565117 25395 raft_consensus.cc:2272] T 9b26ae30d0734e338bc81b8d9f963b67 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.575356 25395 tablet_replica.cc:333] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.576200 25395 raft_consensus.cc:2243] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.577239 25395 raft_consensus.cc:2272] T 32c8792823e44557bace909d8b20d9eb P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.577884 26625 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.595631 27240 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.596982 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.609036 26625 consensus_peers.cc:597] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.611495 26625 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.611804 25395 tablet_replica.cc:333] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.612869 25395 raft_consensus.cc:2243] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.613632 25395 raft_consensus.cc:2272] T 23a5091904e646e8b76c8f9103e029b5 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.616640 25395 tablet_replica.cc:333] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.617488 25395 raft_consensus.cc:2243] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.619079 25395 raft_consensus.cc:2272] T 7a3ba69234d6417b968d15d31d856dbf P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.629681 27243 consensus_peers.cc:597] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.630816 27243 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.631544 27243 consensus_peers.cc:597] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.632973 26625 consensus_peers.cc:597] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.645483 25395 tablet_replica.cc:333] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.646612 25395 raft_consensus.cc:2243] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.648249 25395 raft_consensus.cc:2272] T b945492abb95467c8e66b0f6d8842bc7 P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.651454 25395 tablet_replica.cc:333] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.652376 25395 raft_consensus.cc:2243] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.663215 25395 raft_consensus.cc:2272] T c46a2e31548b4665b067897f6ebe9bf9 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.666183 25395 tablet_replica.cc:333] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.667128 25395 raft_consensus.cc:2243] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.668303 25395 raft_consensus.cc:2272] T a72cbe5dad8844a08aa3bf83d8f3ad27 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.674510 27243 consensus_peers.cc:597] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.679997 26548 consensus_peers.cc:597] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.675410 27240 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:11.687485 25395 tablet_replica.cc:333] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.688418 25395 raft_consensus.cc:2243] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.690655 25395 raft_consensus.cc:2272] T 941b69cce0d24bb9a4f60558447429c4 P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.693485 25395 tablet_replica.cc:333] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.694384 25395 raft_consensus.cc:2243] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.695633 25395 raft_consensus.cc:2272] T e29f1967e75645cbb7842e14e0404518 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.698419 25395 tablet_replica.cc:333] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.699177 25395 raft_consensus.cc:2243] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.699860 25395 raft_consensus.cc:2272] T 9ecc61d0190444bea318620b6a278926 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.705793 26622 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:11.706586 27243 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.715214 26625 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.718813 25395 tablet_replica.cc:333] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.719699 25395 raft_consensus.cc:2243] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.720346 25395 raft_consensus.cc:2272] T ebe9b36ae60941888203dd2967005c27 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.723223 25395 tablet_replica.cc:333] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.724105 25395 raft_consensus.cc:2243] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.725270 25395 raft_consensus.cc:2272] T 20b4ddf1aa104699a71886717f8e24b6 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.725961 27243 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.739315 27240 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:11.746045 25395 tablet_replica.cc:333] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.747787 25395 raft_consensus.cc:2243] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.748677 25395 raft_consensus.cc:2272] T 0edde491935742d4b076995932d10cc9 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.752980 25395 tablet_replica.cc:333] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.758481 25395 raft_consensus.cc:2243] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:12:11.760262 26625 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.762540 25395 raft_consensus.cc:2272] T 5ce4b86f29b4456dba024f24f29091e4 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.773669 25395 tablet_replica.cc:333] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.774694 25395 raft_consensus.cc:2243] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.775429 25395 raft_consensus.cc:2272] T 01228e22d88047b6bc2f5a6b74aa2b51 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.778872 25395 tablet_replica.cc:333] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
W20260709 13:12:11.782871 27243 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.784008 25395 raft_consensus.cc:2243] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.787132 25395 raft_consensus.cc:2272] T 2a158e3bdc954edd8dde2444100459ef P ef2886777a8f45e69e213b02a22ecec7 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.798674 26625 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.807631 25395 tablet_replica.cc:333] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.809051 25395 raft_consensus.cc:2243] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.810039 25395 raft_consensus.cc:2272] T 71037b41f3ef4e33946b5099bf7adb3d P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.813364 25395 tablet_replica.cc:333] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.814035 25395 raft_consensus.cc:2243] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.814605 25395 raft_consensus.cc:2272] T b1b4bf10cd16491e8819a9dce5192276 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.817250 25395 tablet_replica.cc:333] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.818073 25395 raft_consensus.cc:2243] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.819348 25395 raft_consensus.cc:2272] T 5b5c3addfbab45deb9fc008aee1b7ea5 P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.820616 27243 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.822208 25395 tablet_replica.cc:333] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.824122 25395 raft_consensus.cc:2243] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.825870 25395 raft_consensus.cc:2272] T 9b1aac0e4d18474e899d9c60448999fc P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.829553 25395 tablet_replica.cc:333] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.830603 25395 raft_consensus.cc:2243] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.832866 25395 raft_consensus.cc:2272] T bbeed79ff32c46018128de0f6b9a3514 P ef2886777a8f45e69e213b02a22ecec7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.835650 25395 tablet_replica.cc:333] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.836514 25395 raft_consensus.cc:2243] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.838260 25395 raft_consensus.cc:2272] T fa6a5d55926746d28b7b8b8862f40c10 P ef2886777a8f45e69e213b02a22ecec7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.841506 25395 tablet_replica.cc:333] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.842710 25395 raft_consensus.cc:2243] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.843453 25395 raft_consensus.cc:2272] T a78e2d37ffa144e9ae8e64979146f436 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.846954 25395 tablet_replica.cc:333] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.847898 25395 raft_consensus.cc:2243] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.848635 25395 raft_consensus.cc:2272] T 81721f0402d24cbfb7f52e0ba164247b P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.856132 27243 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.857235 27240 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:11.863992 25395 tablet_replica.cc:333] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.864959 25395 raft_consensus.cc:2243] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.865705 25395 raft_consensus.cc:2272] T 274eefdb88c143849b4b07f0d6ffcdc0 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.868531 27240 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:11.881457 25395 tablet_replica.cc:333] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.882493 25395 raft_consensus.cc:2243] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.883945 25395 raft_consensus.cc:2272] T f6d05596fdb0401faeb202a1f8740d44 P ef2886777a8f45e69e213b02a22ecec7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.887140 25395 tablet_replica.cc:333] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.888022 25395 raft_consensus.cc:2243] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.889597 25395 raft_consensus.cc:2272] T 4b57a114025342d2bdfb15a7bb13db93 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.890405 26622 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:11.892390 25395 tablet_replica.cc:333] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
W20260709 13:12:11.892877 27240 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:11.893222 25395 raft_consensus.cc:2243] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.894948 25395 raft_consensus.cc:2272] T 108a6730154b42819badee4f37f31ad8 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.897535 25395 tablet_replica.cc:333] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.898391 25395 raft_consensus.cc:2243] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.899010 25395 raft_consensus.cc:2272] T 6daa7e0062a14868b29dc1a9144f41c8 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.901943 25395 tablet_replica.cc:333] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.907017 25395 raft_consensus.cc:2243] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.907692 25395 raft_consensus.cc:2272] T a7aaf3bb8d83488a81bc031ffda595a5 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.912786 25395 tablet_replica.cc:333] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.913623 25395 raft_consensus.cc:2243] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.914975 25395 raft_consensus.cc:2272] T 54cd8d698474498090aabe4448aa2a2b P ef2886777a8f45e69e213b02a22ecec7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.918331 25395 tablet_replica.cc:333] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.919190 25395 raft_consensus.cc:2243] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.920439 25395 raft_consensus.cc:2272] T 7672ae1d65b4497686627cb041189424 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.923197 25395 tablet_replica.cc:333] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.923992 25395 raft_consensus.cc:2243] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.925145 25395 raft_consensus.cc:2272] T 15ce1ae648ca45aba8c6efb73a35ae9e P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.928092 25395 tablet_replica.cc:333] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.928829 25395 raft_consensus.cc:2243] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.930007 25395 raft_consensus.cc:2272] T 7fdbcbb3a7ce412c93c07413fe11793f P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.937419 25395 tablet_replica.cc:333] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.938262 25395 raft_consensus.cc:2243] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.939546 25395 raft_consensus.cc:2272] T f54605dc5ec04452908dd0efd01fbcaf P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.941936 26622 consensus_peers.cc:597] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:11.942510 25395 tablet_replica.cc:333] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.943315 25395 raft_consensus.cc:2243] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.948361 25395 raft_consensus.cc:2272] T 057c1e97d7fb407aaf9cf119a0b63a37 P ef2886777a8f45e69e213b02a22ecec7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.951382 25395 tablet_replica.cc:333] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.952136 25395 raft_consensus.cc:2243] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.952822 25395 raft_consensus.cc:2272] T 9b74cbdc379342d4832425ebe52bbac5 P ef2886777a8f45e69e213b02a22ecec7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.955448 25395 tablet_replica.cc:333] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.956117 25395 raft_consensus.cc:2243] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.956619 25395 raft_consensus.cc:2272] T 30ffd86793fb4eab863861f1047dec1e P ef2886777a8f45e69e213b02a22ecec7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.959149 25395 tablet_replica.cc:333] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.959853 25395 raft_consensus.cc:2243] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.960506 25395 raft_consensus.cc:2272] T e14f699cfba34b90b5f92484e9fd0ddc P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.963277 25395 tablet_replica.cc:333] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.963990 25395 raft_consensus.cc:2243] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.964658 25395 raft_consensus.cc:2272] T 1fcf073468e44507a058097dedeaa5df P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.972060 25395 tablet_replica.cc:333] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.972816 25395 raft_consensus.cc:2243] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.974071 25395 raft_consensus.cc:2272] T e51f289426cf4543b1a962ba324beea3 P ef2886777a8f45e69e213b02a22ecec7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.976806 25395 tablet_replica.cc:333] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7: stopping tablet replica
I20260709 13:12:11.977445 25395 raft_consensus.cc:2243] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.978264 25395 raft_consensus.cc:2272] T 41780cfc14f24065b0d12741153c5b15 P ef2886777a8f45e69e213b02a22ecec7 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:12.105494 26392 catalog_manager.cc:4755] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7672ae1d65b4497686627cb041189424: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:12:12.150750 26622 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:12.336601 26622 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:12.341506 27240 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:12.363308 26622 consensus_peers.cc:597] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:12.365286 27240 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:12.396446 26622 consensus_peers.cc:597] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:12.639124 27240 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:12.669703 27240 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:12.672125 27240 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:12.756022 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:12.769230 32626 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:12.769927 32626 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:12.772802 32626 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:12.794171 27240 leader_election.cc:336] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:12.803069 32623 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:12.804323 32623 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:12:12.807291 26622 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:12.807560 32623 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:12.809527 27243 leader_election.cc:336] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:12.810055 27243 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:12.811509 32641 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:12.815237 27240 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:12.819559 26625 leader_election.cc:336] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:12.831387 32641 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:12.838544 32641 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:12:12.851661 26622 leader_election.cc:336] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:12.851533 26651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
W20260709 13:12:12.857033 27243 leader_election.cc:336] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:12.857825 26622 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:12.859666 27241 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:12.860596 32630 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:12.861115 32623 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:12.860613 32641 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:12:12.874645 32623 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:12.875378 32623 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:12.877554 32623 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:12.886900 27240 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111) [suppressed 511 similar messages]
I20260709 13:12:12.903930 32631 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:12.904575 32631 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:12.907009 32631 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:12.915434 26625 leader_election.cc:336] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:12.922008 26622 leader_election.cc:336] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:12.922549 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:12.924031 32631 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:12.934690 26625 leader_election.cc:336] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:12.942451 26622 leader_election.cc:336] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:12.943035 26622 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:12.943852 32631 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:12.944839 32631 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:12.945355 32631 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:12.947743 32631 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:12.956219 26625 leader_election.cc:336] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:12.956851 32641 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:12:12.957316 26622 leader_election.cc:336] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:12.957469 32641 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:12.957895 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:12.958678 32631 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:12.966320 32641 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:12.966868 27243 leader_election.cc:336] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:12.969297 27240 leader_election.cc:336] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:12.969889 27240 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:12.971248 32641 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:12.988090 32631 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:12.988757 32631 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:12.991052 32631 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:12.996287 32623 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:12.996866 32623 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:13.003470 32639 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.004288 32623 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:13.004094 32639 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:12:13.002135 26622 leader_election.cc:336] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:13.005973 32623 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.006498 32623 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.007025 32639 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:13.008147 26625 leader_election.cc:336] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.008896 32623 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:12:13.011241 26625 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.014037 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:12:13.014705 32639 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:13.014772 27278 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 12.
W20260709 13:12:13.014032 26622 leader_election.cc:336] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:12:13.026970 26625 leader_election.cc:336] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.027529 26625 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.030903 32623 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:13.032125 26625 leader_election.cc:336] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:13.034931 26625 leader_election.cc:336] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.035862 32623 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.036733 32623 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:13.039271 32623 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:13.039700 32639 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.040215 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.040290 32639 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:13.042268 32623 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:13.042740 32623 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.042891 32639 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:13.043231 32623 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:13.052987 26625 leader_election.cc:336] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:13.053685 26625 leader_election.cc:336] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:13.041800 26622 leader_election.cc:336] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:13.055609 26622 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.055646 32623 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.058240 32623 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:12:13.058948 32623 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:13.063490 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5c3addfbab45deb9fc008aee1b7ea5" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:12:13.064163 27278 raft_consensus.cc:3060] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:13.069927 26625 leader_election.cc:336] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.073824 27278 raft_consensus.cc:2468] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 13.
W20260709 13:12:13.074580 26622 leader_election.cc:336] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:13.075923 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.076893 32639 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:13.077116 26622 leader_election.cc:336] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:13.078011 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.080494 26622 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.081374 32623 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:13.081753 32639 raft_consensus.cc:2804] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:13.082367 32639 raft_consensus.cc:697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:12:13.083621 32639 consensus_queue.cc:237] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.093940 32641 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.094635 32641 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.096975 32641 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:13.116242 27240 leader_election.cc:336] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:12:13.120046 27243 leader_election.cc:336] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.120522 27243 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.123907 32630 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:13.153533 26403 catalog_manager.cc:5697] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 12 to 13, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 13 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.164301 32641 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.164953 32641 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.168678 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:12:13.175895 32641 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:13.180843 27243 leader_election.cc:336] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.181324 27243 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.182114 32641 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:13.187350 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800334420 after lost signal to thread 25398
W20260709 13:12:13.188608 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0bc0 after lost signal to thread 26442
W20260709 13:12:13.189302 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad5e0 after lost signal to thread 26609
W20260709 13:12:13.190517 26680 debug-util.cc:398] Leaking SignalData structure 0x7b0800291160 after lost signal to thread 26683
I20260709 13:12:13.192931 32631 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.193552 32631 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:12:13.194171 26680 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5220 after lost signal to thread 27302
I20260709 13:12:13.195856 32631 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:12:13.198107 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
W20260709 13:12:13.213451 26625 leader_election.cc:336] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.213990 26625 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.215070 32639 raft_consensus.cc:2749] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:13.219172 32639 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.219722 32639 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:13.221951 32639 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:13.243319 26625 leader_election.cc:336] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.244392 32623 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:12:13.244751 26622 leader_election.cc:336] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:13.244997 32623 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.245385 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.247093 32639 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:13.247272 32623 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:12:13.252873 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:12:13.263816 32641 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.264472 32641 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:12:13.265679 26625 leader_election.cc:336] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.268397 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:12:13.269008 26652 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 12.
I20260709 13:12:13.270282 27241 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:12:13.271071 32626 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:13.271440 32626 raft_consensus.cc:493] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.271783 32626 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:13.278044 32641 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:13.280148 27243 leader_election.cc:336] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.280157 32626 raft_consensus.cc:515] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.283648 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54605dc5ec04452908dd0efd01fbcaf" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:12:13.284194 26652 raft_consensus.cc:3060] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:13.288640 26622 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b1f40e8672c549d3b4be7862ac07b7e2, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.292096 26652 raft_consensus.cc:2468] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 13.
I20260709 13:12:13.299506 32639 raft_consensus.cc:2749] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:13.298878 26622 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:13.306396 27241 leader_election.cc:304] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:12:13.307545 32639 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.308113 32639 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.310355 32639 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
I20260709 13:12:13.311132 32630 raft_consensus.cc:2804] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:13.315287 26625 leader_election.cc:336] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.316277 32626 leader_election.cc:290] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:12:13.331197 32626 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.338953 32630 raft_consensus.cc:697] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:12:13.341272 32630 consensus_queue.cc:237] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.343078 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" is_pre_election: true
I20260709 13:12:13.350438 27278 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 8.
I20260709 13:12:13.339031 32626 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.358994 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320" is_pre_election: true
I20260709 13:12:13.362057 26652 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 14.
I20260709 13:12:13.362927 32649 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.365737 32649 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.366303 27241 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:12:13.367365 32641 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:13.367811 32641 raft_consensus.cc:493] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.368466 32641 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:13.368992 32649 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:13.370411 27243 leader_election.cc:336] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.371594 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.373389 32623 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:13.373776 32623 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:13.374161 32623 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.369776 32626 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:12:13.381608 26403 catalog_manager.cc:5697] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 12 to 13, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 13 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:13.388252 27240 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:13.396308 32623 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.398496 32623 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196:45899)
W20260709 13:12:13.399360 26622 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:13.405421 26625 leader_election.cc:336] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:13.409834 27243 leader_election.cc:336] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.409945 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbeed79ff32c46018128de0f6b9a3514" candidate_uuid: "af1b5d6d444447b7a580afb4aff33320" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1f40e8672c549d3b4be7862ac07b7e2"
I20260709 13:12:13.411896 27278 raft_consensus.cc:3060] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:13.419584 27240 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:13.419723 27278 raft_consensus.cc:2468] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1b5d6d444447b7a580afb4aff33320 in term 9.
I20260709 13:12:13.410918 32641 raft_consensus.cc:515] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:13.423671 26652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15ce1ae648ca45aba8c6efb73a35ae9e" candidate_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "af1b5d6d444447b7a580afb4aff33320"
I20260709 13:12:13.424268 26652 raft_consensus.cc:3060] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:13.432057 26652 raft_consensus.cc:2468] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f40e8672c549d3b4be7862ac07b7e2 in term 15.
I20260709 13:12:13.433283 27241 leader_election.cc:304] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: 
I20260709 13:12:13.434233 32630 raft_consensus.cc:2804] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:13.434746 32630 raft_consensus.cc:697] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Becoming Leader. State: Replica: b1f40e8672c549d3b4be7862ac07b7e2, State: Running, Role: LEADER
I20260709 13:12:13.435756 32630 consensus_queue.cc:237] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:12:13.441941 27243 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:13.442408 27243 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.446844 32641 leader_election.cc:290] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: Requested vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:12:13.447609 32626 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:13.449229 26622 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320, b1f40e8672c549d3b4be7862ac07b7e2; no voters: ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:13.450394 32639 raft_consensus.cc:2804] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:13.450919 32639 raft_consensus.cc:697] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Becoming Leader. State: Replica: af1b5d6d444447b7a580afb4aff33320, State: Running, Role: LEADER
I20260709 13:12:13.451814 32639 consensus_queue.cc:237] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:12:13.454319 25395 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 26606)
I20260709 13:12:13.478034 26403 catalog_manager.cc:5697] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 reported cstate change: term changed from 8 to 9, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to af1b5d6d444447b7a580afb4aff33320 (127.24.204.195). New cstate: current_term: 9 leader_uuid: "af1b5d6d444447b7a580afb4aff33320" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:13.483076 26622 consensus_peers.cc:597] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:13.504127 26403 catalog_manager.cc:5697] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 reported cstate change: term changed from 14 to 15, leader changed from ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194) to b1f40e8672c549d3b4be7862ac07b7e2 (127.24.204.196). New cstate: current_term: 15 leader_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:13.508455 27243 leader_election.cc:336] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:13.537000 27240 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:13.618685 26625 consensus_peers.cc:597] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:13.631013 27270 raft_consensus.cc:1275] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:13.632728 32623 consensus_queue.cc:1048] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:12:13.686934 26625 consensus_peers.cc:597] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:13.693423 27240 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:13.704916 27243 consensus_peers.cc:597] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.740003 26622 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:13.766386 26625 consensus_peers.cc:597] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.792287 27243 consensus_peers.cc:597] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:13.792923 26625 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:13.857997 26651 raft_consensus.cc:1275] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:13.859951 32650 consensus_queue.cc:1048] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:12:13.865495 27240 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:13.889106 26625 consensus_peers.cc:597] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.944834 26625 consensus_peers.cc:597] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.950325 26625 consensus_peers.cc:597] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:13.978245 26625 consensus_peers.cc:597] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.990275 27240 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:14.002370 26622 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:14.004935 26651 raft_consensus.cc:1275] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Refusing update from remote peer b1f40e8672c549d3b4be7862ac07b7e2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:12:14.018443 32626 consensus_queue.cc:1048] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:12:14.019178 27243 consensus_peers.cc:597] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.023041 26625 consensus_peers.cc:597] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.023603 26625 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.043162 26625 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:14.045362 27278 raft_consensus.cc:1275] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Refusing update from remote peer af1b5d6d444447b7a580afb4aff33320: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:14.050590 32639 consensus_queue.cc:1048] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:12:14.062726 27243 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.065222 26625 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.129961 26625 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.134191 27243 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.155715 26622 consensus_peers.cc:597] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:14.167300 27240 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:14.187696 26625 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.197489 27243 consensus_peers.cc:597] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.205192 27243 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.305132 27243 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.307302 27240 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:14.338024 27243 consensus_peers.cc:597] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.338675 27243 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.350262 27240 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:14.360625 27243 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.364326 26622 consensus_peers.cc:597] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:14.384420 26625 consensus_peers.cc:597] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.385812 27240 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:14.389041 27240 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:14.407383 27243 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.423074 27243 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.423947 27243 consensus_peers.cc:597] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.442667 27243 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.454761 25395 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 26606)
W20260709 13:12:14.450114 26625 consensus_peers.cc:597] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.458537 26625 consensus_peers.cc:597] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.460538 26625 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.469818 26622 consensus_peers.cc:597] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:14.592057 26625 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:33025, user_credentials={real_user=slave}} blocked reactor thread for 63586.6us
I20260709 13:12:14.616137 32639 raft_consensus.cc:493] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:14.616736 32639 raft_consensus.cc:515] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:14.619149 32639 leader_election.cc:290] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:14.832877 32641 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:14.833843 32641 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:14.836567 32641 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:14.926645 32639 raft_consensus.cc:493] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:14.927335 32639 raft_consensus.cc:515] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:14.929685 32639 leader_election.cc:290] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:14.972919 32641 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:14.973611 32641 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:14.975669 32641 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:14.985177 32630 raft_consensus.cc:493] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:14.988775 32630 raft_consensus.cc:515] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:15.004722 32630 leader_election.cc:290] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:15.008980 32666 raft_consensus.cc:493] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:15.016028 32666 raft_consensus.cc:515] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:15.018468 32666 leader_election.cc:290] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:15.028774 27240 leader_election.cc:336] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:15.035789 32652 raft_consensus.cc:493] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:15.036477 32652 raft_consensus.cc:515] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:15.038770 32652 leader_election.cc:290] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:15.040995 27240 leader_election.cc:336] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:12:15.048774 27240 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:15.044355 32652 raft_consensus.cc:493] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:15.050685 32652 raft_consensus.cc:515] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:15.053627 32652 leader_election.cc:290] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:15.070336 27240 leader_election.cc:336] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:12:15.080912 26625 leader_election.cc:336] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:15.082441 26625 leader_election.cc:336] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:15.083573 27240 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:15.089349 27240 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:15.091092 32652 raft_consensus.cc:493] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:15.091871 32652 raft_consensus.cc:515] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:15.093935 32652 leader_election.cc:290] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:15.094525 26622 leader_election.cc:336] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:12:15.103740 27243 leader_election.cc:336] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:15.102130 26622 leader_election.cc:304] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.106442 27243 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:12:15.106909 26622 consensus_peers.cc:597] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:15.107530 26622 leader_election.cc:336] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:15.107893 26622 leader_election.cc:304] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.108649 32671 raft_consensus.cc:2749] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:15.109133 32630 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:15.109297 32671 raft_consensus.cc:2749] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:15.110244 26622 consensus_peers.cc:597] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:15.110785 26622 consensus_peers.cc:597] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:15.111271 26622 consensus_peers.cc:597] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:15.112586 27243 leader_election.cc:336] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:15.115229 27243 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:12:15.110201 26625 leader_election.cc:336] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:15.116182 26622 leader_election.cc:336] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:15.118569 26622 leader_election.cc:304] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.119379 32652 raft_consensus.cc:2749] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:15.126101 32630 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:15.126964 32630 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:15.127471 32630 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:15.129914 32630 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:15.133507 27243 leader_election.cc:336] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:15.138051 27243 leader_election.cc:304] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.141582 32630 raft_consensus.cc:2749] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:15.140242 27240 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:12:15.153505 26625 leader_election.cc:336] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:15.154244 26625 leader_election.cc:336] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:15.154794 26625 leader_election.cc:336] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:15.166244 32670 raft_consensus.cc:493] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:15.166849 32670 raft_consensus.cc:515] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
W20260709 13:12:15.167835 27240 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:15.169064 32670 leader_election.cc:290] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:15.173684 26625 leader_election.cc:336] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:15.178364 27243 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:15.181381 27243 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.184190 32670 raft_consensus.cc:493] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
W20260709 13:12:15.178953 26622 leader_election.cc:336] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:15.184669 32670 raft_consensus.cc:515] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:15.185011 26622 leader_election.cc:304] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.185724 32671 raft_consensus.cc:2749] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:15.186872 32630 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:15.191644 26625 leader_election.cc:336] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:15.186645 26622 leader_election.cc:336] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:15.186733 32670 leader_election.cc:290] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:15.192934 26622 leader_election.cc:304] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.193884 32670 raft_consensus.cc:2749] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:15.183835 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:15.203095 26622 leader_election.cc:336] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:15.203732 26622 leader_election.cc:304] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.204536 32670 raft_consensus.cc:2749] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:15.209033 26622 leader_election.cc:336] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:15.209627 26622 leader_election.cc:304] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.210395 32670 raft_consensus.cc:2749] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:15.210903 26622 leader_election.cc:336] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:15.211339 26622 leader_election.cc:304] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.214433 32670 raft_consensus.cc:2749] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.237906 32670 raft_consensus.cc:493] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:15.238451 32670 raft_consensus.cc:515] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:15.240540 32670 leader_election.cc:290] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:15.245398 26625 leader_election.cc:336] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:15.251629 26622 leader_election.cc:336] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:15.252712 26622 leader_election.cc:304] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.253654 32670 raft_consensus.cc:2749] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:15.324476 32670 raft_consensus.cc:493] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:15.325059 32670 raft_consensus.cc:515] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } }
I20260709 13:12:15.327317 32670 leader_election.cc:290] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:15.343408 26625 leader_election.cc:336] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:15.345014 26622 leader_election.cc:336] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:15.345470 26622 leader_election.cc:304] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af1b5d6d444447b7a580afb4aff33320; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:15.346812 32670 raft_consensus.cc:2749] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:15.522156 27240 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:15.523000 27240 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:15.533602 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080028a340 after lost signal to thread 25398
W20260709 13:12:15.534703 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8660 after lost signal to thread 26442
W20260709 13:12:15.535984 26439 debug-util.cc:398] Leaking SignalData structure 0x7b08003292c0 after lost signal to thread 26683
W20260709 13:12:15.537163 26439 debug-util.cc:398] Leaking SignalData structure 0x7b080031aa40 after lost signal to thread 27302
W20260709 13:12:15.680320 26622 consensus_peers.cc:597] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:15.696241 27240 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:15.723747 25395 tablet_server.cc:196] TabletServer@127.24.204.194:0 shutdown complete.
W20260709 13:12:15.816949 26622 consensus_peers.cc:597] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:15.926395 27240 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:15.929499 25395 tablet_server.cc:179] TabletServer@127.24.204.195:0 shutting down...
W20260709 13:12:15.980932 27241 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:15.988552 27241 consensus_peers.cc:597] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:15.996320 26622 consensus_peers.cc:597] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:15.997639 27241 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.015023 27241 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.026737 27241 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.061995 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:16.065399 25395 tablet_replica.cc:333] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.066476 25395 raft_consensus.cc:2243] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.067832 25395 raft_consensus.cc:2272] T fb7b25ba8d2644ceb86280e40ef3c8dc P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.073217 25395 tablet_replica.cc:333] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.074342 25395 raft_consensus.cc:2243] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.075110 25395 raft_consensus.cc:2272] T 40a3c5a4dbcb4d7f8b2517b3d86bcb00 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.078315 25395 tablet_replica.cc:333] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
W20260709 13:12:16.078488 26625 consensus_peers.cc:597] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:16.079346 25395 raft_consensus.cc:2243] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.080103 25395 raft_consensus.cc:2272] T 63f94c193a504bc1b0601e54e3ec5f9a P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.084021 25395 tablet_replica.cc:333] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.090842 25395 raft_consensus.cc:2243] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.091630 25395 raft_consensus.cc:2272] T 203b3a179cc240e6ac8beb1d95728111 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.094288 26622 consensus_peers.cc:597] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:16.102707 25395 tablet_replica.cc:333] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.103696 25395 raft_consensus.cc:2243] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.104598 25395 raft_consensus.cc:2272] T b945492abb95467c8e66b0f6d8842bc7 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.107532 25395 tablet_replica.cc:333] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
W20260709 13:12:16.108410 27241 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.108421 25395 raft_consensus.cc:2243] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.110937 25395 raft_consensus.cc:2272] T c46a2e31548b4665b067897f6ebe9bf9 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.121173 25395 tablet_replica.cc:333] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.122874 25395 raft_consensus.cc:2243] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:16.131734 27241 consensus_peers.cc:597] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.132447 27241 consensus_peers.cc:597] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.133306 27240 consensus_peers.cc:597] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:16.141319 25395 raft_consensus.cc:2272] T 479f20ff71c04b8ea8eea5b4f8c922ff P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.147882 25395 tablet_replica.cc:333] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.148844 25395 raft_consensus.cc:2243] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.150254 25395 raft_consensus.cc:2272] T bbeed79ff32c46018128de0f6b9a3514 P af1b5d6d444447b7a580afb4aff33320 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.156430 25395 tablet_replica.cc:333] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.157622 25395 raft_consensus.cc:2243] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.160018 25395 raft_consensus.cc:2272] T b0f9b412be4742fc99eac55c24c89cf8 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.162757 25395 tablet_replica.cc:333] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.163592 25395 raft_consensus.cc:2243] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.164333 25395 raft_consensus.cc:2272] T 4887e9161abf4ffe869e9d1cc636b7da P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.167078 25395 tablet_replica.cc:333] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.167989 25395 raft_consensus.cc:2243] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.168677 25395 raft_consensus.cc:2272] T f54605dc5ec04452908dd0efd01fbcaf P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.171404 25395 tablet_replica.cc:333] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.178911 25395 raft_consensus.cc:2243] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.179587 25395 raft_consensus.cc:2272] T 8f3c8f39cbe14359a810de00ced87a46 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.182535 25395 tablet_replica.cc:333] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.183370 25395 raft_consensus.cc:2243] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.184940 25395 raft_consensus.cc:2272] T b0b9da52e1c04100a4d56d1cfce9e2a2 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.189267 27241 consensus_peers.cc:597] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.191869 25395 tablet_replica.cc:333] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.192788 25395 raft_consensus.cc:2243] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.193506 25395 raft_consensus.cc:2272] T 32c8792823e44557bace909d8b20d9eb P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.196417 25395 tablet_replica.cc:333] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.197252 25395 raft_consensus.cc:2243] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.198314 25395 raft_consensus.cc:2272] T 23a5091904e646e8b76c8f9103e029b5 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.200917 25395 tablet_replica.cc:333] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.201807 25395 raft_consensus.cc:2243] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.202943 25395 raft_consensus.cc:2272] T a72cbe5dad8844a08aa3bf83d8f3ad27 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.205510 25395 tablet_replica.cc:333] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.206357 25395 raft_consensus.cc:2243] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.207095 25395 raft_consensus.cc:2272] T 941b69cce0d24bb9a4f60558447429c4 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.218413 25395 tablet_replica.cc:333] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.219312 25395 raft_consensus.cc:2243] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.220136 25395 raft_consensus.cc:2272] T e29f1967e75645cbb7842e14e0404518 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.222721 25395 tablet_replica.cc:333] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.223480 25395 raft_consensus.cc:2243] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.224545 25395 raft_consensus.cc:2272] T 7a3ba69234d6417b968d15d31d856dbf P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.226985 25395 tablet_replica.cc:333] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.227710 25395 raft_consensus.cc:2243] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.228279 25395 raft_consensus.cc:2272] T 9ecc61d0190444bea318620b6a278926 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.236588 25395 tablet_replica.cc:333] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.237454 25395 raft_consensus.cc:2243] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.238632 25395 raft_consensus.cc:2272] T ebe9b36ae60941888203dd2967005c27 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.241132 25395 tablet_replica.cc:333] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.241948 25395 raft_consensus.cc:2243] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.242906 25395 raft_consensus.cc:2272] T 20b4ddf1aa104699a71886717f8e24b6 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.245674 25395 tablet_replica.cc:333] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.246471 25395 raft_consensus.cc:2243] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.247694 25395 raft_consensus.cc:2272] T 9b26ae30d0734e338bc81b8d9f963b67 P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.250243 25395 tablet_replica.cc:333] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.251472 25395 raft_consensus.cc:2243] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.253607 25395 raft_consensus.cc:2272] T 01228e22d88047b6bc2f5a6b74aa2b51 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.255976 27241 consensus_peers.cc:597] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.257306 25395 tablet_replica.cc:333] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.258169 25395 raft_consensus.cc:2243] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.259193 25395 raft_consensus.cc:2272] T ffb5488a21bd418b96b52a8ab8a2e669 P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.270040 25395 tablet_replica.cc:333] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.270975 25395 raft_consensus.cc:2243] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:16.276999 27243 consensus_peers.cc:597] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:16.278023 25395 raft_consensus.cc:2272] T 81721f0402d24cbfb7f52e0ba164247b P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.281090 25395 tablet_replica.cc:333] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.281985 25395 raft_consensus.cc:2243] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.283244 25395 raft_consensus.cc:2272] T 274eefdb88c143849b4b07f0d6ffcdc0 P af1b5d6d444447b7a580afb4aff33320 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.286080 25395 tablet_replica.cc:333] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.286878 25395 raft_consensus.cc:2243] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.287964 25395 raft_consensus.cc:2272] T f6d05596fdb0401faeb202a1f8740d44 P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.290503 25395 tablet_replica.cc:333] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.291304 25395 raft_consensus.cc:2243] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.292367 25395 raft_consensus.cc:2272] T fa6a5d55926746d28b7b8b8862f40c10 P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.294911 25395 tablet_replica.cc:333] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.295717 25395 raft_consensus.cc:2243] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.296985 25395 raft_consensus.cc:2272] T 66cd76ef163447878430c4633d13a427 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.299501 25395 tablet_replica.cc:333] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.300235 25395 raft_consensus.cc:2243] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.302528 25395 raft_consensus.cc:2272] T 2a158e3bdc954edd8dde2444100459ef P af1b5d6d444447b7a580afb4aff33320 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.305043 25395 tablet_replica.cc:333] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.305975 25395 raft_consensus.cc:2243] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.307060 25395 raft_consensus.cc:2272] T b1b4bf10cd16491e8819a9dce5192276 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.314121 27240 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:16.316568 25395 tablet_replica.cc:333] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.317458 25395 raft_consensus.cc:2243] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.318668 25395 raft_consensus.cc:2272] T 5b5c3addfbab45deb9fc008aee1b7ea5 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.321484 25395 tablet_replica.cc:333] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.322292 25395 raft_consensus.cc:2243] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.322961 25395 raft_consensus.cc:2272] T 6cb26f1d881541f898a5a148f7f74144 P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.325491 25395 tablet_replica.cc:333] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.326289 25395 raft_consensus.cc:2243] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.327432 25395 raft_consensus.cc:2272] T 30ffd86793fb4eab863861f1047dec1e P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.330361 25395 tablet_replica.cc:333] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.331177 25395 raft_consensus.cc:2243] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.332499 25395 raft_consensus.cc:2272] T e14f699cfba34b90b5f92484e9fd0ddc P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.335126 25395 tablet_replica.cc:333] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.335884 25395 raft_consensus.cc:2243] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.336443 25395 raft_consensus.cc:2272] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P af1b5d6d444447b7a580afb4aff33320 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.339257 25395 tablet_replica.cc:333] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.340016 25395 raft_consensus.cc:2243] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.341068 25395 raft_consensus.cc:2272] T 7672ae1d65b4497686627cb041189424 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.344079 25395 tablet_replica.cc:333] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.344830 25395 raft_consensus.cc:2243] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.346217 25395 raft_consensus.cc:2272] T 54cd8d698474498090aabe4448aa2a2b P af1b5d6d444447b7a580afb4aff33320 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.358186 27241 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.371163 27241 consensus_peers.cc:597] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.378222 25395 tablet_replica.cc:333] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.379189 25395 raft_consensus.cc:2243] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.380236 25395 raft_consensus.cc:2272] T 1fcf073468e44507a058097dedeaa5df P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.382853 25395 tablet_replica.cc:333] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.383630 25395 raft_consensus.cc:2243] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.384245 25395 raft_consensus.cc:2272] T 15ce1ae648ca45aba8c6efb73a35ae9e P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.386796 25395 tablet_replica.cc:333] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.387542 25395 raft_consensus.cc:2243] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.388268 25395 raft_consensus.cc:2272] T 7fdbcbb3a7ce412c93c07413fe11793f P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.391115 25395 tablet_replica.cc:333] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.391852 25395 raft_consensus.cc:2243] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.392428 25395 raft_consensus.cc:2272] T 574d2707e806420dab53495563bd03aa P af1b5d6d444447b7a580afb4aff33320 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.409834 27241 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.427364 27241 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.429140 25395 tablet_replica.cc:333] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.430001 25395 raft_consensus.cc:2243] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.430675 25395 raft_consensus.cc:2272] T 108a6730154b42819badee4f37f31ad8 P af1b5d6d444447b7a580afb4aff33320 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.433187 25395 tablet_replica.cc:333] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.433925 25395 raft_consensus.cc:2243] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.434500 25395 raft_consensus.cc:2272] T f79cbcb2b1924d9c9e584d9a32e92bfa P af1b5d6d444447b7a580afb4aff33320 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.436914 25395 tablet_replica.cc:333] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.437548 25395 raft_consensus.cc:2243] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.438647 25395 raft_consensus.cc:2272] T 0edde491935742d4b076995932d10cc9 P af1b5d6d444447b7a580afb4aff33320 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.441303 25395 tablet_replica.cc:333] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320: stopping tablet replica
I20260709 13:12:16.442016 25395 raft_consensus.cc:2243] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.447822 25395 raft_consensus.cc:2272] T e51f289426cf4543b1a962ba324beea3 P af1b5d6d444447b7a580afb4aff33320 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.473420 27241 consensus_peers.cc:597] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.508699 27241 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Couldn't send request to peer af1b5d6d444447b7a580afb4aff33320. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.547595 27240 consensus_peers.cc:597] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:16.554554 27243 consensus_peers.cc:597] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.604847 27243 consensus_peers.cc:597] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:16.697626 27240 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:16.699435 27243 consensus_peers.cc:597] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:16.700080 32674 raft_consensus.cc:493] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:16.701112 32674 raft_consensus.cc:515] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:16.704583 32674 leader_election.cc:290] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:16.715044 27243 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:16.717461 27240 leader_election.cc:336] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:16.717980 27240 leader_election.cc:304] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:16.719600 32674 raft_consensus.cc:2749] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:16.721817 27240 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:16.768627 27243 consensus_peers.cc:597] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.830258 27243 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.842567 27243 consensus_peers.cc:597] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.880741 27243 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.884572 27243 consensus_peers.cc:597] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.893530 27240 consensus_peers.cc:597] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:16.995538 27243 consensus_peers.cc:597] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:17.005226 32674 raft_consensus.cc:493] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:17.005818 32674 raft_consensus.cc:515] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.008121 32674 leader_election.cc:290] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
W20260709 13:12:17.030658 27243 leader_election.cc:336] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:17.031533 27243 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:17.044068 27243 consensus_peers.cc:597] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:17.065846 27240 consensus_peers.cc:597] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:17.082729 27240 leader_election.cc:336] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:17.085067 27240 leader_election.cc:304] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:12:17.085798 27243 consensus_peers.cc:597] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:17.087138 32674 raft_consensus.cc:2749] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:17.097919 27243 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:17.101955 27240 consensus_peers.cc:597] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:17.111462 27243 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Couldn't send request to peer ef2886777a8f45e69e213b02a22ecec7. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:17.129355 27240 consensus_peers.cc:597] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:17.166054 32674 raft_consensus.cc:493] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.166618 32674 raft_consensus.cc:515] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.169008 32674 leader_election.cc:290] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:17.178165 27241 leader_election.cc:336] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
W20260709 13:12:17.179031 27243 leader_election.cc:336] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:17.179459 27243 leader_election.cc:304] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:17.180649 32674 raft_consensus.cc:2749] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:17.299186 27240 consensus_peers.cc:597] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:17.382124 32674 raft_consensus.cc:493] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.384009 32674 raft_consensus.cc:515] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.387375 32674 leader_election.cc:290] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:17.394621 27240 leader_election.cc:336] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:12:17.395874 27241 leader_election.cc:336] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
I20260709 13:12:17.396345 27241 leader_election.cc:304] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:12:17.397181 32674 raft_consensus.cc:2749] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:17.408915 32674 raft_consensus.cc:493] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.409952 32674 raft_consensus.cc:515] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.412828 32674 leader_election.cc:290] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:17.423269 27243 leader_election.cc:336] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:17.429123 27241 leader_election.cc:336] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
I20260709 13:12:17.429740 27241 leader_election.cc:304] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:17.431263 32674 raft_consensus.cc:2749] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:17.433684 27240 consensus_peers.cc:597] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:17.465004 32674 raft_consensus.cc:493] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.465898 32674 raft_consensus.cc:515] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.468425 32674 leader_election.cc:290] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:17.473347 27243 leader_election.cc:336] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:17.473879 27241 leader_election.cc:336] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
I20260709 13:12:17.474325 27241 leader_election.cc:304] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:17.475049 32674 raft_consensus.cc:2749] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:17.498126 32674 raft_consensus.cc:493] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef2886777a8f45e69e213b02a22ecec7)
I20260709 13:12:17.499137 32674 raft_consensus.cc:515] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:12:17.510980 27240 leader_election.cc:336] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:17.527817 32674 leader_election.cc:290] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025)
I20260709 13:12:17.531783 32674 raft_consensus.cc:493] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.532632 32674 raft_consensus.cc:515] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.535681 32675 raft_consensus.cc:493] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.536933 32675 raft_consensus.cc:515] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } attrs { replace: true } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.541038 32675 leader_election.cc:290] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:17.543329 27243 leader_election.cc:336] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:17.545996 27241 leader_election.cc:336] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
W20260709 13:12:17.549136 27241 leader_election.cc:336] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
W20260709 13:12:17.549322 27240 leader_election.cc:336] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:17.548676 27243 leader_election.cc:304] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: b9c3761688a64982ae1c4aeb758e09ef, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:17.549877 27240 leader_election.cc:304] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:12:17.550338 32674 leader_election.cc:290] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:12:17.550926 32675 raft_consensus.cc:2749] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:17.553248 32675 raft_consensus.cc:2749] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:17.561743 27243 leader_election.cc:336] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:17.562544 27243 leader_election.cc:336] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:17.562906 27243 leader_election.cc:304] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:17.563757 32678 raft_consensus.cc:2749] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:17.583693 32678 raft_consensus.cc:493] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.584614 32678 raft_consensus.cc:515] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.589594 32678 leader_election.cc:290] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:12:17.592206 32675 raft_consensus.cc:493] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.592999 32675 raft_consensus.cc:515] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.596076 32675 leader_election.cc:290] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:17.596668 27240 leader_election.cc:336] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:17.597839 32678 raft_consensus.cc:493] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.598995 32678 raft_consensus.cc:515] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b9c3761688a64982ae1c4aeb758e09ef" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 37907 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:12:17.600455 27241 leader_election.cc:336] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
I20260709 13:12:17.602099 27241 leader_election.cc:304] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:12:17.601280 32678 leader_election.cc:290] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
I20260709 13:12:17.603781 32678 raft_consensus.cc:2749] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:12:17.607616 27241 leader_election.cc:336] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
W20260709 13:12:17.612031 27240 leader_election.cc:336] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
W20260709 13:12:17.612676 27243 leader_election.cc:336] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:17.613546 27243 leader_election.cc:304] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
W20260709 13:12:17.613112 27241 leader_election.cc:336] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
I20260709 13:12:17.614842 32674 raft_consensus.cc:2749] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:17.614977 27241 leader_election.cc:304] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, b9c3761688a64982ae1c4aeb758e09ef
I20260709 13:12:17.615983 32674 raft_consensus.cc:2749] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:17.623338 27240 consensus_peers.cc:597] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:17.638352 32674 raft_consensus.cc:493] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.639366 32674 raft_consensus.cc:515] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.642146 32674 leader_election.cc:290] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:17.647956 27241 leader_election.cc:336] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
W20260709 13:12:17.649166 27243 leader_election.cc:336] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
I20260709 13:12:17.649611 27243 leader_election.cc:304] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:17.651438 32674 raft_consensus.cc:2749] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:17.656983 32675 raft_consensus.cc:493] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.657948 32675 raft_consensus.cc:515] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
W20260709 13:12:17.659744 27240 consensus_peers.cc:597] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:17.660280 32675 leader_election.cc:290] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:17.664789 27243 leader_election.cc:336] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:17.666194 27241 leader_election.cc:336] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
I20260709 13:12:17.666597 27241 leader_election.cc:304] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:17.670015 32674 raft_consensus.cc:2749] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:17.673377 27240 consensus_peers.cc:597] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:17.703540 25395 tablet_server.cc:196] TabletServer@127.24.204.195:0 shutdown complete.
W20260709 13:12:17.893290 27241 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111) [suppressed 663 similar messages]
I20260709 13:12:17.904953 25395 tablet_server.cc:179] TabletServer@127.24.204.196:0 shutting down...
I20260709 13:12:17.922120 32678 raft_consensus.cc:493] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader af1b5d6d444447b7a580afb4aff33320)
I20260709 13:12:17.923879 32678 raft_consensus.cc:515] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef2886777a8f45e69e213b02a22ecec7" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 33025 } } peers { permanent_uuid: "af1b5d6d444447b7a580afb4aff33320" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 34711 } } peers { permanent_uuid: "b1f40e8672c549d3b4be7862ac07b7e2" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 45899 } attrs { promote: false } }
I20260709 13:12:17.927294 32678 leader_election.cc:290] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025), af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711)
W20260709 13:12:17.930550 27243 leader_election.cc:336] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef2886777a8f45e69e213b02a22ecec7 (127.24.204.194:33025): Network error: Client connection negotiation failed: client connection to 127.24.204.194:33025: connect: Connection refused (error 111)
W20260709 13:12:17.932802 27241 leader_election.cc:336] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer af1b5d6d444447b7a580afb4aff33320 (127.24.204.195:34711): Network error: Client connection negotiation failed: client connection to 127.24.204.195:34711: connect: Connection refused (error 111)
I20260709 13:12:17.933323 27241 leader_election.cc:304] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f40e8672c549d3b4be7862ac07b7e2; no voters: af1b5d6d444447b7a580afb4aff33320, ef2886777a8f45e69e213b02a22ecec7
I20260709 13:12:17.934669 32678 raft_consensus.cc:2749] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:17.964775 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:17.968739 25395 tablet_replica.cc:333] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:17.970114 25395 raft_consensus.cc:2243] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.972558 25395 raft_consensus.cc:2272] T a72cbe5dad8844a08aa3bf83d8f3ad27 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.977306 25395 tablet_replica.cc:333] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:17.978601 25395 raft_consensus.cc:2243] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.980026 25395 raft_consensus.cc:2272] T 7a3ba69234d6417b968d15d31d856dbf P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.983989 25395 tablet_replica.cc:333] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:17.984938 25395 raft_consensus.cc:2243] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 NON_PARTICIPANT]: Raft consensus shutting down.
I20260709 13:12:17.985474 25395 pending_rounds.cc:70] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: Trying to abort 1 pending ops.
I20260709 13:12:17.985728 25395 pending_rounds.cc:77] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2: Aborting op as it isn't in flight: id { term: 8 index: 5 } timestamp: 7305636487187447808 op_type: NO_OP noop_request { }
I20260709 13:12:17.986302 25395 raft_consensus.cc:2889] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 NON_PARTICIPANT]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:17.986734 25395 raft_consensus.cc:2272] T 941b69cce0d24bb9a4f60558447429c4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 8 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:12:17.990803 25395 tablet_replica.cc:333] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:17.992017 25395 raft_consensus.cc:2243] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.993791 25395 raft_consensus.cc:2272] T 574d2707e806420dab53495563bd03aa P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.994132 27240 consensus_peers.cc:597] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:17.997658 25395 tablet_replica.cc:333] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:17.998932 25395 raft_consensus.cc:2243] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.000584 25395 raft_consensus.cc:2272] T a7aaf3bb8d83488a81bc031ffda595a5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.004416 25395 tablet_replica.cc:333] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.005530 25395 raft_consensus.cc:2243] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.007328 25395 raft_consensus.cc:2272] T f54605dc5ec04452908dd0efd01fbcaf P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.011098 25395 tablet_replica.cc:333] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.012137 25395 raft_consensus.cc:2243] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.013233 25395 raft_consensus.cc:2272] T 0edde491935742d4b076995932d10cc9 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.017304 25395 tablet_replica.cc:333] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.018483 25395 raft_consensus.cc:2243] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.020243 25395 raft_consensus.cc:2272] T 63f94c193a504bc1b0601e54e3ec5f9a P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:18.022207 27240 consensus_peers.cc:597] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 -> Peer b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): Couldn't send request to peer b9c3761688a64982ae1c4aeb758e09ef. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:18.024024 25395 tablet_replica.cc:333] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.025065 25395 raft_consensus.cc:2243] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.026721 25395 raft_consensus.cc:2272] T 7672ae1d65b4497686627cb041189424 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.030979 25395 tablet_replica.cc:333] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.031994 25395 raft_consensus.cc:2243] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.033636 25395 raft_consensus.cc:2272] T 6daa7e0062a14868b29dc1a9144f41c8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.037156 25395 tablet_replica.cc:333] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.038179 25395 raft_consensus.cc:2243] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.039255 25395 raft_consensus.cc:2272] T bbeed79ff32c46018128de0f6b9a3514 P b1f40e8672c549d3b4be7862ac07b7e2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.043181 25395 tablet_replica.cc:333] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.044052 25395 raft_consensus.cc:2243] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.045461 25395 raft_consensus.cc:2272] T 6cb26f1d881541f898a5a148f7f74144 P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.048895 25395 tablet_replica.cc:333] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.049836 25395 raft_consensus.cc:2243] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.051415 25395 raft_consensus.cc:2272] T f79cbcb2b1924d9c9e584d9a32e92bfa P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.055480 25395 tablet_replica.cc:333] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.056346 25395 raft_consensus.cc:2243] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.057754 25395 raft_consensus.cc:2272] T 1fcf073468e44507a058097dedeaa5df P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.061074 25395 tablet_replica.cc:333] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.061884 25395 raft_consensus.cc:2243] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.063369 25395 raft_consensus.cc:2272] T 479f20ff71c04b8ea8eea5b4f8c922ff P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.066434 25395 tablet_replica.cc:333] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.067222 25395 raft_consensus.cc:2243] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.068557 25395 raft_consensus.cc:2272] T 93a535a53cf0452f96a49f9aa849777a P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.071756 25395 tablet_replica.cc:333] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.072633 25395 raft_consensus.cc:2243] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.073846 25395 raft_consensus.cc:2272] T 01228e22d88047b6bc2f5a6b74aa2b51 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.076722 25395 tablet_replica.cc:333] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.077471 25395 raft_consensus.cc:2243] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.078159 25395 raft_consensus.cc:2272] T ffb5488a21bd418b96b52a8ab8a2e669 P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.081018 25395 tablet_replica.cc:333] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.081981 25395 raft_consensus.cc:2243] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.082899 25395 raft_consensus.cc:2272] T 2a158e3bdc954edd8dde2444100459ef P b1f40e8672c549d3b4be7862ac07b7e2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.086309 25395 tablet_replica.cc:333] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.087034 25395 raft_consensus.cc:2243] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.087730 25395 raft_consensus.cc:2272] T 71037b41f3ef4e33946b5099bf7adb3d P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.090473 25395 tablet_replica.cc:333] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.091223 25395 raft_consensus.cc:2243] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.091810 25395 raft_consensus.cc:2272] T 5b5c3addfbab45deb9fc008aee1b7ea5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.094923 25395 tablet_replica.cc:333] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.095667 25395 raft_consensus.cc:2243] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.097353 25395 raft_consensus.cc:2272] T 731b96cedb5749df893a1de699717183 P b1f40e8672c549d3b4be7862ac07b7e2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.100823 25395 tablet_replica.cc:333] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.101549 25395 raft_consensus.cc:2243] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.102977 25395 raft_consensus.cc:2272] T b0f9b412be4742fc99eac55c24c89cf8 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.106020 25395 tablet_replica.cc:333] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.106817 25395 raft_consensus.cc:2243] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.107666 25395 raft_consensus.cc:2272] T 4b57a114025342d2bdfb15a7bb13db93 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.110962 25395 tablet_replica.cc:333] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.111754 25395 raft_consensus.cc:2243] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.113299 25395 raft_consensus.cc:2272] T 41780cfc14f24065b0d12741153c5b15 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.116231 25395 tablet_replica.cc:333] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.117038 25395 raft_consensus.cc:2243] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.118441 25395 raft_consensus.cc:2272] T 5f93f34ef8a541ecba8b1a0dc7ea5a2a P b1f40e8672c549d3b4be7862ac07b7e2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.121286 25395 tablet_replica.cc:333] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.122004 25395 raft_consensus.cc:2243] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.123320 25395 raft_consensus.cc:2272] T 32c8792823e44557bace909d8b20d9eb P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.126238 25395 tablet_replica.cc:333] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.126977 25395 raft_consensus.cc:2243] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.127553 25395 raft_consensus.cc:2272] T 5ce4b86f29b4456dba024f24f29091e4 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.130395 25395 tablet_replica.cc:333] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.131165 25395 raft_consensus.cc:2243] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.131922 25395 raft_consensus.cc:2272] T 057c1e97d7fb407aaf9cf119a0b63a37 P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.135202 25395 tablet_replica.cc:333] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.135959 25395 raft_consensus.cc:2243] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.136976 25395 raft_consensus.cc:2272] T 9b74cbdc379342d4832425ebe52bbac5 P b1f40e8672c549d3b4be7862ac07b7e2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.140033 25395 tablet_replica.cc:333] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.140806 25395 raft_consensus.cc:2243] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.141440 25395 raft_consensus.cc:2272] T 66cd76ef163447878430c4633d13a427 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.144203 25395 tablet_replica.cc:333] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.144899 25395 raft_consensus.cc:2243] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.146242 25395 raft_consensus.cc:2272] T 9b1aac0e4d18474e899d9c60448999fc P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.149106 25395 tablet_replica.cc:333] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.149801 25395 raft_consensus.cc:2243] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.150398 25395 raft_consensus.cc:2272] T b0b9da52e1c04100a4d56d1cfce9e2a2 P b1f40e8672c549d3b4be7862ac07b7e2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.153102 25395 tablet_replica.cc:333] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.153862 25395 raft_consensus.cc:2243] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.155248 25395 raft_consensus.cc:2272] T 203b3a179cc240e6ac8beb1d95728111 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.158039 25395 tablet_replica.cc:333] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.158743 25395 raft_consensus.cc:2243] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.159916 25395 raft_consensus.cc:2272] T a78e2d37ffa144e9ae8e64979146f436 P b1f40e8672c549d3b4be7862ac07b7e2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.162715 25395 tablet_replica.cc:333] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.163373 25395 raft_consensus.cc:2243] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.164547 25395 raft_consensus.cc:2272] T 81721f0402d24cbfb7f52e0ba164247b P b1f40e8672c549d3b4be7862ac07b7e2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.167348 25395 tablet_replica.cc:333] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.168022 25395 raft_consensus.cc:2243] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.168563 25395 raft_consensus.cc:2272] T f6d05596fdb0401faeb202a1f8740d44 P b1f40e8672c549d3b4be7862ac07b7e2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.171108 25395 tablet_replica.cc:333] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.171802 25395 raft_consensus.cc:2243] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.173348 25395 raft_consensus.cc:2272] T 15ce1ae648ca45aba8c6efb73a35ae9e P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.176283 25395 tablet_replica.cc:333] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.176970 25395 raft_consensus.cc:2243] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.177596 25395 raft_consensus.cc:2272] T fa6a5d55926746d28b7b8b8862f40c10 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.180428 25395 tablet_replica.cc:333] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.181087 25395 raft_consensus.cc:2243] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.182453 25395 raft_consensus.cc:2272] T 9ecc61d0190444bea318620b6a278926 P b1f40e8672c549d3b4be7862ac07b7e2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.185072 25395 tablet_replica.cc:333] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2: stopping tablet replica
I20260709 13:12:18.185853 25395 raft_consensus.cc:2243] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.187090 25395 raft_consensus.cc:2272] T 8f3c8f39cbe14359a810de00ced87a46 P b1f40e8672c549d3b4be7862ac07b7e2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.530833 25395 tablet_server.cc:196] TabletServer@127.24.204.196:0 shutdown complete.
I20260709 13:12:18.619194 25395 master.cc:562] Master@127.24.204.254:32835 shutting down...
W20260709 13:12:18.659678 26456 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:12:18.659936 26456 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:18.660169 26456 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:28.500593 26392 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111) [suppressed 21 similar messages]
W20260709 13:12:28.504469 26392 catalog_manager.cc:4755] TS b9c3761688a64982ae1c4aeb758e09ef (127.24.204.193:37907): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7672ae1d65b4497686627cb041189424: Network error: Client connection negotiation failed: client connection to 127.24.204.193:37907: connect: Connection refused (error 111)
I20260709 13:12:29.563500 25395 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:29.564687 25395 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:29.565099 25395 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6b5d6a3be49c419aa4980b2ed2efd28a: stopping tablet replica
I20260709 13:12:29.835724 25395 master.cc:584] Master@127.24.204.254:32835 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (217604 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:12:29.961943 25395 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.204.254:46115
I20260709 13:12:29.963105 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:29.969178 32682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:29.970118 32683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:29.970307 32685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:29.970494 25395 server_base.cc:1061] running on GCE node
I20260709 13:12:29.973528 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:29.973853 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:29.974036 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602749974017 us; error 0 us; skew 500 ppm
I20260709 13:12:29.974498 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:29.976928 25395 webserver.cc:533] Webserver started at http://127.24.204.254:35207/ using document root <none> and password file <none>
I20260709 13:12:29.977377 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:29.977530 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:29.977836 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:29.979091 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/master-0-root/instance:
uuid: "1311245efbe54ea3ad91eedfd95a93ad"
format_stamp: "Formatted at 2026-07-09 13:12:29 on dist-test-slave-qv7r"
I20260709 13:12:29.983589 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:29.987116 32690 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:29.987888 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:29.988211 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/master-0-root
uuid: "1311245efbe54ea3ad91eedfd95a93ad"
format_stamp: "Formatted at 2026-07-09 13:12:29 on dist-test-slave-qv7r"
I20260709 13:12:29.988482 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:30.024681 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:30.026074 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:30.067305 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.254:46115
I20260709 13:12:30.067410 32741 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.254:46115 every 8 connection(s)
I20260709 13:12:30.071681 32742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.083493 32742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad: Bootstrap starting.
I20260709 13:12:30.088619 32742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.093242 32742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad: No bootstrap required, opened a new log
I20260709 13:12:30.095567 32742 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1311245efbe54ea3ad91eedfd95a93ad" member_type: VOTER }
I20260709 13:12:30.096033 32742 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.096297 32742 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1311245efbe54ea3ad91eedfd95a93ad, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.097004 32742 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1311245efbe54ea3ad91eedfd95a93ad" member_type: VOTER }
I20260709 13:12:30.097497 32742 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:30.097770 32742 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:30.098048 32742 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.103102 32742 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1311245efbe54ea3ad91eedfd95a93ad" member_type: VOTER }
I20260709 13:12:30.103678 32742 leader_election.cc:304] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1311245efbe54ea3ad91eedfd95a93ad; no voters: 
I20260709 13:12:30.104950 32742 leader_election.cc:290] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:30.105443 32745 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:30.106887 32745 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 1 LEADER]: Becoming Leader. State: Replica: 1311245efbe54ea3ad91eedfd95a93ad, State: Running, Role: LEADER
I20260709 13:12:30.107579 32745 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1311245efbe54ea3ad91eedfd95a93ad" member_type: VOTER }
I20260709 13:12:30.107918 32742 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:30.114493 32746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1311245efbe54ea3ad91eedfd95a93ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1311245efbe54ea3ad91eedfd95a93ad" member_type: VOTER } }
I20260709 13:12:30.114830 32747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1311245efbe54ea3ad91eedfd95a93ad. Latest consensus state: current_term: 1 leader_uuid: "1311245efbe54ea3ad91eedfd95a93ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1311245efbe54ea3ad91eedfd95a93ad" member_type: VOTER } }
I20260709 13:12:30.115497 32747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:30.115442 32746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:30.117729 32755 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:30.122632 32755 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:30.124215 25395 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:30.131979 32755 catalog_manager.cc:1383] Generated new cluster ID: 799de1e7c6c24d5b81fe8e3d58850920
I20260709 13:12:30.132278 32755 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:30.145074 32755 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:30.146477 32755 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:30.160373 32755 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad: Generated new TSK 0
I20260709 13:12:30.161011 32755 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:30.191416 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:30.198446 32763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:30.199903 32764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:30.201061 32766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:30.202555 25395 server_base.cc:1061] running on GCE node
I20260709 13:12:30.204767 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:30.204960 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:30.205174 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602750205134 us; error 0 us; skew 500 ppm
I20260709 13:12:30.205826 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:30.208431 25395 webserver.cc:533] Webserver started at http://127.24.204.193:35565/ using document root <none> and password file <none>
I20260709 13:12:30.208926 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:30.209081 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:30.209388 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:30.210695 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/instance:
uuid: "70c1750ca53a445883b66469ea339141"
format_stamp: "Formatted at 2026-07-09 13:12:30 on dist-test-slave-qv7r"
I20260709 13:12:30.215500 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:30.219419   303 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.220353 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:12:30.220665 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-0-root
uuid: "70c1750ca53a445883b66469ea339141"
format_stamp: "Formatted at 2026-07-09 13:12:30 on dist-test-slave-qv7r"
I20260709 13:12:30.221024 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:30.232825 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:30.234136 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:30.235592 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:30.238271 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:30.238487 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.238736 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:30.238925 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.284929 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.193:40765
I20260709 13:12:30.285060   365 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.193:40765 every 8 connection(s)
I20260709 13:12:30.289996 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:30.298429   370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:30.299427   371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:30.302418 25395 server_base.cc:1061] running on GCE node
W20260709 13:12:30.303218   373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:30.305181 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:30.305497 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:30.305917 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602750305892 us; error 0 us; skew 500 ppm
I20260709 13:12:30.306699 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:30.308521   366 heartbeater.cc:344] Connected to a master server at 127.24.204.254:46115
I20260709 13:12:30.308931   366 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:30.310029 25395 webserver.cc:533] Webserver started at http://127.24.204.194:43049/ using document root <none> and password file <none>
I20260709 13:12:30.310117   366 heartbeater.cc:507] Master 127.24.204.254:46115 requested a full tablet report, sending...
I20260709 13:12:30.310912 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:30.311214 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:30.311580 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:30.313091 32707 ts_manager.cc:194] Registered new tserver with Master: 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:30.313086 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/instance:
uuid: "7b79bd4dca614b218791c5293a51c7a9"
format_stamp: "Formatted at 2026-07-09 13:12:30 on dist-test-slave-qv7r"
I20260709 13:12:30.316119 32707 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52010
I20260709 13:12:30.320071 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:30.323901   378 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.324689 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:30.324996 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-1-root
uuid: "7b79bd4dca614b218791c5293a51c7a9"
format_stamp: "Formatted at 2026-07-09 13:12:30 on dist-test-slave-qv7r"
I20260709 13:12:30.325373 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:30.342607 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:30.343899 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:30.345418 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:30.347807 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:30.348026 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.348268 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:30.348433 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.393074 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.194:35023
I20260709 13:12:30.393190   440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.194:35023 every 8 connection(s)
I20260709 13:12:30.398254 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:30.406584   445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:30.406775   446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:30.410789   448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:30.410811 25395 server_base.cc:1061] running on GCE node
I20260709 13:12:30.411950   441 heartbeater.cc:344] Connected to a master server at 127.24.204.254:46115
I20260709 13:12:30.412376   441 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:30.412380 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:30.412835 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:30.413009 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602750412991 us; error 0 us; skew 500 ppm
I20260709 13:12:30.413386   441 heartbeater.cc:507] Master 127.24.204.254:46115 requested a full tablet report, sending...
I20260709 13:12:30.413703 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:30.415890 32707 ts_manager.cc:194] Registered new tserver with Master: 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:30.416662 25395 webserver.cc:533] Webserver started at http://127.24.204.195:46225/ using document root <none> and password file <none>
I20260709 13:12:30.417371 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:30.417626 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:30.417963 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:30.417893 32707 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52024
I20260709 13:12:30.419691 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/instance:
uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
format_stamp: "Formatted at 2026-07-09 13:12:30 on dist-test-slave-qv7r"
I20260709 13:12:30.424439 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 13:12:30.428232   453 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.429119 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:30.429464 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-2-root
uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
format_stamp: "Formatted at 2026-07-09 13:12:30 on dist-test-slave-qv7r"
I20260709 13:12:30.429811 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:30.447566 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:30.448894 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:30.450429 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:30.452649 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:30.452890 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.453121 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:30.453292 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.496768 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.195:39781
I20260709 13:12:30.496865   515 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.195:39781 every 8 connection(s)
I20260709 13:12:30.501896 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:30.509008   519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:30.510617   520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:30.513767   522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:30.514001 25395 server_base.cc:1061] running on GCE node
I20260709 13:12:30.514935   516 heartbeater.cc:344] Connected to a master server at 127.24.204.254:46115
I20260709 13:12:30.515093 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:30.515311   516 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:30.515424 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:30.515743 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602750515727 us; error 0 us; skew 500 ppm
I20260709 13:12:30.516285   516 heartbeater.cc:507] Master 127.24.204.254:46115 requested a full tablet report, sending...
I20260709 13:12:30.516376 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:30.518865 32707 ts_manager.cc:194] Registered new tserver with Master: c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:30.519352 25395 webserver.cc:533] Webserver started at http://127.24.204.196:45903/ using document root <none> and password file <none>
I20260709 13:12:30.519884 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:30.520089 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:30.520344 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:30.520421 32707 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52032
I20260709 13:12:30.521828 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-3-root/instance:
uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
format_stamp: "Formatted at 2026-07-09 13:12:30 on dist-test-slave-qv7r"
I20260709 13:12:30.526957 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:12:30.530808   527 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.531690 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:30.532013 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-3-root
uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
format_stamp: "Formatted at 2026-07-09 13:12:30 on dist-test-slave-qv7r"
I20260709 13:12:30.532274 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:30.553362 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:30.554744 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:30.556267 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:30.558959 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:30.559149 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.559430 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:30.559572 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:30.604009 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.196:42975
I20260709 13:12:30.604121   589 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.196:42975 every 8 connection(s)
I20260709 13:12:30.621385   590 heartbeater.cc:344] Connected to a master server at 127.24.204.254:46115
I20260709 13:12:30.622020   590 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:30.622941   590 heartbeater.cc:507] Master 127.24.204.254:46115 requested a full tablet report, sending...
I20260709 13:12:30.625180 32707 ts_manager.cc:194] Registered new tserver with Master: 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:30.626166 25395 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018746158s
I20260709 13:12:30.626801 32707 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52038
I20260709 13:12:30.660707 32707 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52044:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:12:30.931766   480 tablet_service.cc:1511] Processing CreateTablet for tablet 10ce075819b848f9849ae714b57964f7 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:30.933987   478 tablet_service.cc:1511] Processing CreateTablet for tablet effea88d8d284e51a4c8383f5da9fd83 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:30.934991   481 tablet_service.cc:1511] Processing CreateTablet for tablet 5142c450ae11440bac6ebd5b5ab35bba (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:30.931840   479 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4fea653b2e44fd87939ab040d317f6 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:30.933501   480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ce075819b848f9849ae714b57964f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.937939   477 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4f70da72b449609b0b4f28f6589ab3 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:30.939030   481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5142c450ae11440bac6ebd5b5ab35bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.939988   477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4f70da72b449609b0b4f28f6589ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.941735   476 tablet_service.cc:1511] Processing CreateTablet for tablet e4d7d71169d347a982bc81fce6e293f6 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:30.943210   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d7d71169d347a982bc81fce6e293f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.943842   331 tablet_service.cc:1511] Processing CreateTablet for tablet 5142c450ae11440bac6ebd5b5ab35bba (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:30.945335   331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5142c450ae11440bac6ebd5b5ab35bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.946278   330 tablet_service.cc:1511] Processing CreateTablet for tablet 10ce075819b848f9849ae714b57964f7 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:30.946943   326 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4f70da72b449609b0b4f28f6589ab3 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:30.948763   479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4fea653b2e44fd87939ab040d317f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.948897   329 tablet_service.cc:1511] Processing CreateTablet for tablet afc6d1809c204b7c8dbca7216cfc3121 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:30.951288   475 tablet_service.cc:1511] Processing CreateTablet for tablet 194e4343a7d94f87a19e28be0166a557 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:30.951488   328 tablet_service.cc:1511] Processing CreateTablet for tablet effea88d8d284e51a4c8383f5da9fd83 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:30.952446   478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effea88d8d284e51a4c8383f5da9fd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.953970   327 tablet_service.cc:1511] Processing CreateTablet for tablet e7b5dfaf74c940a19f58b2d439e6b768 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:30.955530   475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 194e4343a7d94f87a19e28be0166a557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.956429   474 tablet_service.cc:1511] Processing CreateTablet for tablet 7092bc27912f4ee0b10a1f261f38eac8 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:30.958063   474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7092bc27912f4ee0b10a1f261f38eac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.960474   325 tablet_service.cc:1511] Processing CreateTablet for tablet 194e4343a7d94f87a19e28be0166a557 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:30.963647   324 tablet_service.cc:1511] Processing CreateTablet for tablet c77cacfdc1e943a6ae75838391278350 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:30.965091   324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77cacfdc1e943a6ae75838391278350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.967581   325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 194e4343a7d94f87a19e28be0166a557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.967686   473 tablet_service.cc:1511] Processing CreateTablet for tablet e9d528fd921345acbfc657dc909148f0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:30.969369   473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9d528fd921345acbfc657dc909148f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.969942   330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ce075819b848f9849ae714b57964f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.970892   326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4f70da72b449609b0b4f28f6589ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.972568   329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc6d1809c204b7c8dbca7216cfc3121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.972697   323 tablet_service.cc:1511] Processing CreateTablet for tablet 7092bc27912f4ee0b10a1f261f38eac8 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:30.974328   323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7092bc27912f4ee0b10a1f261f38eac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.975693   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b5dfaf74c940a19f58b2d439e6b768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.976936   328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effea88d8d284e51a4c8383f5da9fd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.003127   322 tablet_service.cc:1511] Processing CreateTablet for tablet 644496fb7ce44dc3a989c54110d04525 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:31.004699   472 tablet_service.cc:1511] Processing CreateTablet for tablet 644496fb7ce44dc3a989c54110d04525 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:31.006131   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644496fb7ce44dc3a989c54110d04525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.004729   322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644496fb7ce44dc3a989c54110d04525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.020359   555 tablet_service.cc:1511] Processing CreateTablet for tablet 5142c450ae11440bac6ebd5b5ab35bba (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:31.022791   554 tablet_service.cc:1511] Processing CreateTablet for tablet afc6d1809c204b7c8dbca7216cfc3121 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:31.026854   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5142c450ae11440bac6ebd5b5ab35bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.027249   552 tablet_service.cc:1511] Processing CreateTablet for tablet e7b5dfaf74c940a19f58b2d439e6b768 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:31.028064   553 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4fea653b2e44fd87939ab040d317f6 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:31.029518   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc6d1809c204b7c8dbca7216cfc3121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.033368   550 tablet_service.cc:1511] Processing CreateTablet for tablet e4d7d71169d347a982bc81fce6e293f6 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:31.036499   551 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4f70da72b449609b0b4f28f6589ab3 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:31.039623   547 tablet_service.cc:1511] Processing CreateTablet for tablet e9d528fd921345acbfc657dc909148f0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:31.041996   546 tablet_service.cc:1511] Processing CreateTablet for tablet 72cfaa775c3b4fb2a7756d6042ab17b9 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:31.043867   549 tablet_service.cc:1511] Processing CreateTablet for tablet c77cacfdc1e943a6ae75838391278350 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:31.029891   548 tablet_service.cc:1511] Processing CreateTablet for tablet 7092bc27912f4ee0b10a1f261f38eac8 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:31.046574   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4fea653b2e44fd87939ab040d317f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.048213   480 tablet_service.cc:1511] Processing CreateTablet for tablet 35552e87ca5c49fe9e0b3b38ddbe0d0a (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:31.050474   480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35552e87ca5c49fe9e0b3b38ddbe0d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.054092   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d7d71169d347a982bc81fce6e293f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.056559   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7092bc27912f4ee0b10a1f261f38eac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.062047   546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72cfaa775c3b4fb2a7756d6042ab17b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.067118   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77cacfdc1e943a6ae75838391278350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.070070   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4f70da72b449609b0b4f28f6589ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.074040   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b5dfaf74c940a19f58b2d439e6b768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.078091   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9d528fd921345acbfc657dc909148f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.099361   331 tablet_service.cc:1511] Processing CreateTablet for tablet 72cfaa775c3b4fb2a7756d6042ab17b9 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:31.102556   481 tablet_service.cc:1511] Processing CreateTablet for tablet bf5a50bacfa64214acf10104084bb1be (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:31.110478   481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5a50bacfa64214acf10104084bb1be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:31.119674 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:31.120471   323 tablet_service.cc:1511] Processing CreateTablet for tablet 35552e87ca5c49fe9e0b3b38ddbe0d0a (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:31.120945   331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72cfaa775c3b4fb2a7756d6042ab17b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.137969   323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35552e87ca5c49fe9e0b3b38ddbe0d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.151389   327 tablet_service.cc:1511] Processing CreateTablet for tablet 94e4b48b4e2f471e99335ac86c36167f (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:31.152895   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e4b48b4e2f471e99335ac86c36167f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.167297   611 tablet_bootstrap.cc:492] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:31.174386   476 tablet_service.cc:1511] Processing CreateTablet for tablet 94e4b48b4e2f471e99335ac86c36167f (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:31.175879   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e4b48b4e2f471e99335ac86c36167f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.181228   406 tablet_service.cc:1511] Processing CreateTablet for tablet 10ce075819b848f9849ae714b57964f7 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:31.182932   406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ce075819b848f9849ae714b57964f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.187814   404 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4fea653b2e44fd87939ab040d317f6 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:31.188776   399 tablet_service.cc:1511] Processing CreateTablet for tablet c77cacfdc1e943a6ae75838391278350 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:31.191460   400 tablet_service.cc:1511] Processing CreateTablet for tablet 194e4343a7d94f87a19e28be0166a557 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:31.196885   401 tablet_service.cc:1511] Processing CreateTablet for tablet e4d7d71169d347a982bc81fce6e293f6 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:31.196993   402 tablet_service.cc:1511] Processing CreateTablet for tablet e7b5dfaf74c940a19f58b2d439e6b768 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:31.196995   403 tablet_service.cc:1511] Processing CreateTablet for tablet effea88d8d284e51a4c8383f5da9fd83 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:31.198814   398 tablet_service.cc:1511] Processing CreateTablet for tablet e9d528fd921345acbfc657dc909148f0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:31.199311   404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4fea653b2e44fd87939ab040d317f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.200160   402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b5dfaf74c940a19f58b2d439e6b768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.200824   400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 194e4343a7d94f87a19e28be0166a557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.201475   403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effea88d8d284e51a4c8383f5da9fd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.200846   397 tablet_service.cc:1511] Processing CreateTablet for tablet 644496fb7ce44dc3a989c54110d04525 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:31.204249   397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644496fb7ce44dc3a989c54110d04525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.210070   401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d7d71169d347a982bc81fce6e293f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.210566   328 tablet_service.cc:1511] Processing CreateTablet for tablet 208e3c5b595545858696a33f8e73deab (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:31.211712   399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77cacfdc1e943a6ae75838391278350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.211887   328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208e3c5b595545858696a33f8e73deab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.196993   405 tablet_service.cc:1511] Processing CreateTablet for tablet afc6d1809c204b7c8dbca7216cfc3121 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:31.214566   405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc6d1809c204b7c8dbca7216cfc3121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.217939   398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9d528fd921345acbfc657dc909148f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.221817   473 tablet_service.cc:1511] Processing CreateTablet for tablet 76a48b926a8e43f98d19342830ebc360 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:31.223345   473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a48b926a8e43f98d19342830ebc360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.228979   610 tablet_bootstrap.cc:492] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:31.226053   611 tablet_bootstrap.cc:654] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.235000   326 tablet_service.cc:1511] Processing CreateTablet for tablet 76a48b926a8e43f98d19342830ebc360 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:31.236404   326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a48b926a8e43f98d19342830ebc360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.245102   551 tablet_service.cc:1511] Processing CreateTablet for tablet 35552e87ca5c49fe9e0b3b38ddbe0d0a (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:31.246564   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35552e87ca5c49fe9e0b3b38ddbe0d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.250680   477 tablet_service.cc:1511] Processing CreateTablet for tablet 29bdd222276f45d0b94756421060da52 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:31.252230   477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29bdd222276f45d0b94756421060da52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.258787   548 tablet_service.cc:1511] Processing CreateTablet for tablet bf5a50bacfa64214acf10104084bb1be (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:31.260289   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5a50bacfa64214acf10104084bb1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.275342   324 tablet_service.cc:1511] Processing CreateTablet for tablet 31cf36e914b5401f9584db0b92dd2591 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:31.276822   324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31cf36e914b5401f9584db0b92dd2591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.277403   611 tablet_bootstrap.cc:492] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:31.278038   611 ts_tablet_manager.cc:1403] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.000s
I20260709 13:12:31.296741   553 tablet_service.cc:1511] Processing CreateTablet for tablet 208e3c5b595545858696a33f8e73deab (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:31.296649   472 tablet_service.cc:1511] Processing CreateTablet for tablet 31cf36e914b5401f9584db0b92dd2591 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:31.281379   611 raft_consensus.cc:359] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:31.298249   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31cf36e914b5401f9584db0b92dd2591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.298275   611 raft_consensus.cc:385] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.300621   611 raft_consensus.cc:740] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.301623   611 consensus_queue.cc:260] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:31.313334   550 tablet_service.cc:1511] Processing CreateTablet for tablet 76a48b926a8e43f98d19342830ebc360 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:31.313783   327 tablet_service.cc:1511] Processing CreateTablet for tablet 82e165c0d45844da9b680b461c2b5493 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:31.314740   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a48b926a8e43f98d19342830ebc360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.314978   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e165c0d45844da9b680b461c2b5493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.319525   366 heartbeater.cc:499] Master 127.24.204.254:46115 was elected leader, sending a full tablet report...
I20260709 13:12:31.321995   330 tablet_service.cc:1511] Processing CreateTablet for tablet c447d7bc00cf4281a661063406c070ee (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:31.323351   330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c447d7bc00cf4281a661063406c070ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.314858   610 tablet_bootstrap.cc:654] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.328820   476 tablet_service.cc:1511] Processing CreateTablet for tablet c447d7bc00cf4281a661063406c070ee (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:31.350281   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208e3c5b595545858696a33f8e73deab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.351058   554 tablet_service.cc:1511] Processing CreateTablet for tablet 82e165c0d45844da9b680b461c2b5493 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:31.352514   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e165c0d45844da9b680b461c2b5493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.353850   555 tablet_service.cc:1511] Processing CreateTablet for tablet 29bdd222276f45d0b94756421060da52 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:31.355140   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29bdd222276f45d0b94756421060da52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.330611   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c447d7bc00cf4281a661063406c070ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.361728   615 tablet_bootstrap.cc:492] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:31.362215   406 tablet_service.cc:1511] Processing CreateTablet for tablet 94e4b48b4e2f471e99335ac86c36167f (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:31.363744   406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e4b48b4e2f471e99335ac86c36167f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.374698   401 tablet_service.cc:1511] Processing CreateTablet for tablet bf5a50bacfa64214acf10104084bb1be (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:31.376121   401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5a50bacfa64214acf10104084bb1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.378175   397 tablet_service.cc:1511] Processing CreateTablet for tablet 72cfaa775c3b4fb2a7756d6042ab17b9 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:31.379603   397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72cfaa775c3b4fb2a7756d6042ab17b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:31.404479 32693 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 54026us
I20260709 13:12:31.405661   611 ts_tablet_manager.cc:1434] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.127s	user 0.032s	sys 0.019s
I20260709 13:12:31.406729   611 tablet_bootstrap.cc:492] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:31.407944   403 tablet_service.cc:1511] Processing CreateTablet for tablet 29bdd222276f45d0b94756421060da52 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:31.409333   403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29bdd222276f45d0b94756421060da52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.413460   611 tablet_bootstrap.cc:654] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.415737   612 tablet_bootstrap.cc:492] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:31.416219   402 tablet_service.cc:1511] Processing CreateTablet for tablet 31cf36e914b5401f9584db0b92dd2591 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:31.418146   402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31cf36e914b5401f9584db0b92dd2591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.421067   441 heartbeater.cc:499] Master 127.24.204.254:46115 was elected leader, sending a full tablet report...
I20260709 13:12:31.421504   405 tablet_service.cc:1511] Processing CreateTablet for tablet 82e165c0d45844da9b680b461c2b5493 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 13:12:31.436014 32694 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 43911.7us
I20260709 13:12:31.436699   404 tablet_service.cc:1511] Processing CreateTablet for tablet 208e3c5b595545858696a33f8e73deab (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:31.452869   547 tablet_service.cc:1511] Processing CreateTablet for tablet c447d7bc00cf4281a661063406c070ee (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:31.454288   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c447d7bc00cf4281a661063406c070ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.456123   614 raft_consensus.cc:493] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.449973   405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e165c0d45844da9b680b461c2b5493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.457258   614 raft_consensus.cc:515] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:31.462184   610 tablet_bootstrap.cc:492] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:31.462776   610 ts_tablet_manager.cc:1403] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.234s	user 0.011s	sys 0.009s
I20260709 13:12:31.463464   404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208e3c5b595545858696a33f8e73deab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.465636   399 tablet_service.cc:1511] Processing CreateTablet for tablet 2088f3e2e60a40348ddbae342c78941b (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:31.467010   399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2088f3e2e60a40348ddbae342c78941b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.468477   614 leader_election.cc:290] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:31.466117   610 raft_consensus.cc:359] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:31.505082   610 raft_consensus.cc:385] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.505492   610 raft_consensus.cc:740] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.520610   610 consensus_queue.cc:260] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:31.523339   516 heartbeater.cc:499] Master 127.24.204.254:46115 was elected leader, sending a full tablet report...
I20260709 13:12:31.536882   612 tablet_bootstrap.cc:654] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:31.544207   367 tablet.cc:2406] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:31.545544   611 tablet_bootstrap.cc:492] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:31.548424   473 tablet_service.cc:1511] Processing CreateTablet for tablet 2088f3e2e60a40348ddbae342c78941b (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:31.550063   473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2088f3e2e60a40348ddbae342c78941b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.561093   550 tablet_service.cc:1511] Processing CreateTablet for tablet 2088f3e2e60a40348ddbae342c78941b (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:31.562642   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2088f3e2e60a40348ddbae342c78941b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.564296   611 ts_tablet_manager.cc:1403] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.158s	user 0.025s	sys 0.020s
I20260709 13:12:31.567974   611 raft_consensus.cc:359] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:31.568813   611 raft_consensus.cc:385] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.569154   611 raft_consensus.cc:740] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.572873   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5142c450ae11440bac6ebd5b5ab35bba" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:31.573201   401 tablet_service.cc:1511] Processing CreateTablet for tablet b30b99a7946e406280df3352194e0545 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 13:12:31.574764   304 leader_election.cc:343] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.574868   401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30b99a7946e406280df3352194e0545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.575218   476 tablet_service.cc:1511] Processing CreateTablet for tablet b30b99a7946e406280df3352194e0545 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:31.576649   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30b99a7946e406280df3352194e0545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.578495   610 ts_tablet_manager.cc:1434] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.115s	user 0.007s	sys 0.001s
I20260709 13:12:31.579733   610 tablet_bootstrap.cc:492] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:31.585479   330 tablet_service.cc:1511] Processing CreateTablet for tablet b30b99a7946e406280df3352194e0545 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:31.587074   330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30b99a7946e406280df3352194e0545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.592077   555 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0cb63fe6b54741b53e72257d8eea82 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:31.593498   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0cb63fe6b54741b53e72257d8eea82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.605592   615 tablet_bootstrap.cc:654] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.605046   611 consensus_queue.cc:260] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:31.606551   327 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0cb63fe6b54741b53e72257d8eea82 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:31.607714   611 ts_tablet_manager.cc:1434] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:12:31.607980   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0cb63fe6b54741b53e72257d8eea82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.608769   611 tablet_bootstrap.cc:492] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:31.613776   397 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0cb63fe6b54741b53e72257d8eea82 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:31.615118   397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0cb63fe6b54741b53e72257d8eea82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.621599   472 tablet_service.cc:1511] Processing CreateTablet for tablet 55312d46dd4747c0bacb0d980ca208b1 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:31.623530   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55312d46dd4747c0bacb0d980ca208b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.630268   590 heartbeater.cc:499] Master 127.24.204.254:46115 was elected leader, sending a full tablet report...
I20260709 13:12:31.642355   610 tablet_bootstrap.cc:654] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.655680   614 raft_consensus.cc:493] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.656381   614 raft_consensus.cc:515] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:31.661551   614 leader_election.cc:290] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:31.668272   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5142c450ae11440bac6ebd5b5ab35bba" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:31.668300   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b5dfaf74c940a19f58b2d439e6b768" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:31.670807   307 leader_election.cc:343] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.671440   307 leader_election.cc:304] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
W20260709 13:12:31.672971   307 leader_election.cc:343] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.674484   614 raft_consensus.cc:2749] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:31.683406   612 tablet_bootstrap.cc:492] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:31.684001   612 ts_tablet_manager.cc:1403] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.269s	user 0.010s	sys 0.009s
I20260709 13:12:31.684291   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b5dfaf74c940a19f58b2d439e6b768" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
W20260709 13:12:31.686292   306 leader_election.cc:343] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.686777   306 leader_election.cc:304] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:31.687621   614 raft_consensus.cc:2749] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:31.688239   612 raft_consensus.cc:359] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:31.688964   612 raft_consensus.cc:385] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.689231   612 raft_consensus.cc:740] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.691641   550 tablet_service.cc:1511] Processing CreateTablet for tablet 55312d46dd4747c0bacb0d980ca208b1 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:31.693133   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55312d46dd4747c0bacb0d980ca208b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.694728   324 tablet_service.cc:1511] Processing CreateTablet for tablet 55312d46dd4747c0bacb0d980ca208b1 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:31.696048   324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55312d46dd4747c0bacb0d980ca208b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.702836   403 tablet_service.cc:1511] Processing CreateTablet for tablet 40791a3fd5f24fcc97260df7cb88f115 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:31.704286   403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40791a3fd5f24fcc97260df7cb88f115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.710899   472 tablet_service.cc:1511] Processing CreateTablet for tablet 40791a3fd5f24fcc97260df7cb88f115 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:31.711066   328 tablet_service.cc:1511] Processing CreateTablet for tablet d4ea2fc89ca344de86b1026038aa08bb (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:31.712252   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40791a3fd5f24fcc97260df7cb88f115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.712459   328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ea2fc89ca344de86b1026038aa08bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.711465   615 tablet_bootstrap.cc:492] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:31.713987   615 ts_tablet_manager.cc:1403] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.353s	user 0.012s	sys 0.019s
I20260709 13:12:31.714545   547 tablet_service.cc:1511] Processing CreateTablet for tablet 40791a3fd5f24fcc97260df7cb88f115 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:31.715842   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40791a3fd5f24fcc97260df7cb88f115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.717293   615 raft_consensus.cc:359] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:31.723436   615 raft_consensus.cc:385] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.723839   615 raft_consensus.cc:740] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.724948   615 consensus_queue.cc:260] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:31.734328   610 tablet_bootstrap.cc:492] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:31.734982   610 ts_tablet_manager.cc:1403] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.155s	user 0.019s	sys 0.027s
I20260709 13:12:31.738894   611 tablet_bootstrap.cc:654] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.739006   610 raft_consensus.cc:359] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:31.740053   610 raft_consensus.cc:385] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.740423   610 raft_consensus.cc:740] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.741255   610 consensus_queue.cc:260] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:31.745641   615 ts_tablet_manager.cc:1434] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:12:31.748395   612 consensus_queue.cc:260] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:31.749133   405 tablet_service.cc:1511] Processing CreateTablet for tablet d4ea2fc89ca344de86b1026038aa08bb (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:31.762641   610 ts_tablet_manager.cc:1434] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:12:31.766360   610 tablet_bootstrap.cc:492] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:31.763453   405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ea2fc89ca344de86b1026038aa08bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.773353   555 tablet_service.cc:1511] Processing CreateTablet for tablet e86d3a0eaf524c18ab308eb7803263f0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:31.775599   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e86d3a0eaf524c18ab308eb7803263f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.773830   328 tablet_service.cc:1511] Processing CreateTablet for tablet e86d3a0eaf524c18ab308eb7803263f0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:31.779414   328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e86d3a0eaf524c18ab308eb7803263f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.774284   615 tablet_bootstrap.cc:492] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:31.795145   473 tablet_service.cc:1511] Processing CreateTablet for tablet d4ea2fc89ca344de86b1026038aa08bb (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:31.806916   473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ea2fc89ca344de86b1026038aa08bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.804071   397 tablet_service.cc:1511] Processing CreateTablet for tablet e86d3a0eaf524c18ab308eb7803263f0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:31.804373   472 tablet_service.cc:1511] Processing CreateTablet for tablet 81d8c817825941bdb7e7435a4be4be3e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:31.801012   615 tablet_bootstrap.cc:654] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.810806   547 tablet_service.cc:1511] Processing CreateTablet for tablet 81d8c817825941bdb7e7435a4be4be3e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:31.812497   397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e86d3a0eaf524c18ab308eb7803263f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.812265   327 tablet_service.cc:1511] Processing CreateTablet for tablet 81d8c817825941bdb7e7435a4be4be3e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:31.814993   403 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1d975e40654d90b138939a2c9bc659 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:31.817584   550 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1d975e40654d90b138939a2c9bc659 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:31.821442   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d8c817825941bdb7e7435a4be4be3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.823822   403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1d975e40654d90b138939a2c9bc659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.826668   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d8c817825941bdb7e7435a4be4be3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.827834   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d8c817825941bdb7e7435a4be4be3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.832710   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1d975e40654d90b138939a2c9bc659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.846776   612 ts_tablet_manager.cc:1434] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.162s	user 0.015s	sys 0.033s
I20260709 13:12:31.854816   612 tablet_bootstrap.cc:492] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:31.866981   476 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1d975e40654d90b138939a2c9bc659 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:31.876576   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1d975e40654d90b138939a2c9bc659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.885025   397 tablet_service.cc:1511] Processing CreateTablet for tablet da508793a0e245b98ec5b5cb69dc3b78 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:31.889043   615 tablet_bootstrap.cc:492] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:31.889708   615 ts_tablet_manager.cc:1403] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.116s	user 0.036s	sys 0.022s
I20260709 13:12:31.890496   397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da508793a0e245b98ec5b5cb69dc3b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.891114   611 tablet_bootstrap.cc:492] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:31.891702   611 ts_tablet_manager.cc:1403] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.283s	user 0.006s	sys 0.016s
I20260709 13:12:31.893270   477 tablet_service.cc:1511] Processing CreateTablet for tablet da508793a0e245b98ec5b5cb69dc3b78 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:31.894670   477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da508793a0e245b98ec5b5cb69dc3b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.895416   611 raft_consensus.cc:359] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:31.896298   611 raft_consensus.cc:385] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.896633   611 raft_consensus.cc:740] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.899565   328 tablet_service.cc:1511] Processing CreateTablet for tablet da508793a0e245b98ec5b5cb69dc3b78 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:31.900422   555 tablet_service.cc:1511] Processing CreateTablet for tablet ee683cad470a4e5389da6f91a92664a4 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:31.901057   328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da508793a0e245b98ec5b5cb69dc3b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.901684   612 tablet_bootstrap.cc:654] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.903215   615 raft_consensus.cc:359] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:31.903986   615 raft_consensus.cc:385] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.904286   615 raft_consensus.cc:740] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.905064   615 consensus_queue.cc:260] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:31.907460   615 ts_tablet_manager.cc:1434] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:31.908537   615 tablet_bootstrap.cc:492] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:31.897547   611 consensus_queue.cc:260] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:31.912947   611 ts_tablet_manager.cc:1434] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:12:31.901727   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee683cad470a4e5389da6f91a92664a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.914214   611 tablet_bootstrap.cc:492] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:31.921118   404 tablet_service.cc:1511] Processing CreateTablet for tablet ee683cad470a4e5389da6f91a92664a4 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:31.949493   615 tablet_bootstrap.cc:654] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.949724   403 tablet_service.cc:1511] Processing CreateTablet for tablet c8b138e8469b435e9f167c96d962a892 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:31.950448   404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee683cad470a4e5389da6f91a92664a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.926412   476 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb8ccdeec5247b58ff52a64999af132 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:31.953910   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb8ccdeec5247b58ff52a64999af132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.941633   324 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb8ccdeec5247b58ff52a64999af132 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:31.925400   554 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb8ccdeec5247b58ff52a64999af132 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:31.947611   620 raft_consensus.cc:493] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.938794   610 tablet_bootstrap.cc:654] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.929309   327 tablet_service.cc:1511] Processing CreateTablet for tablet ee683cad470a4e5389da6f91a92664a4 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:31.955473   324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb8ccdeec5247b58ff52a64999af132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.965955   620 raft_consensus.cc:515] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:31.969151   611 tablet_bootstrap.cc:654] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.961380   477 tablet_service.cc:1511] Processing CreateTablet for tablet c8b138e8469b435e9f167c96d962a892 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:31.972180   612 tablet_bootstrap.cc:492] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:31.952921   403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b138e8469b435e9f167c96d962a892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.973454   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb8ccdeec5247b58ff52a64999af132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.988400   330 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc4b123ed2a46788fa7fbb6effdff5e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:31.990332   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee683cad470a4e5389da6f91a92664a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.991808   405 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc4b123ed2a46788fa7fbb6effdff5e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:31.994186   330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc4b123ed2a46788fa7fbb6effdff5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.994814   477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b138e8469b435e9f167c96d962a892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.995533   555 tablet_service.cc:1511] Processing CreateTablet for tablet c8b138e8469b435e9f167c96d962a892 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:32.001910   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b138e8469b435e9f167c96d962a892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.005702   405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc4b123ed2a46788fa7fbb6effdff5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.977614   620 leader_election.cc:290] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:32.018067   620 raft_consensus.cc:493] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.018656   620 raft_consensus.cc:515] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.020387   615 tablet_bootstrap.cc:492] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:32.021027   615 ts_tablet_manager.cc:1403] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.113s	user 0.022s	sys 0.011s
I20260709 13:12:32.023547   612 ts_tablet_manager.cc:1403] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.002s
I20260709 13:12:32.025105   615 raft_consensus.cc:359] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.026087   615 raft_consensus.cc:385] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.026608   615 raft_consensus.cc:740] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.032101   615 consensus_queue.cc:260] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.037456   550 tablet_service.cc:1511] Processing CreateTablet for tablet ac98fcdb54dc49569e1bed91b70763d6 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:32.038924   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac98fcdb54dc49569e1bed91b70763d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.041319   615 ts_tablet_manager.cc:1434] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 13:12:32.042690   615 tablet_bootstrap.cc:492] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:32.043041   614 raft_consensus.cc:493] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.043552   614 raft_consensus.cc:515] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.045855   614 leader_election.cc:290] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:32.049499   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092bc27912f4ee0b10a1f261f38eac8" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:32.051419   307 leader_election.cc:343] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.052901   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092bc27912f4ee0b10a1f261f38eac8" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:32.052353   615 tablet_bootstrap.cc:654] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:32.054920   304 leader_election.cc:343] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.055450   304 leader_election.cc:304] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:32.056804   614 raft_consensus.cc:2749] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.058367   612 raft_consensus.cc:359] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.059172   612 raft_consensus.cc:385] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.059491   612 raft_consensus.cc:740] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.059725   611 tablet_bootstrap.cc:492] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:32.032449   620 leader_election.cc:290] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:32.060628   611 ts_tablet_manager.cc:1403] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.147s	user 0.013s	sys 0.004s
I20260709 13:12:32.060333   612 consensus_queue.cc:260] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.070832   612 ts_tablet_manager.cc:1434] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:12:32.076826   326 tablet_service.cc:1511] Processing CreateTablet for tablet ac98fcdb54dc49569e1bed91b70763d6 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:32.078328   326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac98fcdb54dc49569e1bed91b70763d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.065147   611 raft_consensus.cc:359] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.090008   611 raft_consensus.cc:385] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.090536   611 raft_consensus.cc:740] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.096786   404 tablet_service.cc:1511] Processing CreateTablet for tablet ac98fcdb54dc49569e1bed91b70763d6 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:32.097381   610 tablet_bootstrap.cc:492] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:32.097903   610 ts_tablet_manager.cc:1403] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.332s	user 0.045s	sys 0.020s
I20260709 13:12:32.098227   404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac98fcdb54dc49569e1bed91b70763d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.099300   612 tablet_bootstrap.cc:492] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:32.101271   610 raft_consensus.cc:359] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.102078   610 raft_consensus.cc:385] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.102375   610 raft_consensus.cc:740] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.103163   610 consensus_queue.cc:260] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.105484   610 ts_tablet_manager.cc:1434] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:32.106246   612 tablet_bootstrap.cc:654] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.106827   610 tablet_bootstrap.cc:492] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
W20260709 13:12:32.122236 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:32.127836   554 tablet_service.cc:1511] Processing CreateTablet for tablet 8879df9852da4e428d5432830c645ea9 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:32.129328   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8879df9852da4e428d5432830c645ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.131723   611 consensus_queue.cc:260] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.134058   611 ts_tablet_manager.cc:1434] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.001s
I20260709 13:12:32.135110   611 tablet_bootstrap.cc:492] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:32.130836   610 tablet_bootstrap.cc:654] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.130846   612 tablet_bootstrap.cc:492] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:32.138077   612 ts_tablet_manager.cc:1403] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 13:12:32.141331   612 raft_consensus.cc:359] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.142119   612 raft_consensus.cc:385] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.142416   612 raft_consensus.cc:740] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.154132   615 tablet_bootstrap.cc:492] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:32.154808   615 ts_tablet_manager.cc:1403] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.025s
I20260709 13:12:32.157004   612 consensus_queue.cc:260] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.158972   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d528fd921345acbfc657dc909148f0" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:32.160218   612 ts_tablet_manager.cc:1434] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:12:32.161942   626 raft_consensus.cc:493] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:32.162302   457 leader_election.cc:343] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.162562   626 raft_consensus.cc:515] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.161604   612 tablet_bootstrap.cc:492] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:32.174292   404 tablet_service.cc:1511] Processing CreateTablet for tablet fb22622dd6074222841290f4d737acf2 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:32.180229   404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb22622dd6074222841290f4d737acf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.186009   626 leader_election.cc:290] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:32.190389   615 raft_consensus.cc:359] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.191260   615 raft_consensus.cc:385] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.191557   615 raft_consensus.cc:740] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.192310   615 consensus_queue.cc:260] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.195909   615 ts_tablet_manager.cc:1434] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.005s
I20260709 13:12:32.198733   611 tablet_bootstrap.cc:654] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.198817   615 tablet_bootstrap.cc:492] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:32.206959   477 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc4b123ed2a46788fa7fbb6effdff5e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:32.208851   477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc4b123ed2a46788fa7fbb6effdff5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.210131   624 raft_consensus.cc:493] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.210794   624 raft_consensus.cc:515] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.216194   624 leader_election.cc:290] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:32.224502   615 tablet_bootstrap.cc:654] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.239118   476 tablet_service.cc:1511] Processing CreateTablet for tablet 8879df9852da4e428d5432830c645ea9 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:32.240664   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8879df9852da4e428d5432830c645ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.241515   614 raft_consensus.cc:493] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.244062   614 raft_consensus.cc:515] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.246523   614 leader_election.cc:290] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:32.253736   550 tablet_service.cc:1511] Processing CreateTablet for tablet fb22622dd6074222841290f4d737acf2 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:32.254323   610 tablet_bootstrap.cc:492] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:32.254880   610 ts_tablet_manager.cc:1403] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.148s	user 0.036s	sys 0.043s
I20260709 13:12:32.255259   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb22622dd6074222841290f4d737acf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.256295   620 raft_consensus.cc:493] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.256471   612 tablet_bootstrap.cc:654] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.256901   620 raft_consensus.cc:515] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.259203   620 leader_election.cc:290] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:32.261659   403 tablet_service.cc:1511] Processing CreateTablet for tablet 218260d1606649edb1f8c91d1392ed7f (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:32.262384   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5142c450ae11440bac6ebd5b5ab35bba" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:32.270320   403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218260d1606649edb1f8c91d1392ed7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.270603   473 tablet_service.cc:1511] Processing CreateTablet for tablet fb22622dd6074222841290f4d737acf2 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:32.272104   473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb22622dd6074222841290f4d737acf2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:32.274152   457 leader_election.cc:343] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.277468   611 tablet_bootstrap.cc:492] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:32.278103   611 ts_tablet_manager.cc:1403] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.008s
I20260709 13:12:32.278455   610 raft_consensus.cc:359] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.279501   610 raft_consensus.cc:385] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.279903   610 raft_consensus.cc:740] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.287379   611 raft_consensus.cc:359] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.288259   626 raft_consensus.cc:493] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.288695   611 raft_consensus.cc:385] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.288899   626 raft_consensus.cc:515] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.289410   611 raft_consensus.cc:740] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.290894   611 consensus_queue.cc:260] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.280968   610 consensus_queue.cc:260] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.306211   626 leader_election.cc:290] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:32.306497   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ce075819b848f9849ae714b57964f7" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:32.307240   416 raft_consensus.cc:2468] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:32.307947   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:32.308507   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d528fd921345acbfc657dc909148f0" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:32.314109   456 leader_election.cc:304] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:32.323632   630 raft_consensus.cc:2804] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.324235   630 raft_consensus.cc:493] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.324637   630 raft_consensus.cc:3060] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.325024   610 ts_tablet_manager.cc:1434] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 13:12:32.326318   610 tablet_bootstrap.cc:492] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
W20260709 13:12:32.329950   304 leader_election.cc:343] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.315097   624 raft_consensus.cc:493] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.331380   624 raft_consensus.cc:515] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.317034   611 ts_tablet_manager.cc:1434] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.002s
W20260709 13:12:32.315868   456 leader_election.cc:343] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.334509   456 leader_election.cc:304] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:32.323685   472 tablet_service.cc:1511] Processing CreateTablet for tablet 218260d1606649edb1f8c91d1392ed7f (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:32.336596   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218260d1606649edb1f8c91d1392ed7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.337759   620 raft_consensus.cc:2749] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.340304   611 tablet_bootstrap.cc:492] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:32.348148   555 tablet_service.cc:1511] Processing CreateTablet for tablet 11cc376e2d944e4cab791e761af1be67 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:32.348668   405 tablet_service.cc:1511] Processing CreateTablet for tablet 11cc376e2d944e4cab791e761af1be67 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:32.353982   326 tablet_service.cc:1511] Processing CreateTablet for tablet 8879df9852da4e428d5432830c645ea9 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:32.354624   327 tablet_service.cc:1511] Processing CreateTablet for tablet 218260d1606649edb1f8c91d1392ed7f (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:32.358268   624 leader_election.cc:290] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:32.368187   624 raft_consensus.cc:493] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.369125   547 tablet_service.cc:1511] Processing CreateTablet for tablet c2b68afdb4a44c419ac582ebc689ecf0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:32.373878   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218260d1606649edb1f8c91d1392ed7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.368007   328 tablet_service.cc:1511] Processing CreateTablet for tablet 11cc376e2d944e4cab791e761af1be67 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:32.368937   624 raft_consensus.cc:515] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.395557   326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8879df9852da4e428d5432830c645ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.399766   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ce075819b848f9849ae714b57964f7" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:32.401247   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:32.408598   340 raft_consensus.cc:2468] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:32.408843   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc6d1809c204b7c8dbca7216cfc3121" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:32.401492   405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11cc376e2d944e4cab791e761af1be67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.410115   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092bc27912f4ee0b10a1f261f38eac8" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:32.410908   338 raft_consensus.cc:2468] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:32.413113   530 leader_election.cc:304] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:12:32.414206   626 raft_consensus.cc:2804] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.414485   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b68afdb4a44c419ac582ebc689ecf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.414609   626 raft_consensus.cc:493] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.415290   626 raft_consensus.cc:3060] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.419132   328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11cc376e2d944e4cab791e761af1be67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.421459   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11cc376e2d944e4cab791e761af1be67. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:32.423173   530 leader_election.cc:343] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.425184   626 raft_consensus.cc:515] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.428764   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092bc27912f4ee0b10a1f261f38eac8" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:32.429056   624 leader_election.cc:290] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:32.429503   339 raft_consensus.cc:3060] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.435873   476 tablet_service.cc:1511] Processing CreateTablet for tablet 1d62ccb3929543488daa15130eed287a (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:32.437506   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d62ccb3929543488daa15130eed287a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.437747   624 raft_consensus.cc:493] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.438621   624 raft_consensus.cc:515] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.439960   397 tablet_service.cc:1511] Processing CreateTablet for tablet 1d62ccb3929543488daa15130eed287a (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:32.447623   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d7d71169d347a982bc81fce6e293f6" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:32.449728   382 leader_election.cc:343] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.451261   339 raft_consensus.cc:2468] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:32.452845   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5142c450ae11440bac6ebd5b5ab35bba" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:32.452744   330 tablet_service.cc:1511] Processing CreateTablet for tablet c2b68afdb4a44c419ac582ebc689ecf0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:32.453132   530 leader_election.cc:304] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:12:32.453689   340 raft_consensus.cc:2468] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:32.454258   330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b68afdb4a44c419ac582ebc689ecf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.454929   456 leader_election.cc:304] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:32.456338   620 raft_consensus.cc:2804] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.456797   620 raft_consensus.cc:493] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.457178   620 raft_consensus.cc:3060] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.452777   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ce075819b848f9849ae714b57964f7" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:32.458370   626 leader_election.cc:290] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:32.459041   626 raft_consensus.cc:2804] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.459551   626 raft_consensus.cc:697] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:32.460520   626 consensus_queue.cc:237] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.462677   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ce075819b848f9849ae714b57964f7" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:32.463227   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:32.464697   489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d7d71169d347a982bc81fce6e293f6" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:32.384159   610 tablet_bootstrap.cc:654] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.402143   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:32.466202   415 raft_consensus.cc:2468] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
W20260709 13:12:32.466542   379 leader_election.cc:343] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.396763   478 tablet_service.cc:1511] Processing CreateTablet for tablet c2b68afdb4a44c419ac582ebc689ecf0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 13:12:32.467331   379 leader_election.cc:343] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.467782   379 leader_election.cc:304] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:32.468180   478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b68afdb4a44c419ac582ebc689ecf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.469202   306 leader_election.cc:304] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:32.470405   614 raft_consensus.cc:2804] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.470821   614 raft_consensus.cc:493] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.471160   614 raft_consensus.cc:3060] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.491705   397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d62ccb3929543488daa15130eed287a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.492350   554 tablet_service.cc:1511] Processing CreateTablet for tablet 1d62ccb3929543488daa15130eed287a (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:32.493846   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d62ccb3929543488daa15130eed287a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.477767   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc6d1809c204b7c8dbca7216cfc3121" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
W20260709 13:12:32.505475   381 leader_election.cc:343] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:32.499323   456 leader_election.cc:343] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.509649   476 tablet_service.cc:1511] Processing CreateTablet for tablet fdba3586e7ba42179a320766690f44bc (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:32.510931   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdba3586e7ba42179a320766690f44bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.506577   381 leader_election.cc:304] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:32.513826   324 tablet_service.cc:1511] Processing CreateTablet for tablet fdba3586e7ba42179a320766690f44bc (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:32.514132   614 raft_consensus.cc:515] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.514845   324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdba3586e7ba42179a320766690f44bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.516873   624 leader_election.cc:290] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:32.517822   612 tablet_bootstrap.cc:492] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:32.518347   612 ts_tablet_manager.cc:1403] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.357s	user 0.030s	sys 0.035s
I20260709 13:12:32.518219   489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:32.523797   624 raft_consensus.cc:2804] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.524268   624 raft_consensus.cc:493] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.524601   624 raft_consensus.cc:3060] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.529824   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4fea653b2e44fd87939ab040d317f6" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:32.531980   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4fea653b2e44fd87939ab040d317f6" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:32.532234   652 raft_consensus.cc:493] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.532673   490 raft_consensus.cc:2468] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:32.532778   652 raft_consensus.cc:515] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.534727   553 tablet_service.cc:1511] Processing CreateTablet for tablet 82a993590f1841ea8bb26eaab3ffbca0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:32.535447   652 leader_election.cc:290] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:32.536151   611 tablet_bootstrap.cc:700] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: Time spent opening tablet: real 0.144s	user 0.002s	sys 0.001s
I20260709 13:12:32.536557   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a993590f1841ea8bb26eaab3ffbca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.536820   611 tablet_bootstrap.cc:654] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.538021   650 raft_consensus.cc:2749] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.539721   379 leader_election.cc:304] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:32.556061   650 raft_consensus.cc:2804] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.556190   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:32.556715   650 raft_consensus.cc:493] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:32.528527   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 75497.6us
I20260709 13:12:32.557235   650 raft_consensus.cc:3060] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:32.558348   530 leader_election.cc:343] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.542351   404 tablet_service.cc:1511] Processing CreateTablet for tablet fdba3586e7ba42179a320766690f44bc (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:32.560582   404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdba3586e7ba42179a320766690f44bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:32.560626   304 leader_election.cc:343] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.559017   530 leader_election.cc:304] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:32.562991   652 raft_consensus.cc:2749] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.564904   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f70da72b449609b0b4f28f6589ab3" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
W20260709 13:12:32.606046   530 leader_election.cc:343] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.520744   614 leader_election.cc:290] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:32.644649   489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092bc27912f4ee0b10a1f261f38eac8" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:32.645397   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092bc27912f4ee0b10a1f261f38eac8" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
W20260709 13:12:32.640727 32694 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 75013.3us
I20260709 13:12:32.647004   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f70da72b449609b0b4f28f6589ab3" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:32.647395   528 leader_election.cc:343] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.644351   620 raft_consensus.cc:515] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
W20260709 13:12:32.648625   382 leader_election.cc:343] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.664031   406 tablet_service.cc:1511] Processing CreateTablet for tablet 82a993590f1841ea8bb26eaab3ffbca0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:32.664968   610 tablet_bootstrap.cc:492] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
W20260709 13:12:32.649303   528 leader_election.cc:343] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.645738   325 tablet_service.cc:1511] Processing CreateTablet for tablet 82a993590f1841ea8bb26eaab3ffbca0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:12:32.666404   528 leader_election.cc:343] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.666621   331 tablet_service.cc:1511] Processing CreateTablet for tablet 8b7fe5c08e134e6297971768dca0caa0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:32.667127   528 leader_election.cc:304] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:32.667713   325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a993590f1841ea8bb26eaab3ffbca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.668229   654 raft_consensus.cc:2749] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.649750   614 raft_consensus.cc:493] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.669680   555 tablet_service.cc:1511] Processing CreateTablet for tablet 8b7fe5c08e134e6297971768dca0caa0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:32.657123   630 raft_consensus.cc:515] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.669831   614 raft_consensus.cc:515] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.670938   491 raft_consensus.cc:2393] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 in current term 1: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
I20260709 13:12:32.671015   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7fe5c08e134e6297971768dca0caa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.672223   614 leader_election.cc:290] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:32.655285   612 raft_consensus.cc:359] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.666335   615 tablet_bootstrap.cc:492] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:32.665407   406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a993590f1841ea8bb26eaab3ffbca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.674036   610 ts_tablet_manager.cc:1403] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.348s	user 0.019s	sys 0.018s
I20260709 13:12:32.681334   331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7fe5c08e134e6297971768dca0caa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.681527   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35552e87ca5c49fe9e0b3b38ddbe0d0a" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:32.682531   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35552e87ca5c49fe9e0b3b38ddbe0d0a" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:32.685160   620 leader_election.cc:290] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
W20260709 13:12:32.686738   304 leader_election.cc:343] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.680750   379 leader_election.cc:304] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
W20260709 13:12:32.687911   307 leader_election.cc:343] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.688530   307 leader_election.cc:304] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:32.689204   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5142c450ae11440bac6ebd5b5ab35bba" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:32.690856   457 leader_election.cc:343] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.691012   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5142c450ae11440bac6ebd5b5ab35bba" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:32.691880   339 raft_consensus.cc:3060] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.697960   614 raft_consensus.cc:2749] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.704357   339 raft_consensus.cc:2468] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:32.675345   612 raft_consensus.cc:385] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.679683   615 ts_tablet_manager.cc:1403] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.481s	user 0.032s	sys 0.027s
I20260709 13:12:32.711091   399 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfa1d8bf64d4c509074630610c02e52 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:32.712116   656 raft_consensus.cc:3060] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.712581   399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfa1d8bf64d4c509074630610c02e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.717324   611 tablet_bootstrap.cc:492] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:32.717898   611 ts_tablet_manager.cc:1403] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.378s	user 0.022s	sys 0.032s
I20260709 13:12:32.720301   611 raft_consensus.cc:359] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.720860   611 raft_consensus.cc:385] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.721153   611 raft_consensus.cc:740] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.721899   611 consensus_queue.cc:260] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.722338   456 leader_election.cc:304] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:32.723431   620 raft_consensus.cc:2804] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.726339 32707 catalog_manager.cc:5697] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 1 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.731685   611 ts_tablet_manager.cc:1434] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:12:32.732860   611 tablet_bootstrap.cc:492] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:32.735627   610 raft_consensus.cc:359] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.737495   610 raft_consensus.cc:385] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.737919   610 raft_consensus.cc:740] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
W20260709 13:12:32.738034 32691 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.204.195:39781, user_credentials={real_user=slave}} blocked reactor thread for 94938.1us
I20260709 13:12:32.739252   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ce075819b848f9849ae714b57964f7" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:32.737939   630 leader_election.cc:290] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:32.741084   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ce075819b848f9849ae714b57964f7" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:32.741747   610 consensus_queue.cc:260] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:32.744271   610 ts_tablet_manager.cc:1434] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.003s
W20260709 13:12:32.745672   381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 239176us
I20260709 13:12:32.707155   612 raft_consensus.cc:740] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
W20260709 13:12:32.749327   456 leader_election.cc:343] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.749977   550 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfa1d8bf64d4c509074630610c02e52 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:32.751351   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfa1d8bf64d4c509074630610c02e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.754243   476 tablet_service.cc:1511] Processing CreateTablet for tablet 8b7fe5c08e134e6297971768dca0caa0 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:32.755535   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7fe5c08e134e6297971768dca0caa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.759263   610 tablet_bootstrap.cc:492] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:32.759004   612 consensus_queue.cc:260] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.770015   472 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfa1d8bf64d4c509074630610c02e52 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:32.771425   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfa1d8bf64d4c509074630610c02e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.771654   330 tablet_service.cc:1511] Processing CreateTablet for tablet 48a1b61fefe4409aafc26d1c3ad71f75 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:32.772998   330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a1b61fefe4409aafc26d1c3ad71f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.779633   615 raft_consensus.cc:359] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:32.780465   615 raft_consensus.cc:385] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.780766   615 raft_consensus.cc:740] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.792680   610 tablet_bootstrap.cc:654] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.797303   611 tablet_bootstrap.cc:654] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.799388   612 ts_tablet_manager.cc:1434] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.281s	user 0.003s	sys 0.014s
I20260709 13:12:32.800628   612 tablet_bootstrap.cc:492] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:32.806166   620 raft_consensus.cc:697] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:32.805935   615 consensus_queue.cc:260] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:32.824653   612 tablet_bootstrap.cc:654] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.827294   476 tablet_service.cc:1511] Processing CreateTablet for tablet 48a1b61fefe4409aafc26d1c3ad71f75 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:32.828337   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a1b61fefe4409aafc26d1c3ad71f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.830253   626 raft_consensus.cc:493] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.830892   626 raft_consensus.cc:515] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.835740   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4fea653b2e44fd87939ab040d317f6" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:32.844529   661 raft_consensus.cc:493] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.845321   661 raft_consensus.cc:515] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:32.849488   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b5dfaf74c940a19f58b2d439e6b768" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:32.851820   382 leader_election.cc:343] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.855362   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b5dfaf74c940a19f58b2d439e6b768" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:32.856354   339 raft_consensus.cc:2468] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:32.858256   381 leader_election.cc:304] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:32.860163   661 leader_election.cc:290] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:32.833447   626 leader_election.cc:290] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:32.881865   405 tablet_service.cc:1511] Processing CreateTablet for tablet 48a1b61fefe4409aafc26d1c3ad71f75 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:32.885905   472 tablet_service.cc:1511] Processing CreateTablet for tablet db8c93d4a8ad4ec0b108017f2f61138e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:32.886368   327 tablet_service.cc:1511] Processing CreateTablet for tablet 55d997035dbd4e7d88a1f947b2f915bb (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:32.887687   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55d997035dbd4e7d88a1f947b2f915bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.887820   403 tablet_service.cc:1511] Processing CreateTablet for tablet 55d997035dbd4e7d88a1f947b2f915bb (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:32.866688   661 raft_consensus.cc:2804] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.889122   661 raft_consensus.cc:493] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.889496   661 raft_consensus.cc:3060] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.890540   550 tablet_service.cc:1511] Processing CreateTablet for tablet 55d997035dbd4e7d88a1f947b2f915bb (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:32.891765   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55d997035dbd4e7d88a1f947b2f915bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.893922   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4fea653b2e44fd87939ab040d317f6" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:32.894685   491 raft_consensus.cc:2468] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:32.873991   620 consensus_queue.cc:237] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.896873   624 raft_consensus.cc:515] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.912909   612 tablet_bootstrap.cc:492] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:32.913590   612 ts_tablet_manager.cc:1403] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.113s	user 0.023s	sys 0.019s
I20260709 13:12:32.915763   650 raft_consensus.cc:515] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.917132   414 raft_consensus.cc:2393] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54e079297e3a4863ac2eccd69f7dbd9c in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:32.903477   403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55d997035dbd4e7d88a1f947b2f915bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.922351   528 leader_election.cc:304] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:32.923338   626 raft_consensus.cc:2804] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.923915   626 raft_consensus.cc:493] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.924408   626 raft_consensus.cc:3060] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.924654   554 tablet_service.cc:1511] Processing CreateTablet for tablet db8c93d4a8ad4ec0b108017f2f61138e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:32.926177   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8c93d4a8ad4ec0b108017f2f61138e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.902652   615 ts_tablet_manager.cc:1434] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.193s	user 0.010s	sys 0.000s
I20260709 13:12:32.935520   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8c93d4a8ad4ec0b108017f2f61138e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.934284   416 raft_consensus.cc:2393] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70c1750ca53a445883b66469ea339141 in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:32.939960   656 raft_consensus.cc:2749] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.940037   306 leader_election.cc:304] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:32.941111   614 raft_consensus.cc:2749] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.943558   615 tablet_bootstrap.cc:492] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:32.948288   415 raft_consensus.cc:2468] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:32.948361   614 raft_consensus.cc:493] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.949163   614 raft_consensus.cc:515] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:32.947988   661 raft_consensus.cc:515] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:32.953147   456 leader_election.cc:304] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:32.953735   614 leader_election.cc:290] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:32.954600   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effea88d8d284e51a4c8383f5da9fd83" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:32.957069   405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a1b61fefe4409aafc26d1c3ad71f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.955091   658 raft_consensus.cc:2804] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.957794   624 leader_election.cc:290] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
W20260709 13:12:32.934078   381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 75993.4us
I20260709 13:12:32.959534   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effea88d8d284e51a4c8383f5da9fd83" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:32.970618   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:32.971517   650 leader_election.cc:290] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:32.967054   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b5dfaf74c940a19f58b2d439e6b768" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:32.972963   658 raft_consensus.cc:697] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
W20260709 13:12:32.973618   379 leader_election.cc:343] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:32.977699   382 leader_election.cc:343] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.981055   654 consensus_queue.cc:1048] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:32.981945   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4fea653b2e44fd87939ab040d317f6" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:32.973949   658 consensus_queue.cc:237] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
W20260709 13:12:32.984457   304 leader_election.cc:343] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.987704 32705 catalog_manager.cc:5697] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.989333   626 raft_consensus.cc:515] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:32.990542   564 raft_consensus.cc:2393] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 in current term 1: Already voted for candidate 54e079297e3a4863ac2eccd69f7dbd9c in this term.
I20260709 13:12:32.983644   330 tablet_service.cc:1511] Processing CreateTablet for tablet db8c93d4a8ad4ec0b108017f2f61138e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:32.994203   330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8c93d4a8ad4ec0b108017f2f61138e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.974443   661 leader_election.cc:290] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:33.004036   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:33.005375   338 raft_consensus.cc:2393] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 in current term 1: Already voted for candidate 70c1750ca53a445883b66469ea339141 in this term.
I20260709 13:12:33.005756   612 raft_consensus.cc:359] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.006608   612 raft_consensus.cc:385] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.006923   612 raft_consensus.cc:740] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.007648   611 tablet_bootstrap.cc:492] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:33.008198   611 ts_tablet_manager.cc:1403] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.276s	user 0.020s	sys 0.025s
I20260709 13:12:33.011168   610 tablet_bootstrap.cc:492] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:33.011724   610 ts_tablet_manager.cc:1403] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.253s	user 0.048s	sys 0.071s
I20260709 13:12:33.011659   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b5dfaf74c940a19f58b2d439e6b768" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:33.012462   338 raft_consensus.cc:3060] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.015054   610 raft_consensus.cc:359] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.015329   381 leader_election.cc:304] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:33.015853   610 raft_consensus.cc:385] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.016249   610 raft_consensus.cc:740] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.016832   661 raft_consensus.cc:2749] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.018525   399 tablet_service.cc:1511] Processing CreateTablet for tablet b1743042f2d04b94808274ce1c08af42 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:33.019459   476 tablet_service.cc:1511] Processing CreateTablet for tablet b1743042f2d04b94808274ce1c08af42 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:33.020012   399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1743042f2d04b94808274ce1c08af42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.020653   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1743042f2d04b94808274ce1c08af42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.020589   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4fea653b2e44fd87939ab040d317f6" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:33.034997   491 raft_consensus.cc:3060] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.021109   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4fea653b2e44fd87939ab040d317f6" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:33.037503   550 tablet_service.cc:1511] Processing CreateTablet for tablet b1743042f2d04b94808274ce1c08af42 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:12:33.048506   306 leader_election.cc:343] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.048976   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1743042f2d04b94808274ce1c08af42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.049841   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4fea653b2e44fd87939ab040d317f6" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:33.051287   491 raft_consensus.cc:2468] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:33.052627   528 leader_election.cc:304] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:33.038504   416 raft_consensus.cc:2393] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 54e079297e3a4863ac2eccd69f7dbd9c in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:33.053504   654 raft_consensus.cc:2804] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.049024   306 leader_election.cc:304] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:33.054054   654 raft_consensus.cc:697] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:33.054564   614 raft_consensus.cc:2749] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.054966   654 consensus_queue.cc:237] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.055379   327 tablet_service.cc:1511] Processing CreateTablet for tablet 9bcd9ae6a2eb4b90be3ad7a183c00b8a (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:33.056586   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bcd9ae6a2eb4b90be3ad7a183c00b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.055486   379 leader_election.cc:304] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:33.061750   661 raft_consensus.cc:2749] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.020344   626 leader_election.cc:290] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:33.042645   338 raft_consensus.cc:2468] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:33.020174   610 consensus_queue.cc:260] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.071283   404 tablet_service.cc:1511] Processing CreateTablet for tablet 9bcd9ae6a2eb4b90be3ad7a183c00b8a (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:33.073462   472 tablet_service.cc:1511] Processing CreateTablet for tablet 9bcd9ae6a2eb4b90be3ad7a183c00b8a (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:33.082345   615 tablet_bootstrap.cc:654] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.091396   658 raft_consensus.cc:493] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.098448   325 tablet_service.cc:1511] Processing CreateTablet for tablet 88c308c7d16f484992afc75ec0343d26 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:33.098345   404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bcd9ae6a2eb4b90be3ad7a183c00b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.103122   610 ts_tablet_manager.cc:1434] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.003s
I20260709 13:12:33.096505   381 leader_election.cc:304] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:33.093036   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bcd9ae6a2eb4b90be3ad7a183c00b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.024919   611 raft_consensus.cc:359] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.114291   325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c308c7d16f484992afc75ec0343d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.086331   554 tablet_service.cc:1511] Processing CreateTablet for tablet 88c308c7d16f484992afc75ec0343d26 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:33.119117   611 raft_consensus.cc:385] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.131803   661 raft_consensus.cc:2804] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.134747   661 raft_consensus.cc:697] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:33.135607   661 consensus_queue.cc:237] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.136114   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c308c7d16f484992afc75ec0343d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.087042   612 consensus_queue.cc:260] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.116572   658 raft_consensus.cc:515] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.139303   611 raft_consensus.cc:740] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.149237   476 tablet_service.cc:1511] Processing CreateTablet for tablet 601d16b32f7947f899a17d9b9c4b1152 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:33.149222   611 consensus_queue.cc:260] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.150633   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601d16b32f7947f899a17d9b9c4b1152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.151204   611 ts_tablet_manager.cc:1434] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.143s	user 0.008s	sys 0.003s
I20260709 13:12:33.152254   611 tablet_bootstrap.cc:492] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:33.155081   528 consensus_peers.cc:597] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.157601   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35552e87ca5c49fe9e0b3b38ddbe0d0a" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:33.157919   658 leader_election.cc:290] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:33.158390   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35552e87ca5c49fe9e0b3b38ddbe0d0a" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:33.159004   338 raft_consensus.cc:2468] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
W20260709 13:12:33.159224   457 leader_election.cc:343] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.160389   456 leader_election.cc:304] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:33.161509   658 raft_consensus.cc:2804] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.162024   658 raft_consensus.cc:493] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.162349   658 raft_consensus.cc:3060] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.163479   403 tablet_service.cc:1511] Processing CreateTablet for tablet 88c308c7d16f484992afc75ec0343d26 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:33.164904   403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c308c7d16f484992afc75ec0343d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.166411   612 ts_tablet_manager.cc:1434] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.252s	user 0.008s	sys 0.001s
I20260709 13:12:33.167418   612 tablet_bootstrap.cc:492] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:33.173658   615 tablet_bootstrap.cc:492] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:33.174203   615 ts_tablet_manager.cc:1403] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.231s	user 0.017s	sys 0.003s
I20260709 13:12:33.169395   658 raft_consensus.cc:515] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.170989   610 tablet_bootstrap.cc:492] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:33.178392   550 tablet_service.cc:1511] Processing CreateTablet for tablet 601d16b32f7947f899a17d9b9c4b1152 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:33.179822   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601d16b32f7947f899a17d9b9c4b1152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.186941   658 leader_election.cc:290] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:33.187819   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35552e87ca5c49fe9e0b3b38ddbe0d0a" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:33.189740   457 leader_election.cc:343] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.191810   610 tablet_bootstrap.cc:654] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.191844   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35552e87ca5c49fe9e0b3b38ddbe0d0a" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:33.192646   339 raft_consensus.cc:3060] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.195744   611 tablet_bootstrap.cc:654] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.185897   615 raft_consensus.cc:359] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.209993   339 raft_consensus.cc:2468] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:33.211455   652 raft_consensus.cc:493] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.212119   652 raft_consensus.cc:515] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.201877   615 raft_consensus.cc:385] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.213923   615 raft_consensus.cc:740] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.215128   652 leader_election.cc:290] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:33.214787   615 consensus_queue.cc:260] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.215832   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d7d71169d347a982bc81fce6e293f6" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:33.214814   456 leader_election.cc:304] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:33.216524   415 raft_consensus.cc:2468] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:33.216969   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d7d71169d347a982bc81fce6e293f6" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:33.217445   615 ts_tablet_manager.cc:1434] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.002s
I20260709 13:12:33.217797   491 raft_consensus.cc:2468] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:33.218214   530 leader_election.cc:304] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:33.217343   658 raft_consensus.cc:2804] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.222976   615 tablet_bootstrap.cc:492] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:33.223057   658 raft_consensus.cc:697] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:33.223740   652 raft_consensus.cc:2804] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.224200   652 raft_consensus.cc:493] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.224195   658 consensus_queue.cc:237] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.225534   652 raft_consensus.cc:3060] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.233848   330 tablet_service.cc:1511] Processing CreateTablet for tablet 601d16b32f7947f899a17d9b9c4b1152 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:33.233861   404 tablet_service.cc:1511] Processing CreateTablet for tablet b6697ad4db194664b519fcb657a65e53 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:33.236990   330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601d16b32f7947f899a17d9b9c4b1152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.237079   404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6697ad4db194664b519fcb657a65e53. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:33.239049 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:33.243907   476 tablet_service.cc:1511] Processing CreateTablet for tablet b6697ad4db194664b519fcb657a65e53 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:33.245478   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6697ad4db194664b519fcb657a65e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.256325 32706 catalog_manager.cc:5697] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.259622   612 tablet_bootstrap.cc:654] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.274250 32704 catalog_manager.cc:5697] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 1 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.283195   652 raft_consensus.cc:515] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.286186   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d7d71169d347a982bc81fce6e293f6" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:33.286803   415 raft_consensus.cc:3060] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.290848   327 tablet_service.cc:1511] Processing CreateTablet for tablet 61d4a00d69b74c98ab81dd2996356c83 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:33.293550   415 raft_consensus.cc:2468] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:33.295027   530 leader_election.cc:304] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:33.296042   673 raft_consensus.cc:2804] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.296548   673 raft_consensus.cc:697] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:33.298740   550 tablet_service.cc:1511] Processing CreateTablet for tablet b6697ad4db194664b519fcb657a65e53 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:33.300463   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6697ad4db194664b519fcb657a65e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.302203   472 tablet_service.cc:1511] Processing CreateTablet for tablet 61d4a00d69b74c98ab81dd2996356c83 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:33.302491   404 tablet_service.cc:1511] Processing CreateTablet for tablet 61d4a00d69b74c98ab81dd2996356c83 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:33.297374   673 consensus_queue.cc:237] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.306154   404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d4a00d69b74c98ab81dd2996356c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.303399   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d4a00d69b74c98ab81dd2996356c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.311970   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d4a00d69b74c98ab81dd2996356c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.315927   615 tablet_bootstrap.cc:654] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.324357   652 leader_election.cc:290] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:33.326993   330 tablet_service.cc:1511] Processing CreateTablet for tablet f4a5bbb7df494a0ba42cdb90d573ce1e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:33.327244   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d7d71169d347a982bc81fce6e293f6" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:33.327457   547 tablet_service.cc:1511] Processing CreateTablet for tablet f4a5bbb7df494a0ba42cdb90d573ce1e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:33.327911   491 raft_consensus.cc:3060] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.328253   330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a5bbb7df494a0ba42cdb90d573ce1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.328758   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a5bbb7df494a0ba42cdb90d573ce1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.339248   403 tablet_service.cc:1511] Processing CreateTablet for tablet f4a5bbb7df494a0ba42cdb90d573ce1e (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:33.340580   403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a5bbb7df494a0ba42cdb90d573ce1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.348194   472 tablet_service.cc:1511] Processing CreateTablet for tablet c071a99756034ba58ef554450a637513 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:33.349387   472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c071a99756034ba58ef554450a637513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.358537   611 tablet_bootstrap.cc:492] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:33.359241   611 ts_tablet_manager.cc:1403] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.207s	user 0.020s	sys 0.035s
I20260709 13:12:33.360410   610 tablet_bootstrap.cc:492] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:33.360955   610 ts_tablet_manager.cc:1403] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.221s	user 0.020s	sys 0.009s
I20260709 13:12:33.363402   611 raft_consensus.cc:359] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.364133   611 raft_consensus.cc:385] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.364393   611 raft_consensus.cc:740] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.365239   611 consensus_queue.cc:260] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.341140   491 raft_consensus.cc:2468] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:33.366788 32707 catalog_manager.cc:5697] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.369061 32707 catalog_manager.cc:5697] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.385306   550 tablet_service.cc:1511] Processing CreateTablet for tablet c071a99756034ba58ef554450a637513 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:33.386854   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c071a99756034ba58ef554450a637513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.394790   658 consensus_queue.cc:1048] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.395818   610 raft_consensus.cc:359] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.396643   610 raft_consensus.cc:385] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.396996   610 raft_consensus.cc:740] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.397755   610 consensus_queue.cc:260] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.409351   330 tablet_service.cc:1511] Processing CreateTablet for tablet c071a99756034ba58ef554450a637513 (DEFAULT_TABLE table=test-workload [id=fd77fe45eb6d44739d5cc6d440b118f0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:33.411059   330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c071a99756034ba58ef554450a637513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.411325   611 ts_tablet_manager.cc:1434] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:12:33.412914   611 tablet_bootstrap.cc:492] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:33.418682   457 consensus_peers.cc:597] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.407603 32704 catalog_manager.cc:5697] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 1 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.426601   611 tablet_bootstrap.cc:654] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.434353   612 tablet_bootstrap.cc:492] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:33.434926   612 ts_tablet_manager.cc:1403] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.268s	user 0.009s	sys 0.017s
I20260709 13:12:33.440706   610 ts_tablet_manager.cc:1434] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 13:12:33.440963   615 tablet_bootstrap.cc:492] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:33.441536   615 ts_tablet_manager.cc:1403] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.219s	user 0.017s	sys 0.021s
I20260709 13:12:33.442096   610 tablet_bootstrap.cc:492] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:33.451087   658 raft_consensus.cc:493] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.451655   658 raft_consensus.cc:515] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.454515   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5a50bacfa64214acf10104084bb1be" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:33.454989   658 leader_election.cc:290] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:33.456413   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5a50bacfa64214acf10104084bb1be" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:33.456643   456 leader_election.cc:343] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:33.457916   457 leader_election.cc:343] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.458391   457 leader_election.cc:304] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:33.459774   612 raft_consensus.cc:359] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.460345   658 raft_consensus.cc:2749] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.462069   615 raft_consensus.cc:359] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.460557   612 raft_consensus.cc:385] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.463259   615 raft_consensus.cc:385] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.463973   615 raft_consensus.cc:740] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.465479   610 tablet_bootstrap.cc:654] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.465142   615 consensus_queue.cc:260] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.468976   614 raft_consensus.cc:493] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.469514   614 raft_consensus.cc:515] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.471422   611 tablet_bootstrap.cc:492] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:33.471776   614 leader_election.cc:290] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:33.471930   611 ts_tablet_manager.cc:1403] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.002s
I20260709 13:12:33.473425   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f70da72b449609b0b4f28f6589ab3" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:33.474102   564 raft_consensus.cc:2468] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:33.474781   611 raft_consensus.cc:359] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.475467   307 leader_election.cc:304] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:12:33.475471   611 raft_consensus.cc:385] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.477946   611 raft_consensus.cc:740] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
W20260709 13:12:33.478474   456 consensus_peers.cc:597] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.478646   611 consensus_queue.cc:260] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.478750   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f70da72b449609b0b4f28f6589ab3" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:33.480971   304 leader_election.cc:343] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.463702   612 raft_consensus.cc:740] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.482620   614 raft_consensus.cc:2804] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.483090   614 raft_consensus.cc:493] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.483455   614 raft_consensus.cc:3060] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.483970   612 consensus_queue.cc:260] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.485671   615 ts_tablet_manager.cc:1434] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.006s
I20260709 13:12:33.500648   612 ts_tablet_manager.cc:1434] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.003s
I20260709 13:12:33.495251   614 raft_consensus.cc:515] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.502929   611 ts_tablet_manager.cc:1434] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.002s
I20260709 13:12:33.503659   615 tablet_bootstrap.cc:492] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:33.503954   611 tablet_bootstrap.cc:492] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:33.511247   610 tablet_bootstrap.cc:492] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:33.511659   610 ts_tablet_manager.cc:1403] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.004s
I20260709 13:12:33.513201   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f70da72b449609b0b4f28f6589ab3" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:33.512419   614 leader_election.cc:290] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:33.514747   615 tablet_bootstrap.cc:654] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.514442   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f70da72b449609b0b4f28f6589ab3" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:33.515228   564 raft_consensus.cc:3060] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.518577   612 tablet_bootstrap.cc:492] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
W20260709 13:12:33.522693   304 leader_election.cc:343] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.524574   611 tablet_bootstrap.cc:654] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.525904   610 raft_consensus.cc:359] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.528118   610 raft_consensus.cc:385] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.528503   610 raft_consensus.cc:740] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.529377   610 consensus_queue.cc:260] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.527642   564 raft_consensus.cc:2468] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:33.531447   307 leader_election.cc:304] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:33.532382   614 raft_consensus.cc:2804] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.533066   614 raft_consensus.cc:697] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:33.534653   610 ts_tablet_manager.cc:1434] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:12:33.534222   614 consensus_queue.cc:237] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.535923   610 tablet_bootstrap.cc:492] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:33.543232   610 tablet_bootstrap.cc:654] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.542994   690 raft_consensus.cc:493] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.544044   690 raft_consensus.cc:515] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.549744   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc6d1809c204b7c8dbca7216cfc3121" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:33.550680   415 raft_consensus.cc:2468] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:33.551604   612 tablet_bootstrap.cc:654] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.552451   306 leader_election.cc:304] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:33.558277   690 leader_election.cc:290] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:33.559028   690 raft_consensus.cc:2804] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.559500   690 raft_consensus.cc:493] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.559930   690 raft_consensus.cc:3060] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.563341   611 tablet_bootstrap.cc:492] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:33.564052   611 ts_tablet_manager.cc:1403] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.003s
I20260709 13:12:33.565074   615 tablet_bootstrap.cc:492] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:33.565675   615 ts_tablet_manager.cc:1403] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.063s	user 0.025s	sys 0.027s
I20260709 13:12:33.569125   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc6d1809c204b7c8dbca7216cfc3121" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:33.569913   564 raft_consensus.cc:2468] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:33.571251   615 raft_consensus.cc:359] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.571985   615 raft_consensus.cc:385] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.571861   690 raft_consensus.cc:515] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.572325   615 raft_consensus.cc:740] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.573378   615 consensus_queue.cc:260] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.575891   615 ts_tablet_manager.cc:1434] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:33.577545   615 tablet_bootstrap.cc:492] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:33.584327   615 tablet_bootstrap.cc:654] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.584604   673 consensus_queue.cc:1048] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.596184   611 raft_consensus.cc:359] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.597256   611 raft_consensus.cc:385] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.597600   611 raft_consensus.cc:740] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
W20260709 13:12:33.599871   306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:35023, user_credentials={real_user=slave}} blocked reactor thread for 47553.4us
I20260709 13:12:33.601373   611 consensus_queue.cc:260] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.603525   610 tablet_bootstrap.cc:492] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:33.603981   610 ts_tablet_manager.cc:1403] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.018s
I20260709 13:12:33.605708   620 consensus_queue.cc:1048] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.608479   610 raft_consensus.cc:359] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.609228   610 raft_consensus.cc:385] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.609488   610 raft_consensus.cc:740] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.610275   610 consensus_queue.cc:260] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.611075   690 leader_election.cc:290] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:33.620556   611 ts_tablet_manager.cc:1434] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.056s	user 0.011s	sys 0.000s
I20260709 13:12:33.614717   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc6d1809c204b7c8dbca7216cfc3121" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:33.622089   564 raft_consensus.cc:3060] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.622388   611 tablet_bootstrap.cc:492] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:33.620772   610 ts_tablet_manager.cc:1434] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:12:33.623526   610 tablet_bootstrap.cc:492] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:33.623917   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc6d1809c204b7c8dbca7216cfc3121" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:33.624503   414 raft_consensus.cc:3060] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.630031   564 raft_consensus.cc:2468] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:33.631431   307 leader_election.cc:304] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:12:33.633656   614 raft_consensus.cc:2804] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.634151   614 raft_consensus.cc:697] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:33.635265   611 tablet_bootstrap.cc:654] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.635006   614 consensus_queue.cc:237] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.637816   610 tablet_bootstrap.cc:654] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.637212 32707 catalog_manager.cc:5697] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.641348   661 raft_consensus.cc:493] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.641791   620 consensus_queue.cc:1048] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.641987   661 raft_consensus.cc:515] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.647258   615 tablet_bootstrap.cc:492] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:33.648288   615 ts_tablet_manager.cc:1403] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.004s
I20260709 13:12:33.646670   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effea88d8d284e51a4c8383f5da9fd83" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:33.655745   339 raft_consensus.cc:2468] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:33.657171   661 leader_election.cc:290] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:33.660277   381 leader_election.cc:304] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:33.663231   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effea88d8d284e51a4c8383f5da9fd83" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:33.667641   379 leader_election.cc:343] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.669788   652 consensus_queue.cc:1048] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.676743   661 raft_consensus.cc:2804] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.689970   615 raft_consensus.cc:359] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.691044   615 raft_consensus.cc:385] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.691411   615 raft_consensus.cc:740] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.692297   615 consensus_queue.cc:260] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.682986   690 raft_consensus.cc:493] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.683040   661 raft_consensus.cc:493] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.701269   615 ts_tablet_manager.cc:1434] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.002s
I20260709 13:12:33.702694   615 tablet_bootstrap.cc:492] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:33.705166   612 tablet_bootstrap.cc:492] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:33.705717   612 ts_tablet_manager.cc:1403] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.187s	user 0.013s	sys 0.010s
I20260709 13:12:33.706076   414 raft_consensus.cc:2468] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:33.708838   612 raft_consensus.cc:359] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.709395   615 tablet_bootstrap.cc:654] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.701800   661 raft_consensus.cc:3060] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.701275   690 raft_consensus.cc:515] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.716408   690 leader_election.cc:290] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:33.716892   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77cacfdc1e943a6ae75838391278350" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:33.722911   307 leader_election.cc:343] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.717434   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77cacfdc1e943a6ae75838391278350" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:33.717862   612 raft_consensus.cc:385] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.736968   612 raft_consensus.cc:740] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
W20260709 13:12:33.736979   382 consensus_peers.cc:597] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.738119   612 consensus_queue.cc:260] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.742050   612 ts_tablet_manager.cc:1434] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 13:12:33.736177   661 raft_consensus.cc:515] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.749410   488 raft_consensus.cc:3060] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.749794 32704 catalog_manager.cc:5697] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.758616   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effea88d8d284e51a4c8383f5da9fd83" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:33.759305   339 raft_consensus.cc:3060] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.746173   415 raft_consensus.cc:2468] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:33.767666   654 raft_consensus.cc:493] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.768476   611 tablet_bootstrap.cc:492] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:33.768237   654 raft_consensus.cc:515] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:33.768968   611 ts_tablet_manager.cc:1403] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.000s
I20260709 13:12:33.771867   611 raft_consensus.cc:359] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.772558   611 raft_consensus.cc:385] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.772823   611 raft_consensus.cc:740] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.774149   306 leader_election.cc:304] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:33.775097   690 raft_consensus.cc:2804] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.775673   690 raft_consensus.cc:493] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.776172   690 raft_consensus.cc:3060] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.777388   701 consensus_queue.cc:1048] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.779484   564 raft_consensus.cc:3060] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.781239   694 raft_consensus.cc:493] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.781795   694 raft_consensus.cc:515] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.784790   694 leader_election.cc:290] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:33.787173   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ce075819b848f9849ae714b57964f7" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:33.789407   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ce075819b848f9849ae714b57964f7" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:33.791162   304 leader_election.cc:304] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:33.796995   694 raft_consensus.cc:2749] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.798594   654 leader_election.cc:290] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:33.798348   673 consensus_queue.cc:1048] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.800104   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35552e87ca5c49fe9e0b3b38ddbe0d0a" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:33.801324   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35552e87ca5c49fe9e0b3b38ddbe0d0a" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:33.803205   528 leader_election.cc:304] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:33.806425   673 raft_consensus.cc:2749] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.810297   690 raft_consensus.cc:515] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.811563   339 raft_consensus.cc:2468] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:33.773474   611 consensus_queue.cc:260] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.747928   612 tablet_bootstrap.cc:492] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:33.823370   620 consensus_queue.cc:1048] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.823930   661 leader_election.cc:290] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:33.824405   690 leader_election.cc:290] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:33.824877   381 leader_election.cc:304] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:33.826273   661 raft_consensus.cc:2804] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.826176   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77cacfdc1e943a6ae75838391278350" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:33.826970   611 ts_tablet_manager.cc:1434] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.001s
I20260709 13:12:33.827461   615 tablet_bootstrap.cc:492] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:33.828090   615 ts_tablet_manager.cc:1403] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.126s	user 0.050s	sys 0.069s
I20260709 13:12:33.828588   611 tablet_bootstrap.cc:492] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:33.829413   661 raft_consensus.cc:697] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:33.845896   615 raft_consensus.cc:359] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.847127   615 raft_consensus.cc:385] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.847561   615 raft_consensus.cc:740] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.852185   610 tablet_bootstrap.cc:492] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:33.852747   610 ts_tablet_manager.cc:1403] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.229s	user 0.005s	sys 0.027s
I20260709 13:12:33.838805   701 raft_consensus.cc:493] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.855392   701 raft_consensus.cc:515] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
W20260709 13:12:33.857509   307 leader_election.cc:343] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.857887   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effea88d8d284e51a4c8383f5da9fd83" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:33.858840   701 leader_election.cc:290] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
W20260709 13:12:33.859802   379 leader_election.cc:343] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.860203   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:33.866490   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77cacfdc1e943a6ae75838391278350" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:33.861394   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:33.867166   414 raft_consensus.cc:3060] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.866609   491 raft_consensus.cc:2468] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
W20260709 13:12:33.869305   381 leader_election.cc:343] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.869521   611 tablet_bootstrap.cc:654] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.870847   379 leader_election.cc:304] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:33.861843   564 raft_consensus.cc:3060] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.854583   615 consensus_queue.cc:260] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.879812   615 ts_tablet_manager.cc:1434] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 13:12:33.880555   615 tablet_bootstrap.cc:492] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:33.887045   610 raft_consensus.cc:359] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.887876   610 raft_consensus.cc:385] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.888239   610 raft_consensus.cc:740] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.889024   610 consensus_queue.cc:260] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.891137   610 ts_tablet_manager.cc:1434] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:12:33.895169   610 tablet_bootstrap.cc:492] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:33.873818   661 consensus_queue.cc:237] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:33.898772   612 tablet_bootstrap.cc:654] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.905174   610 tablet_bootstrap.cc:654] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.884321   701 raft_consensus.cc:2804] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.908470   338 raft_consensus.cc:3060] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.908806   701 raft_consensus.cc:493] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.909324   701 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.912067   652 consensus_queue.cc:1048] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.907583   414 raft_consensus.cc:2468] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:33.926717   630 raft_consensus.cc:493] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.930930   630 raft_consensus.cc:515] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:33.932116   690 raft_consensus.cc:493] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.932695   690 raft_consensus.cc:515] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.943148   611 tablet_bootstrap.cc:492] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:33.944953   611 ts_tablet_manager.cc:1403] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.009s
I20260709 13:12:33.949647   306 leader_election.cc:304] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:33.973284   614 raft_consensus.cc:2804] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.973906   614 raft_consensus.cc:697] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:33.987599   615 tablet_bootstrap.cc:654] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.991387   614 consensus_queue.cc:237] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:33.998443   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72cfaa775c3b4fb2a7756d6042ab17b9" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:34.001086   307 leader_election.cc:343] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.002997   630 leader_election.cc:290] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:34.003921   690 leader_election.cc:290] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:34.004400   701 raft_consensus.cc:515] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.005028   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d528fd921345acbfc657dc909148f0" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:34.005836   415 raft_consensus.cc:2468] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:34.007242   456 leader_election.cc:304] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:34.008252   658 raft_consensus.cc:2804] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.008631   658 raft_consensus.cc:493] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.008980   658 raft_consensus.cc:3060] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.009371   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d528fd921345acbfc657dc909148f0" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:34.012817   457 leader_election.cc:343] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.014256 32707 catalog_manager.cc:5697] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.015780   701 leader_election.cc:290] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:34.017632   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72cfaa775c3b4fb2a7756d6042ab17b9" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:34.020099   690 consensus_queue.cc:1048] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.023970   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:34.026314   612 tablet_bootstrap.cc:492] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:34.027101   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:34.030671   612 ts_tablet_manager.cc:1403] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.283s	user 0.011s	sys 0.029s
I20260709 13:12:34.030891   488 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:34.040140   381 leader_election.cc:343] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.040690 32704 catalog_manager.cc:5697] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:34.044828   306 leader_election.cc:343] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.045908   611 raft_consensus.cc:359] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.046767   611 raft_consensus.cc:385] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.047051   611 raft_consensus.cc:740] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.047878   611 consensus_queue.cc:260] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.053817   658 raft_consensus.cc:515] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.055521   611 ts_tablet_manager.cc:1434] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.001s
I20260709 13:12:34.056780   611 tablet_bootstrap.cc:492] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:34.045377   306 leader_election.cc:304] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:34.065950   612 raft_consensus.cc:359] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.068567   612 raft_consensus.cc:385] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.069021   612 raft_consensus.cc:740] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.072033   612 consensus_queue.cc:260] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.080646   612 ts_tablet_manager.cc:1434] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:12:34.081459   612 tablet_bootstrap.cc:492] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:34.065131   690 consensus_queue.cc:1048] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:12:34.082420   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d528fd921345acbfc657dc909148f0" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
W20260709 13:12:34.083624   304 consensus_peers.cc:597] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:34.075212   614 raft_consensus.cc:2749] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.085088   611 tablet_bootstrap.cc:654] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.086364   414 raft_consensus.cc:3060] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.088409   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9d528fd921345acbfc657dc909148f0" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:34.089128   564 raft_consensus.cc:3060] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.092337   612 tablet_bootstrap.cc:654] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.079538   658 leader_election.cc:290] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:34.105880   610 tablet_bootstrap.cc:492] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:34.106403   610 ts_tablet_manager.cc:1403] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.211s	user 0.017s	sys 0.011s
I20260709 13:12:34.106653   615 tablet_bootstrap.cc:492] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:34.107175   615 ts_tablet_manager.cc:1403] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.227s	user 0.014s	sys 0.016s
I20260709 13:12:34.108845   414 raft_consensus.cc:2468] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:34.109454   615 raft_consensus.cc:359] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.110086   456 leader_election.cc:304] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:34.110355   615 raft_consensus.cc:385] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.110704   615 raft_consensus.cc:740] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.111177   658 raft_consensus.cc:2804] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.111500   615 consensus_queue.cc:260] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.113052   658 raft_consensus.cc:697] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:34.115903   615 ts_tablet_manager.cc:1434] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:34.109216   610 raft_consensus.cc:359] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:34.116464   610 raft_consensus.cc:385] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.116724   610 raft_consensus.cc:740] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.117432   610 consensus_queue.cc:260] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:34.119848   610 ts_tablet_manager.cc:1434] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:34.114506   658 consensus_queue.cc:237] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.120842   610 tablet_bootstrap.cc:492] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:34.113245   488 raft_consensus.cc:2468] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:34.121430   564 raft_consensus.cc:2468] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:34.124996   615 tablet_bootstrap.cc:492] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:34.125058   379 leader_election.cc:304] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:34.126282   720 raft_consensus.cc:2804] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.126756   720 raft_consensus.cc:697] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:34.127382   690 consensus_queue.cc:1048] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.127604   720 consensus_queue.cc:237] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.131695   615 tablet_bootstrap.cc:654] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.138995   612 tablet_bootstrap.cc:492] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:34.139554   612 ts_tablet_manager.cc:1403] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.058s	user 0.004s	sys 0.008s
I20260709 13:12:34.143959   612 raft_consensus.cc:359] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.145473   612 raft_consensus.cc:385] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.146261   612 raft_consensus.cc:740] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.148599   612 consensus_queue.cc:260] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.153048   610 tablet_bootstrap.cc:654] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.173231   630 raft_consensus.cc:493] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.173861   630 raft_consensus.cc:515] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.176788   630 leader_election.cc:290] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:34.177456   612 ts_tablet_manager.cc:1434] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 13:12:34.178921   612 tablet_bootstrap.cc:492] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:34.183421   611 tablet_bootstrap.cc:492] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:34.184202   611 ts_tablet_manager.cc:1403] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.004s
I20260709 13:12:34.189621   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:34.190645   415 raft_consensus.cc:2393] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:34.191493   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:34.192379   338 raft_consensus.cc:2393] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 1: Already voted for candidate 70c1750ca53a445883b66469ea339141 in this term.
I20260709 13:12:34.187089   720 raft_consensus.cc:493] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.193620   720 raft_consensus.cc:515] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.194027   456 leader_election.cc:304] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:34.195282   630 raft_consensus.cc:3060] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.196391   720 leader_election.cc:290] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:34.205761   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5a50bacfa64214acf10104084bb1be" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:34.206560   488 raft_consensus.cc:2468] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:34.207512   612 tablet_bootstrap.cc:654] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.207782 32705 catalog_manager.cc:5697] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.210829   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5a50bacfa64214acf10104084bb1be" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:34.212646   382 leader_election.cc:343] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.213764   379 leader_election.cc:304] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:34.220173   720 raft_consensus.cc:2804] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.222512   720 raft_consensus.cc:493] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.222716   615 tablet_bootstrap.cc:492] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:34.222954   720 raft_consensus.cc:3060] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.223454   615 ts_tablet_manager.cc:1403] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.004s
I20260709 13:12:34.228929 32707 catalog_manager.cc:5697] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.230979   615 raft_consensus.cc:359] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.233713   615 raft_consensus.cc:385] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.234020   615 raft_consensus.cc:740] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.220660   630 raft_consensus.cc:2749] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.235896   615 consensus_queue.cc:260] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.235737   611 raft_consensus.cc:359] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:34.238817   615 ts_tablet_manager.cc:1434] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:34.239120   611 raft_consensus.cc:385] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.239818   615 tablet_bootstrap.cc:492] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:34.240130   720 raft_consensus.cc:515] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.243466   720 leader_election.cc:290] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:34.246632   615 tablet_bootstrap.cc:654] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.246953   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5a50bacfa64214acf10104084bb1be" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:34.247243   630 raft_consensus.cc:493] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.247833   630 raft_consensus.cc:515] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
W20260709 13:12:34.248428   382 leader_election.cc:343] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.249222   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5a50bacfa64214acf10104084bb1be" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:34.249893   488 raft_consensus.cc:3060] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.252521   612 tablet_bootstrap.cc:492] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:34.253050   612 ts_tablet_manager.cc:1403] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.007s
I20260709 13:12:34.256690   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f70da72b449609b0b4f28f6589ab3" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:34.258734   630 leader_election.cc:290] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:34.259519   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f70da72b449609b0b4f28f6589ab3" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:34.260882   612 raft_consensus.cc:359] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.261083   457 leader_election.cc:304] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141
I20260709 13:12:34.261818   612 raft_consensus.cc:385] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.262187   612 raft_consensus.cc:740] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.262606   630 raft_consensus.cc:2749] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.239413   611 raft_consensus.cc:740] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.269398   614 raft_consensus.cc:493] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.270439   614 raft_consensus.cc:515] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.272568   488 raft_consensus.cc:2468] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:34.274057   611 consensus_queue.cc:260] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:34.279644   612 consensus_queue.cc:260] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.282447   612 ts_tablet_manager.cc:1434] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:12:34.283716   612 tablet_bootstrap.cc:492] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
W20260709 13:12:34.287731 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:34.288726   611 ts_tablet_manager.cc:1434] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.004s
I20260709 13:12:34.290112   611 tablet_bootstrap.cc:492] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:34.290140   610 tablet_bootstrap.cc:492] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:34.292484   610 ts_tablet_manager.cc:1403] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.172s	user 0.016s	sys 0.007s
I20260709 13:12:34.295047   612 tablet_bootstrap.cc:654] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.298292   614 leader_election.cc:290] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:34.274582   379 leader_election.cc:304] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:34.299387   720 raft_consensus.cc:2804] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.299971   720 raft_consensus.cc:697] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:34.300431   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:34.300805   720 consensus_queue.cc:237] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
W20260709 13:12:34.301934   306 leader_election.cc:343] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.302333   610 raft_consensus.cc:359] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.303063   610 raft_consensus.cc:385] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.303341   610 raft_consensus.cc:740] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.304019   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:34.304029   610 consensus_queue.cc:260] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.305581   488 raft_consensus.cc:2468] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:34.309393   304 leader_election.cc:304] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:34.310880   611 tablet_bootstrap.cc:654] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.311144   614 raft_consensus.cc:2804] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.311446   715 raft_consensus.cc:493] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.312239   715 raft_consensus.cc:515] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.311539   614 raft_consensus.cc:493] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.318477   715 leader_election.cc:290] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:34.315227   614 raft_consensus.cc:3060] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.322157   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72cfaa775c3b4fb2a7756d6042ab17b9" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:34.322887   338 raft_consensus.cc:2468] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:34.323905   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72cfaa775c3b4fb2a7756d6042ab17b9" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:34.326287   530 leader_election.cc:304] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:12:34.328526   610 ts_tablet_manager.cc:1434] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:12:34.330149   610 tablet_bootstrap.cc:492] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:34.330742   611 tablet_bootstrap.cc:492] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:34.331225   611 ts_tablet_manager.cc:1403] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.007s
W20260709 13:12:34.327255   530 leader_election.cc:343] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.329962   715 raft_consensus.cc:2804] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.336349   615 tablet_bootstrap.cc:492] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:34.336845   615 ts_tablet_manager.cc:1403] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.003s
I20260709 13:12:34.338197   715 raft_consensus.cc:493] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.338678   715 raft_consensus.cc:3060] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.339385   610 tablet_bootstrap.cc:654] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.339746   615 raft_consensus.cc:359] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.340504   615 raft_consensus.cc:385] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.340821   615 raft_consensus.cc:740] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.344024   615 consensus_queue.cc:260] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.348333   615 ts_tablet_manager.cc:1434] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:34.352519   611 raft_consensus.cc:359] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.352043   615 tablet_bootstrap.cc:492] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:34.352056   614 raft_consensus.cc:515] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.353236   611 raft_consensus.cc:385] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.354041   611 raft_consensus.cc:740] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.354787   611 consensus_queue.cc:260] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.355520   614 leader_election.cc:290] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:34.356881   611 ts_tablet_manager.cc:1434] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.002s
I20260709 13:12:34.357978   611 tablet_bootstrap.cc:492] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:34.360839   615 tablet_bootstrap.cc:654] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.363317   612 tablet_bootstrap.cc:492] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:34.373117   612 ts_tablet_manager.cc:1403] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.000s
I20260709 13:12:34.381225   612 raft_consensus.cc:359] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.382280   612 raft_consensus.cc:385] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.382609   612 raft_consensus.cc:740] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.376865   715 raft_consensus.cc:515] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.389153   715 leader_election.cc:290] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:34.383742   611 tablet_bootstrap.cc:654] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.393200   615 tablet_bootstrap.cc:492] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:34.393807   615 ts_tablet_manager.cc:1403] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.019s
I20260709 13:12:34.401296   615 raft_consensus.cc:359] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.402313   615 raft_consensus.cc:385] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.402622   615 raft_consensus.cc:740] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.403407   615 consensus_queue.cc:260] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.407677   610 tablet_bootstrap.cc:492] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:34.408291   610 ts_tablet_manager.cc:1403] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.030s
I20260709 13:12:34.410007   615 ts_tablet_manager.cc:1434] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:12:34.411190   615 tablet_bootstrap.cc:492] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:34.411319   610 raft_consensus.cc:359] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.412041   610 raft_consensus.cc:385] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.412307   610 raft_consensus.cc:740] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.413046   610 consensus_queue.cc:260] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.414922   611 tablet_bootstrap.cc:492] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:34.415473   610 ts_tablet_manager.cc:1434] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:34.415603   611 ts_tablet_manager.cc:1403] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.005s
I20260709 13:12:34.418596   610 tablet_bootstrap.cc:492] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:34.418892   615 tablet_bootstrap.cc:654] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.419283   611 raft_consensus.cc:359] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.420166   611 raft_consensus.cc:385] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.421465   611 raft_consensus.cc:740] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.422454   611 consensus_queue.cc:260] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.425290   611 ts_tablet_manager.cc:1434] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:34.426731   611 tablet_bootstrap.cc:492] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:34.430845   610 tablet_bootstrap.cc:654] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.439098   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72cfaa775c3b4fb2a7756d6042ab17b9" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:34.439911   338 raft_consensus.cc:3060] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.446838   338 raft_consensus.cc:2468] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:34.866078   661 raft_consensus.cc:493] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.866731   661 raft_consensus.cc:515] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.868975   661 leader_election.cc:290] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:34.873093   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:34.876150   379 leader_election.cc:343] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.877851   661 raft_consensus.cc:493] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.878509   661 raft_consensus.cc:515] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.882854   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:34.902215   338 raft_consensus.cc:2468] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:34.905437   381 leader_election.cc:304] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:34.911422   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:34.912319   491 raft_consensus.cc:2468] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:34.914995   661 leader_election.cc:290] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:34.916632   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:34.917585   488 raft_consensus.cc:3060] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.921597   748 raft_consensus.cc:493] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.922158   748 raft_consensus.cc:515] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.926792   488 raft_consensus.cc:2468] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:34.929593   304 leader_election.cc:304] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:34.931499   748 leader_election.cc:290] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:34.928278   661 raft_consensus.cc:2804] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:34.934355   661 raft_consensus.cc:493] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.934831   661 raft_consensus.cc:3060] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.936913   748 raft_consensus.cc:493] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.937428   748 raft_consensus.cc:515] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:34.940480   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:34.942087   304 leader_election.cc:343] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.942759   751 raft_consensus.cc:2804] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.943291   751 raft_consensus.cc:697] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:34.944317   610 tablet_bootstrap.cc:492] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:34.944183   751 consensus_queue.cc:237] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.944876   610 ts_tablet_manager.cc:1403] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.526s	user 0.018s	sys 0.010s
I20260709 13:12:34.946451   661 raft_consensus.cc:515] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.947866   658 consensus_queue.cc:1048] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:34.949715   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:34.950384   338 raft_consensus.cc:3060] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.951754   610 raft_consensus.cc:359] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.952580   610 raft_consensus.cc:385] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.952860   610 raft_consensus.cc:740] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.954244   748 leader_election.cc:290] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:34.955267   610 consensus_queue.cc:260] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:34.958663   610 ts_tablet_manager.cc:1434] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:12:34.959342   340 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.959722   610 tablet_bootstrap.cc:492] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:34.959879   338 raft_consensus.cc:2468] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 2.
I20260709 13:12:34.961442   381 leader_election.cc:304] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:34.962419   701 raft_consensus.cc:2804] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:34.962888   701 raft_consensus.cc:697] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:34.963676   701 consensus_queue.cc:237] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:34.964002   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72cfaa775c3b4fb2a7756d6042ab17b9" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:34.977528   488 raft_consensus.cc:3060] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.980188   652 raft_consensus.cc:493] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.980927   652 raft_consensus.cc:515] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:34.983634   652 leader_election.cc:290] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:34.988911   611 tablet_bootstrap.cc:654] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.991849   491 raft_consensus.cc:3060] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.998880   719 consensus_queue.cc:1048] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.014788   661 leader_election.cc:290] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:35.016609   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:35.017401   490 raft_consensus.cc:3060] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:35.020995   610 tablet_bootstrap.cc:654] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.014338   719 consensus_queue.cc:1048] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.033798   751 raft_consensus.cc:493] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.034426   751 raft_consensus.cc:515] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.037721   751 leader_election.cc:290] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:35.039498   489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:35.040467   489 raft_consensus.cc:2468] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:35.047940   304 leader_election.cc:304] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
W20260709 13:12:35.082731   530 leader_election.cc:343] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.089805   530 leader_election.cc:304] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:35.071103   490 raft_consensus.cc:2468] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 2.
I20260709 13:12:35.094240   652 raft_consensus.cc:2804] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.091079   701 consensus_queue.cc:1048] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:35.101107   652 raft_consensus.cc:697] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:35.101596   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77cacfdc1e943a6ae75838391278350" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:35.102273   652 consensus_queue.cc:237] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
W20260709 13:12:35.103312   615 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.007s	sys 0.000s
W20260709 13:12:35.103637   615 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.007s	sys 0.000s
I20260709 13:12:35.104460   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77cacfdc1e943a6ae75838391278350" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:35.105957   615 tablet_bootstrap.cc:492] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:35.106633   615 ts_tablet_manager.cc:1403] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.696s	user 0.020s	sys 0.000s
I20260709 13:12:35.105253   415 raft_consensus.cc:2393] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54e079297e3a4863ac2eccd69f7dbd9c in current term 1: Already voted for candidate 70c1750ca53a445883b66469ea339141 in this term.
I20260709 13:12:35.119287   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:35.111168   620 raft_consensus.cc:493] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.127861   620 raft_consensus.cc:515] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.126044   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208e3c5b595545858696a33f8e73deab" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
W20260709 13:12:35.138513   306 leader_election.cc:343] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.139590   690 raft_consensus.cc:2804] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:35.144719   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:35.141675   611 tablet_bootstrap.cc:492] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:35.161631   611 ts_tablet_manager.cc:1403] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.735s	user 0.026s	sys 0.027s
I20260709 13:12:35.147802   615 raft_consensus.cc:359] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.163376   615 raft_consensus.cc:385] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.163717   615 raft_consensus.cc:740] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.164606   615 consensus_queue.cc:260] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.167990   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bdd222276f45d0b94756421060da52" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:35.179354   615 ts_tablet_manager.cc:1434] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.001s
I20260709 13:12:35.180830   615 tablet_bootstrap.cc:492] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:35.143105   620 leader_election.cc:290] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
W20260709 13:12:35.157727   306 leader_election.cc:343] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.183230 32705 catalog_manager.cc:5697] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.145845   530 leader_election.cc:304] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
W20260709 13:12:35.184866   457 leader_election.cc:343] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.206616   715 raft_consensus.cc:3060] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.210377   611 raft_consensus.cc:359] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.210954   611 raft_consensus.cc:385] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.211243   611 raft_consensus.cc:740] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.213106   690 raft_consensus.cc:493] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7b79bd4dca614b218791c5293a51c7a9)
W20260709 13:12:35.213282   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:35023, user_credentials={real_user=slave}} blocked reactor thread for 67476.9us
I20260709 13:12:35.213938   690 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:35.214277   701 consensus_queue.cc:1048] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.216010   749 consensus_queue.cc:1048] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:35.217150   720 raft_consensus.cc:493] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.217684   720 raft_consensus.cc:515] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.219772   720 leader_election.cc:290] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:35.220604   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31cf36e914b5401f9584db0b92dd2591" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:35.219676   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bdd222276f45d0b94756421060da52" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:35.223054   715 raft_consensus.cc:2749] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:35.224408   456 leader_election.cc:343] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.224907   456 leader_election.cc:304] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:35.225900   610 tablet_bootstrap.cc:492] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:35.226477   610 ts_tablet_manager.cc:1403] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.267s	user 0.022s	sys 0.023s
I20260709 13:12:35.226604   630 consensus_queue.cc:1048] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.227985   747 raft_consensus.cc:2749] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.233934   611 consensus_queue.cc:260] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.232775   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31cf36e914b5401f9584db0b92dd2591" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:35.236487   338 raft_consensus.cc:2468] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:35.238727   610 raft_consensus.cc:359] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.239408   610 raft_consensus.cc:385] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.239658   610 raft_consensus.cc:740] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.240516   610 consensus_queue.cc:260] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.240976   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:35.241786   701 consensus_queue.cc:1048] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.383386   612 consensus_queue.cc:260] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
W20260709 13:12:35.242973   379 leader_election.cc:343] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.244462   612 ts_tablet_manager.cc:1434] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.871s	user 0.017s	sys 0.003s
W20260709 13:12:35.244812   612 ts_tablet_manager.cc:1467] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c: Tablet startup took 871ms
I20260709 13:12:35.245793   718 raft_consensus.cc:493] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.227821   690 raft_consensus.cc:515] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.257194   611 ts_tablet_manager.cc:1434] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.003s
I20260709 13:12:35.248111   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208e3c5b595545858696a33f8e73deab" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:35.262634   610 ts_tablet_manager.cc:1434] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 13:12:35.263309   611 tablet_bootstrap.cc:492] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:35.263648   610 tablet_bootstrap.cc:492] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
W20260709 13:12:35.245098   612 ts_tablet_manager.cc:1469] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c: Trace:
0709 13:12:31.020095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.025380 (+  5285us) service_pool.cc:224] Handling call
0709 13:12:31.028193 (+  2813us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:12:31.028316 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:12:31.237115 (+208799us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:31.412843 (+175728us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:31.414525 (+  1682us) inbound_call.cc:177] Queueing success response
0709 13:12:34.283297 (+2868772us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:12:34.373505 (+ 90208us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:12:34.378193 (+  4688us) tablet_replica.cc:261] Starting instrumentation
0709 13:12:34.379042 (+   849us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":3629,"tablet-open.queue_time_us":2868856}
I20260709 13:12:35.266752   612 tablet_bootstrap.cc:492] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:35.254081   718 raft_consensus.cc:515] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.281392   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:35.283036   661 raft_consensus.cc:493] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.283583   661 raft_consensus.cc:515] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.286187   661 leader_election.cc:290] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:35.286496   615 tablet_bootstrap.cc:654] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.291028   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
W20260709 13:12:35.292658   381 leader_election.cc:343] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.297631   610 tablet_bootstrap.cc:654] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.304554   615 tablet_bootstrap.cc:492] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:35.305197   615 ts_tablet_manager.cc:1403] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.125s	user 0.008s	sys 0.006s
I20260709 13:12:35.316509   381 leader_election.cc:304] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:35.317884   718 leader_election.cc:290] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:35.319835   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b5dfaf74c940a19f58b2d439e6b768" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:35.318324   661 raft_consensus.cc:2804] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.322445   661 raft_consensus.cc:493] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.323000   661 raft_consensus.cc:3060] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:35.325106   307 leader_election.cc:343] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:35.325183   382 consensus_peers.cc:597] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.325735   307 leader_election.cc:304] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9
W20260709 13:12:35.326205   382 leader_election.cc:343] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.326830   749 raft_consensus.cc:2749] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.326779   382 leader_election.cc:304] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:35.328008   720 raft_consensus.cc:2749] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.333313   615 raft_consensus.cc:359] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.334167   615 raft_consensus.cc:385] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.334484   615 raft_consensus.cc:740] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.335618   615 consensus_queue.cc:260] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.338346   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
W20260709 13:12:35.339355   307 leader_election.cc:343] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.339833   307 leader_election.cc:304] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:35.340611   614 consensus_queue.cc:1048] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.341007   749 raft_consensus.cc:2749] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.338500   615 ts_tablet_manager.cc:1434] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:12:35.343581   615 tablet_bootstrap.cc:492] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:35.344404   690 leader_election.cc:290] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:35.366582   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:35.370987   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:35.371409   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b5dfaf74c940a19f58b2d439e6b768" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
W20260709 13:12:35.371404   379 leader_election.cc:343] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.372850   379 leader_election.cc:304] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:35.373278   615 tablet_bootstrap.cc:654] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.373667   720 raft_consensus.cc:2749] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.374574   611 tablet_bootstrap.cc:654] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.378413   612 tablet_bootstrap.cc:654] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.377769   530 leader_election.cc:304] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:35.383085   306 leader_election.cc:304] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:35.384349   749 raft_consensus.cc:2749] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:35.385433   715 raft_consensus.cc:2749] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.388826   661 raft_consensus.cc:515] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.390097   563 raft_consensus.cc:3060] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.406623   338 raft_consensus.cc:1275] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Refusing update from remote peer 7b79bd4dca614b218791c5293a51c7a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:35.410422   719 consensus_queue.cc:1048] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.425628   612 tablet_bootstrap.cc:492] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:35.426294   612 ts_tablet_manager.cc:1403] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.160s	user 0.013s	sys 0.008s
I20260709 13:12:35.431418   612 raft_consensus.cc:359] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.434726   612 raft_consensus.cc:385] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.435062   612 raft_consensus.cc:740] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.433935   414 raft_consensus.cc:3060] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.439462   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31cf36e914b5401f9584db0b92dd2591" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:35.440414   339 raft_consensus.cc:3060] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:35.442451 32738 debug-util.cc:398] Leaking SignalData structure 0x7b08001688a0 after lost signal to thread 25398
W20260709 13:12:35.443624 32738 debug-util.cc:398] Leaking SignalData structure 0x7b080033dda0 after lost signal to thread 32741
W20260709 13:12:35.445020 32738 debug-util.cc:398] Leaking SignalData structure 0x7b08004066a0 after lost signal to thread 365
I20260709 13:12:35.446250   612 consensus_queue.cc:260] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.448093   661 leader_election.cc:290] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:35.449761   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31cf36e914b5401f9584db0b92dd2591" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
W20260709 13:12:35.446727 32738 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0720 after lost signal to thread 440
W20260709 13:12:35.453191 32738 debug-util.cc:398] Leaking SignalData structure 0x7b08002e06c0 after lost signal to thread 441
I20260709 13:12:35.453351   487 raft_consensus.cc:1275] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 7b79bd4dca614b218791c5293a51c7a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:35.453485   749 consensus_queue.cc:1048] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.450878   488 raft_consensus.cc:3060] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:35.454434 32738 debug-util.cc:398] Leaking SignalData structure 0x7b080009f100 after lost signal to thread 515
W20260709 13:12:35.455686 32738 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac9a0 after lost signal to thread 589
W20260709 13:12:35.455971 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:35.457985   701 consensus_queue.cc:1048] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.483371   661 raft_consensus.cc:493] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:35.483456   782 log.cc:927] Time spent T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 13:12:35.484074   661 raft_consensus.cc:515] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.487085   610 tablet_bootstrap.cc:492] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:35.487641   610 ts_tablet_manager.cc:1403] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.224s	user 0.015s	sys 0.006s
I20260709 13:12:35.487555   694 consensus_queue.cc:1048] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.489874   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72cfaa775c3b4fb2a7756d6042ab17b9" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:35.490630   610 raft_consensus.cc:359] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.481060   488 raft_consensus.cc:2468] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:35.492589   612 ts_tablet_manager.cc:1434] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.001s
I20260709 13:12:35.491369   610 raft_consensus.cc:385] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.490681   340 raft_consensus.cc:2393] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 in current term 1: Already voted for candidate 54e079297e3a4863ac2eccd69f7dbd9c in this term.
I20260709 13:12:35.494146   612 tablet_bootstrap.cc:492] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:35.491258   661 leader_election.cc:290] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:35.500665   610 raft_consensus.cc:740] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.494038   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72cfaa775c3b4fb2a7756d6042ab17b9" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:35.517767   610 consensus_queue.cc:260] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.520368   615 tablet_bootstrap.cc:492] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:35.520886   615 ts_tablet_manager.cc:1403] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.177s	user 0.027s	sys 0.015s
I20260709 13:12:35.526639   339 raft_consensus.cc:2468] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:35.530964   379 leader_election.cc:304] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:35.531702 32705 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52024 (request call id 26) took 1183 ms. Trace:
I20260709 13:12:35.532431   661 raft_consensus.cc:2804] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.533018   661 raft_consensus.cc:697] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:35.533906   661 consensus_queue.cc:237] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.546700   381 leader_election.cc:304] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141
I20260709 13:12:35.546200 32707 catalog_manager.cc:5697] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 1 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.553064   701 raft_consensus.cc:3060] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.561234   610 ts_tablet_manager.cc:1434] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.002s
I20260709 13:12:35.561915   701 raft_consensus.cc:2749] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.562721   610 tablet_bootstrap.cc:492] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:35.532123 32705 rpcz_store.cc:276] 0709 13:12:34.348168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.348316 (+   148us) service_pool.cc:224] Handling call
0709 13:12:35.531631 (+1183315us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:35.277186 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:35.294034 (+ 16848us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:35.294070 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:12:35.294088 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:35.294444 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:35.294516 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:35.294549 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:35.294754 (+   205us) tablet.cc:701] Row locks acquired
0709 13:12:35.294780 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:12:35.294933 (+   153us) write_op.cc:270] Start()
0709 13:12:35.295038 (+   105us) write_op.cc:276] Timestamp: P: 1783602755294889 usec, L: 0
0709 13:12:35.295058 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:12:35.295725 (+   667us) log.cc:844] Serialized 543 byte log entry
0709 13:12:35.493962 (+198237us) op_driver.cc:464] REPLICATION: finished
0709 13:12:35.502912 (+  8950us) write_op.cc:301] APPLY: starting
0709 13:12:35.503044 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:35.503188 (+   144us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:35.503359 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:35.503622 (+   263us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:35.503846 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:35.503916 (+    70us) write_op.cc:312] APPLY: finished
0709 13:12:35.504152 (+   236us) log.cc:844] Serialized 22 byte log entry
0709 13:12:35.504356 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:35.504464 (+   108us) write_op.cc:454] Released schema lock
0709 13:12:35.504514 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:35.509521 (+  5007us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:35.511794 (+  2273us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":201094,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":8672,"apply.run_cpu_time_us":2069,"apply.run_wall_time_us":2069,"num_ops":1,"prepare.queue_time_us":52872,"prepare.run_cpu_time_us":26436,"prepare.run_wall_time_us":88640,"raft.queue_time_us":93968,"raft.run_cpu_time_us":1388,"raft.run_wall_time_us":11243,"replication_time_us":198746,"spinlock_wait_cycles":10387840,"thread_start_us":174227,"threads_started":4,"wal-append.queue_time_us":86505}]]}
I20260709 13:12:35.566159   611 tablet_bootstrap.cc:492] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:35.566707   611 ts_tablet_manager.cc:1403] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.308s	user 0.037s	sys 0.036s
I20260709 13:12:35.567759   612 tablet_bootstrap.cc:654] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.569406   611 raft_consensus.cc:359] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.570163   611 raft_consensus.cc:385] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.570436   611 raft_consensus.cc:740] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.572860   611 consensus_queue.cc:260] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.574440   694 raft_consensus.cc:493] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.574945   694 raft_consensus.cc:515] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.575510   611 ts_tablet_manager.cc:1434] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:35.576499   611 tablet_bootstrap.cc:492] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:35.577176   694 leader_election.cc:290] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:35.580168   718 consensus_queue.cc:1048] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.576175   615 raft_consensus.cc:359] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.583323   615 raft_consensus.cc:385] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.583613   615 raft_consensus.cc:740] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.586974   611 tablet_bootstrap.cc:654] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.587147   615 consensus_queue.cc:260] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.588198   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c447d7bc00cf4281a661063406c070ee" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:35.592100   615 ts_tablet_manager.cc:1434] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.003s
W20260709 13:12:35.589775   307 leader_election.cc:343] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.596743   615 tablet_bootstrap.cc:492] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:35.610072   610 tablet_bootstrap.cc:654] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.617733   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c447d7bc00cf4281a661063406c070ee" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:35.655094   611 tablet_bootstrap.cc:492] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:35.655643   611 ts_tablet_manager.cc:1403] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.079s	user 0.025s	sys 0.007s
I20260709 13:12:35.656986   615 tablet_bootstrap.cc:654] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.657079   755 consensus_queue.cc:1048] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.658625   611 raft_consensus.cc:359] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.659384   611 raft_consensus.cc:385] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.659646   611 raft_consensus.cc:740] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.660399   611 consensus_queue.cc:260] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.662453   611 ts_tablet_manager.cc:1434] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:12:35.663187   304 leader_election.cc:343] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.663753   611 tablet_bootstrap.cc:492] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:35.663719   304 leader_election.cc:304] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:35.669826   694 raft_consensus.cc:2749] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.670626   611 tablet_bootstrap.cc:654] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.672987   612 tablet_bootstrap.cc:492] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:35.673548   612 ts_tablet_manager.cc:1403] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.180s	user 0.021s	sys 0.009s
I20260709 13:12:35.645908 32704 catalog_manager.cc:5697] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.679584   610 tablet_bootstrap.cc:492] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:35.680155   610 ts_tablet_manager.cc:1403] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.118s	user 0.033s	sys 0.004s
I20260709 13:12:35.681638   611 tablet_bootstrap.cc:492] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:35.682098   611 ts_tablet_manager.cc:1403] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:12:35.682919   610 raft_consensus.cc:359] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.683661   610 raft_consensus.cc:385] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.683924   610 raft_consensus.cc:740] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.684584   610 consensus_queue.cc:260] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.691344   612 raft_consensus.cc:359] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.692189   612 raft_consensus.cc:385] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.692484   612 raft_consensus.cc:740] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.693214   612 consensus_queue.cc:260] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.695761   615 tablet_bootstrap.cc:492] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:35.696640   612 ts_tablet_manager.cc:1434] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:12:35.697757   612 tablet_bootstrap.cc:492] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:35.696309   615 ts_tablet_manager.cc:1403] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.001s
I20260709 13:12:35.701197   611 raft_consensus.cc:359] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.701681   615 raft_consensus.cc:359] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.705425   615 raft_consensus.cc:385] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.705766   615 raft_consensus.cc:740] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.706178   612 tablet_bootstrap.cc:654] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.702098   611 raft_consensus.cc:385] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.708076   611 raft_consensus.cc:740] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.708887   611 consensus_queue.cc:260] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.711651   611 ts_tablet_manager.cc:1434] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:12:35.712021 32705 catalog_manager.cc:5697] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } }
I20260709 13:12:35.704463   610 ts_tablet_manager.cc:1434] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:12:35.714927   610 tablet_bootstrap.cc:492] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:35.706540   615 consensus_queue.cc:260] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.724035   615 ts_tablet_manager.cc:1434] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:12:35.713084   611 tablet_bootstrap.cc:492] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:35.733631   615 tablet_bootstrap.cc:492] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:35.742694   610 tablet_bootstrap.cc:654] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.742864   340 raft_consensus.cc:1240] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Rejecting Update request from peer 7b79bd4dca614b218791c5293a51c7a9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:35.743407   611 tablet_bootstrap.cc:654] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.743538 32707 catalog_manager.cc:5697] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.744679   701 consensus_queue.cc:1059] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:35.745699   701 raft_consensus.cc:3055] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:35.746016   701 raft_consensus.cc:740] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:35.746753   615 tablet_bootstrap.cc:654] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.746822   701 consensus_queue.cc:260] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.748417   701 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:35.767426   611 tablet_bootstrap.cc:492] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:35.767985   611 ts_tablet_manager.cc:1403] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.007s
I20260709 13:12:35.768307   612 tablet_bootstrap.cc:492] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:35.768841   612 ts_tablet_manager.cc:1403] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.071s	user 0.028s	sys 0.020s
I20260709 13:12:35.770689   611 raft_consensus.cc:359] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.771420   611 raft_consensus.cc:385] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.771818   611 raft_consensus.cc:740] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.771474   612 raft_consensus.cc:359] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.772241   612 raft_consensus.cc:385] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.772722   612 raft_consensus.cc:740] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.772591   611 consensus_queue.cc:260] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:35.773581   612 consensus_queue.cc:260] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.779328   611 ts_tablet_manager.cc:1434] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:12:35.780356   611 tablet_bootstrap.cc:492] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:35.781040   615 tablet_bootstrap.cc:492] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:35.785135   615 ts_tablet_manager.cc:1403] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.011s
I20260709 13:12:35.786798   611 tablet_bootstrap.cc:654] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.788250   615 raft_consensus.cc:359] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.789247   755 raft_consensus.cc:493] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.801836   615 raft_consensus.cc:385] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.802001   755 raft_consensus.cc:515] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.802376   615 raft_consensus.cc:740] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.803912   615 consensus_queue.cc:260] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.775367   610 tablet_bootstrap.cc:492] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:35.805428   610 ts_tablet_manager.cc:1403] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.000s
I20260709 13:12:35.806097   615 ts_tablet_manager.cc:1434] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:12:35.807099   615 tablet_bootstrap.cc:492] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:35.807127   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5a50bacfa64214acf10104084bb1be" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:35.807897   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5a50bacfa64214acf10104084bb1be" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:35.808276   610 raft_consensus.cc:359] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.808967   610 raft_consensus.cc:385] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.809224   610 raft_consensus.cc:740] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.809896   610 consensus_queue.cc:260] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.810300   528 leader_election.cc:304] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:35.811157   715 raft_consensus.cc:2749] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.811951   610 ts_tablet_manager.cc:1434] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:35.812930   610 tablet_bootstrap.cc:492] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:35.813730   615 tablet_bootstrap.cc:654] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.822707   610 tablet_bootstrap.cc:654] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.804402   755 leader_election.cc:290] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:35.830749   563 raft_consensus.cc:3060] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.840417   612 ts_tablet_manager.cc:1434] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:12:35.847203   610 tablet_bootstrap.cc:492] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:35.848002   610 ts_tablet_manager.cc:1403] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.007s
I20260709 13:12:35.847290   612 tablet_bootstrap.cc:492] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:35.862390   610 raft_consensus.cc:359] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.863387   610 raft_consensus.cc:385] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.865216   615 tablet_bootstrap.cc:492] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:35.869112   615 ts_tablet_manager.cc:1403] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.010s
I20260709 13:12:35.870268   611 tablet_bootstrap.cc:492] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:35.870816   611 ts_tablet_manager.cc:1403] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.027s
I20260709 13:12:35.871980   615 raft_consensus.cc:359] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.872706   615 raft_consensus.cc:385] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.872963   615 raft_consensus.cc:740] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.873621   615 consensus_queue.cc:260] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.878958   615 ts_tablet_manager.cc:1434] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:35.878719   611 raft_consensus.cc:359] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.879544   611 raft_consensus.cc:385] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.879927   615 tablet_bootstrap.cc:492] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:35.879874   611 raft_consensus.cc:740] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.880844   611 consensus_queue.cc:260] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.867422   612 tablet_bootstrap.cc:654] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.887820   620 raft_consensus.cc:493] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.888685   611 ts_tablet_manager.cc:1434] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 13:12:35.888374   620 raft_consensus.cc:515] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.889883   611 tablet_bootstrap.cc:492] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:35.890769   620 leader_election.cc:290] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:35.893304   615 tablet_bootstrap.cc:654] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.893852   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:35.894533   340 raft_consensus.cc:2468] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:35.889806   610 raft_consensus.cc:740] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.895893   456 leader_election.cc:304] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:35.896100   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:35.896751   563 raft_consensus.cc:2468] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:35.900830   611 tablet_bootstrap.cc:654] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.896768   610 consensus_queue.cc:260] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.903244   620 raft_consensus.cc:2804] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.903789   620 raft_consensus.cc:493] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.904181   620 raft_consensus.cc:3060] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.905275   610 ts_tablet_manager.cc:1434] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:12:35.910470   610 tablet_bootstrap.cc:492] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:35.917398   612 tablet_bootstrap.cc:492] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:35.918020   612 ts_tablet_manager.cc:1403] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.001s
I20260709 13:12:35.919899   610 tablet_bootstrap.cc:654] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.920785   612 raft_consensus.cc:359] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.921485   612 raft_consensus.cc:385] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.921768   612 raft_consensus.cc:740] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.922534   612 consensus_queue.cc:260] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.926144   612 ts_tablet_manager.cc:1434] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:35.927160   612 tablet_bootstrap.cc:492] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:35.932866   612 tablet_bootstrap.cc:654] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.937088   620 raft_consensus.cc:515] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.946552   661 consensus_queue.cc:1048] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.948482   620 leader_election.cc:290] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:35.952204   615 tablet_bootstrap.cc:492] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:35.953233   615 ts_tablet_manager.cc:1403] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.009s
I20260709 13:12:35.956178   615 raft_consensus.cc:359] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.956413   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:35.956903   615 raft_consensus.cc:385] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.957114   339 raft_consensus.cc:3060] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.957403   615 raft_consensus.cc:740] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.950958   611 tablet_bootstrap.cc:492] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:35.958086   610 tablet_bootstrap.cc:492] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:35.958681   610 ts_tablet_manager.cc:1403] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.003s
I20260709 13:12:35.959025   615 consensus_queue.cc:260] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.958681   611 ts_tablet_manager.cc:1403] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.016s
I20260709 13:12:35.961911   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:35.961790   610 raft_consensus.cc:359] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.962607   610 raft_consensus.cc:385] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.962607   563 raft_consensus.cc:3060] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.963779   610 raft_consensus.cc:740] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.964785   611 raft_consensus.cc:359] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.964742   610 consensus_queue.cc:260] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:35.965543   611 raft_consensus.cc:385] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.967142   610 ts_tablet_manager.cc:1434] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:35.968186   610 tablet_bootstrap.cc:492] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:35.972204   615 ts_tablet_manager.cc:1434] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:12:35.973320   615 tablet_bootstrap.cc:492] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:35.975559   610 tablet_bootstrap.cc:654] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.973251   563 raft_consensus.cc:2468] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:35.976749   694 raft_consensus.cc:493] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.977378   694 raft_consensus.cc:515] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.977936   457 leader_election.cc:304] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:35.965898   611 raft_consensus.cc:740] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.982046   620 raft_consensus.cc:2804] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.982528   620 raft_consensus.cc:697] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:35.982878   611 consensus_queue.cc:260] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:35.983297   620 consensus_queue.cc:237] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.982786   751 raft_consensus.cc:493] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.988176   611 ts_tablet_manager.cc:1434] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.003s
I20260709 13:12:35.989300   611 tablet_bootstrap.cc:492] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:35.987993   751 raft_consensus.cc:515] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:35.995141   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55312d46dd4747c0bacb0d980ca208b1" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:35.995858   490 raft_consensus.cc:2468] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:35.996240   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e165c0d45844da9b680b461c2b5493" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:35.996923   416 raft_consensus.cc:2468] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:35.997676   694 leader_election.cc:290] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:35.997465   304 leader_election.cc:304] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:35.998785   306 leader_election.cc:304] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:35.999748   690 raft_consensus.cc:2804] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.000240   690 raft_consensus.cc:493] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.000684   690 raft_consensus.cc:3060] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.000792   614 raft_consensus.cc:2804] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.001349   614 raft_consensus.cc:493] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.001724   614 raft_consensus.cc:3060] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.003443   751 leader_election.cc:290] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:36.004349   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e165c0d45844da9b680b461c2b5493" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:36.006249   701 raft_consensus.cc:493] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.006817   701 raft_consensus.cc:515] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.007207   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55312d46dd4747c0bacb0d980ca208b1" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:36.010833   701 leader_election.cc:290] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:36.011099   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208e3c5b595545858696a33f8e73deab" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:36.011525   307 leader_election.cc:343] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.011839   563 raft_consensus.cc:2468] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
W20260709 13:12:36.012635   307 leader_election.cc:343] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.013460   382 leader_election.cc:304] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:36.014533   701 raft_consensus.cc:2804] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.014382   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208e3c5b595545858696a33f8e73deab" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:36.016952   338 raft_consensus.cc:2468] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:36.017807   701 raft_consensus.cc:493] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.018357   701 raft_consensus.cc:3060] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.030870   755 raft_consensus.cc:493] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.031581   755 raft_consensus.cc:515] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.035588   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bdd222276f45d0b94756421060da52" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:36.036345   490 raft_consensus.cc:2468] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:36.037493   612 tablet_bootstrap.cc:492] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:36.038023   612 ts_tablet_manager.cc:1403] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.111s	user 0.015s	sys 0.005s
I20260709 13:12:36.038508   339 raft_consensus.cc:2468] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:36.038727   528 leader_election.cc:304] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:36.039700   715 raft_consensus.cc:2804] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.040083   715 raft_consensus.cc:493] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.040429   715 raft_consensus.cc:3060] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.040695   614 raft_consensus.cc:515] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.041194   612 raft_consensus.cc:359] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.042039   612 raft_consensus.cc:385] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.042320   612 raft_consensus.cc:740] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.043143   612 consensus_queue.cc:260] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.031498   615 tablet_bootstrap.cc:654] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.043845   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e165c0d45844da9b680b461c2b5493" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:36.043964   755 leader_election.cc:290] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:36.046031   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bdd222276f45d0b94756421060da52" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:36.046818   414 raft_consensus.cc:2468] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:36.043673   690 raft_consensus.cc:515] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.064435   611 tablet_bootstrap.cc:654] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:36.066196   307 leader_election.cc:343] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.072549   610 tablet_bootstrap.cc:492] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:36.073109   610 ts_tablet_manager.cc:1403] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.105s	user 0.005s	sys 0.029s
I20260709 13:12:36.076006   610 raft_consensus.cc:359] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:36.076701   610 raft_consensus.cc:385] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.076970   610 raft_consensus.cc:740] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.049160   614 leader_election.cc:290] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:36.062911   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e165c0d45844da9b680b461c2b5493" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:36.078329   416 raft_consensus.cc:3060] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.079034   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55312d46dd4747c0bacb0d980ca208b1" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:36.079679   490 raft_consensus.cc:3060] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.085289   612 ts_tablet_manager.cc:1434] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.003s
I20260709 13:12:36.086577   612 tablet_bootstrap.cc:492] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:36.087108   610 consensus_queue.cc:260] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:36.091178   610 ts_tablet_manager.cc:1434] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:36.091919   610 tablet_bootstrap.cc:492] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:36.107290 32704 catalog_manager.cc:5697] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.108731   661 consensus_queue.cc:1048] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.112504   715 raft_consensus.cc:515] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
W20260709 13:12:36.099548   814 log.cc:927] Time spent T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:12:36.128173   715 leader_election.cc:290] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:36.115794   490 raft_consensus.cc:2468] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:36.117161   701 raft_consensus.cc:515] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.137753   304 leader_election.cc:304] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:36.119796   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55312d46dd4747c0bacb0d980ca208b1" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:36.138790   614 raft_consensus.cc:2804] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.122819   630 raft_consensus.cc:493] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.139321   614 raft_consensus.cc:697] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:36.139497   630 raft_consensus.cc:515] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.140611   610 tablet_bootstrap.cc:654] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.140285   614 consensus_queue.cc:237] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.141873   630 leader_election.cc:290] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:36.142990   694 raft_consensus.cc:493] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.143603   694 raft_consensus.cc:515] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:36.142946   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40791a3fd5f24fcc97260df7cb88f115" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:36.144737   415 raft_consensus.cc:2468] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:36.146238   456 leader_election.cc:304] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:36.138283   416 raft_consensus.cc:2468] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:36.147483   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40791a3fd5f24fcc97260df7cb88f115" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:36.148041   694 leader_election.cc:290] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
W20260709 13:12:36.149365   457 leader_election.cc:343] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.150144   612 tablet_bootstrap.cc:654] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.150403   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208e3c5b595545858696a33f8e73deab" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:36.151264   340 raft_consensus.cc:3060] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.123268   620 raft_consensus.cc:493] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.155347   620 raft_consensus.cc:515] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.150746   630 raft_consensus.cc:2804] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.125697   615 tablet_bootstrap.cc:492] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:36.137931   701 leader_election.cc:290] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:36.118582   690 leader_election.cc:290] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:36.157513   630 raft_consensus.cc:493] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.158072   615 ts_tablet_manager.cc:1403] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.185s	user 0.015s	sys 0.010s
I20260709 13:12:36.158511   630 raft_consensus.cc:3060] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.161693   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bdd222276f45d0b94756421060da52" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:36.163362   488 raft_consensus.cc:3060] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.167724   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bdd222276f45d0b94756421060da52" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:36.168855   415 raft_consensus.cc:3060] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.171365   615 raft_consensus.cc:359] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.172358   615 raft_consensus.cc:385] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.172765   615 raft_consensus.cc:740] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.161661   306 leader_election.cc:304] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
W20260709 13:12:36.180723   307 leader_election.cc:343] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.162035   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208e3c5b595545858696a33f8e73deab" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:36.190378   563 raft_consensus.cc:3060] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.199028   620 leader_election.cc:290] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:36.199958   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:36.201462   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c447d7bc00cf4281a661063406c070ee" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:36.214344   565 raft_consensus.cc:2468] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:36.215940   690 raft_consensus.cc:493] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.216555   690 raft_consensus.cc:515] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
W20260709 13:12:36.217442   306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:35023, user_credentials={real_user=slave}} blocked reactor thread for 55898.7us
I20260709 13:12:36.218910   614 raft_consensus.cc:493] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.218819   457 leader_election.cc:304] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:36.219590   614 raft_consensus.cc:515] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.220907   823 raft_consensus.cc:2804] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:36.221117   306 leader_election.cc:343] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.221519   823 raft_consensus.cc:493] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.222067   823 raft_consensus.cc:3060] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.223762   751 raft_consensus.cc:2804] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.224330   751 raft_consensus.cc:697] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:36.226274   615 consensus_queue.cc:260] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.228077   690 leader_election.cc:290] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:36.228662   615 ts_tablet_manager.cc:1434] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 13:12:36.229965   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:36.225204   751 consensus_queue.cc:237] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.234472   630 raft_consensus.cc:515] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.235842   614 leader_election.cc:290] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:36.238200   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0cb63fe6b54741b53e72257d8eea82" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:36.240634   304 leader_election.cc:343] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.244920   304 leader_election.cc:304] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:36.248334   614 raft_consensus.cc:2749] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.242035   415 raft_consensus.cc:2468] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:36.243534   413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0cb63fe6b54741b53e72257d8eea82" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
W20260709 13:12:36.251368   307 leader_election.cc:343] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.251423   413 raft_consensus.cc:2468] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:36.243983   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c447d7bc00cf4281a661063406c070ee" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:36.253124   339 raft_consensus.cc:2468] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:36.245030   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:36.242134   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:36.254173   491 raft_consensus.cc:2468] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:36.254259   414 raft_consensus.cc:2468] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:36.255908   306 leader_election.cc:304] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:36.256937   530 leader_election.cc:304] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:36.245808   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40791a3fd5f24fcc97260df7cb88f115" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:36.257733   694 raft_consensus.cc:2804] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.257179   306 leader_election.cc:304] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:36.258071   715 raft_consensus.cc:2804] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.258270   694 raft_consensus.cc:493] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.258904   715 raft_consensus.cc:697] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:36.259111   694 raft_consensus.cc:3060] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.260077   715 consensus_queue.cc:237] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.258929   614 raft_consensus.cc:2804] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.265516   614 raft_consensus.cc:493] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.265926   614 raft_consensus.cc:3060] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.258216   416 raft_consensus.cc:3060] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.277936   340 raft_consensus.cc:2468] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:36.257467   488 raft_consensus.cc:2468] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:36.279654   381 leader_election.cc:304] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:36.280418   615 tablet_bootstrap.cc:492] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:36.281311   701 raft_consensus.cc:2804] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.281862   701 raft_consensus.cc:697] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:36.282680   701 consensus_queue.cc:237] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.284065   747 raft_consensus.cc:493] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.284616   747 raft_consensus.cc:515] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.287125   747 leader_election.cc:290] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:36.292639   612 tablet_bootstrap.cc:492] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:36.292869   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:36.293219   612 ts_tablet_manager.cc:1403] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.207s	user 0.004s	sys 0.018s
I20260709 13:12:36.294975   630 leader_election.cc:290] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:36.213104   563 raft_consensus.cc:2468] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:36.296865   611 tablet_bootstrap.cc:492] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:36.297461   611 ts_tablet_manager.cc:1403] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.309s	user 0.005s	sys 0.023s
I20260709 13:12:36.296883 32705 catalog_manager.cc:5697] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 1 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.300506   611 raft_consensus.cc:359] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.301306   611 raft_consensus.cc:385] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.301936   614 raft_consensus.cc:515] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
W20260709 13:12:36.303449   457 leader_election.cc:343] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.305864   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:36.306447   414 raft_consensus.cc:3060] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.307874   416 raft_consensus.cc:2468] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:36.309141   614 leader_election.cc:290] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:36.309255   456 leader_election.cc:304] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:36.310298   630 raft_consensus.cc:2804] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.310708   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40791a3fd5f24fcc97260df7cb88f115" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:36.310858   630 raft_consensus.cc:697] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:36.304344   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:36.311923   630 consensus_queue.cc:237] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
W20260709 13:12:36.313959   457 leader_election.cc:343] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.312770   415 raft_consensus.cc:2468] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:36.316620   456 leader_election.cc:304] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:36.318020   747 raft_consensus.cc:2804] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.318485   747 raft_consensus.cc:493] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.318873   747 raft_consensus.cc:3060] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.305328   823 raft_consensus.cc:515] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.309245   612 raft_consensus.cc:359] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.321895   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c447d7bc00cf4281a661063406c070ee" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:36.322746   612 raft_consensus.cc:385] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.322944   562 raft_consensus.cc:3060] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.323086   612 raft_consensus.cc:740] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.324008   610 tablet_bootstrap.cc:492] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:36.324558   610 ts_tablet_manager.cc:1403] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.233s	user 0.017s	sys 0.009s
I20260709 13:12:36.321367   414 raft_consensus.cc:2468] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:36.329941   306 leader_election.cc:304] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:36.330909   614 raft_consensus.cc:2804] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.331382   614 raft_consensus.cc:697] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:36.331924   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:36.332623   488 raft_consensus.cc:3060] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.332152   614 consensus_queue.cc:237] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:36.337694   611 raft_consensus.cc:740] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.340513   612 consensus_queue.cc:260] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.342185   611 consensus_queue.cc:260] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.343426   615 tablet_bootstrap.cc:654] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.346082 32703 catalog_manager.cc:5697] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.339574   823 leader_election.cc:290] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:36.350677   610 raft_consensus.cc:359] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.351413   610 raft_consensus.cc:385] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.351706   610 raft_consensus.cc:740] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.346933   694 raft_consensus.cc:515] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.353453   611 ts_tablet_manager.cc:1434] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.002s
I20260709 13:12:36.354710   611 tablet_bootstrap.cc:492] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:36.357620   612 ts_tablet_manager.cc:1434] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.002s
I20260709 13:12:36.357952   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c447d7bc00cf4281a661063406c070ee" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:36.357195 32704 catalog_manager.cc:5697] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.358626   340 raft_consensus.cc:3060] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.360268   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0cb63fe6b54741b53e72257d8eea82" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:36.361747   307 leader_election.cc:343] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.361729   661 raft_consensus.cc:493] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.364290   612 tablet_bootstrap.cc:492] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:36.363935   661 raft_consensus.cc:515] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.365083   694 leader_election.cc:290] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:36.367399   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86d3a0eaf524c18ab308eb7803263f0" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:36.368299   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0cb63fe6b54741b53e72257d8eea82" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:36.368513   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86d3a0eaf524c18ab308eb7803263f0" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:36.362541   610 consensus_queue.cc:260] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.369084   415 raft_consensus.cc:3060] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.369318   339 raft_consensus.cc:2468] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:36.370853   610 ts_tablet_manager.cc:1434] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
W20260709 13:12:36.371094   382 leader_election.cc:343] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.371917   610 tablet_bootstrap.cc:492] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:36.372339   381 leader_election.cc:304] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:36.360142 32704 catalog_manager.cc:5697] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.376487   488 raft_consensus.cc:2468] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:36.384338   661 leader_election.cc:290] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:36.386576   615 tablet_bootstrap.cc:492] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:36.401130   630 consensus_queue.cc:1048] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.402048   615 ts_tablet_manager.cc:1403] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.173s	user 0.012s	sys 0.000s
I20260709 13:12:36.410449   415 raft_consensus.cc:2468] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:36.411350   615 raft_consensus.cc:359] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.412758   615 raft_consensus.cc:385] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.413154   615 raft_consensus.cc:740] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.416376   615 consensus_queue.cc:260] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.419651   611 tablet_bootstrap.cc:654] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.420478   720 raft_consensus.cc:2804] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.422221   610 tablet_bootstrap.cc:654] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.421372   720 raft_consensus.cc:493] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.414399   306 leader_election.cc:304] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:36.428944   614 raft_consensus.cc:2804] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.421365   562 raft_consensus.cc:2468] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:36.431010   614 raft_consensus.cc:697] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:36.432511   614 consensus_queue.cc:237] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.446025   630 raft_consensus.cc:493] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.446645   630 raft_consensus.cc:515] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.448982   630 leader_election.cc:290] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:36.449802   457 leader_election.cc:304] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:36.451403   612 tablet_bootstrap.cc:654] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.452858   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d975e40654d90b138939a2c9bc659" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:36.454888   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d975e40654d90b138939a2c9bc659" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:36.455651   415 raft_consensus.cc:2468] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:36.456512   823 raft_consensus.cc:2804] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.457074   823 raft_consensus.cc:697] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:36.458001   823 consensus_queue.cc:237] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
W20260709 13:12:36.426575   381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 54337.7us
I20260709 13:12:36.461206   456 leader_election.cc:304] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:36.462147   620 raft_consensus.cc:2804] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.462563   620 raft_consensus.cc:493] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.462925   620 raft_consensus.cc:3060] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.427404   720 raft_consensus.cc:3060] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.470067   747 raft_consensus.cc:515] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.472049   620 raft_consensus.cc:515] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.479993   620 leader_election.cc:290] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:36.481685 32705 catalog_manager.cc:5697] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.479984   747 leader_election.cc:290] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:36.487517   340 raft_consensus.cc:2468] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:36.494850   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:36.494995   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d975e40654d90b138939a2c9bc659" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:36.495896   457 leader_election.cc:343] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:36.497444   457 leader_election.cc:343] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:36.498469   457 leader_election.cc:343] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.502491   720 raft_consensus.cc:515] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.515398   615 ts_tablet_manager.cc:1434] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.113s	user 0.027s	sys 0.029s
I20260709 13:12:36.517957   615 tablet_bootstrap.cc:492] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:36.539394   720 leader_election.cc:290] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
W20260709 13:12:36.551175   456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 75382.9us
I20260709 13:12:36.562136   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86d3a0eaf524c18ab308eb7803263f0" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:36.562855   341 raft_consensus.cc:3060] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.564042   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:36.564855   415 raft_consensus.cc:3060] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.559103   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86d3a0eaf524c18ab308eb7803263f0" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:36.569490   382 leader_election.cc:343] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.574460   611 tablet_bootstrap.cc:492] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:36.575022   611 ts_tablet_manager.cc:1403] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.221s	user 0.013s	sys 0.010s
I20260709 13:12:36.579362   615 tablet_bootstrap.cc:654] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.582162   611 raft_consensus.cc:359] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.583274   611 raft_consensus.cc:385] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.583781   611 raft_consensus.cc:740] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.588073   611 consensus_queue.cc:260] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.589404   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d975e40654d90b138939a2c9bc659" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:36.602447   611 ts_tablet_manager.cc:1434] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 13:12:36.605362   611 tablet_bootstrap.cc:492] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:36.605373   612 tablet_bootstrap.cc:492] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:36.606246   612 ts_tablet_manager.cc:1403] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.242s	user 0.009s	sys 0.009s
I20260709 13:12:36.608139   414 raft_consensus.cc:3060] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.609622   341 raft_consensus.cc:2468] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:36.611197   381 leader_election.cc:304] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:36.612844   833 raft_consensus.cc:2804] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.613500   833 raft_consensus.cc:697] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:36.614629   833 consensus_queue.cc:237] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.616361   610 tablet_bootstrap.cc:492] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:36.616976   610 ts_tablet_manager.cc:1403] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.245s	user 0.017s	sys 0.002s
W20260709 13:12:36.620675 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:36.623015   747 consensus_queue.cc:1048] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.623378   612 raft_consensus.cc:359] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.624155   612 raft_consensus.cc:385] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.624455   612 raft_consensus.cc:740] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.626968 32704 catalog_manager.cc:5697] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.628569 32704 catalog_manager.cc:5697] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.626359   614 consensus_queue.cc:1048] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.630064   612 consensus_queue.cc:260] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
W20260709 13:12:36.635919   307 consensus_peers.cc:597] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.636268   612 ts_tablet_manager.cc:1434] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:12:36.646553   611 tablet_bootstrap.cc:654] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.665210   612 tablet_bootstrap.cc:492] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:36.667783   414 raft_consensus.cc:2468] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:36.668394   415 raft_consensus.cc:2468] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:36.671012   718 raft_consensus.cc:493] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.671543   718 raft_consensus.cc:515] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.673501   612 tablet_bootstrap.cc:654] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.673842   718 leader_election.cc:290] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:36.675951   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:36.676790   488 raft_consensus.cc:2393] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54e079297e3a4863ac2eccd69f7dbd9c in current term 1: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
I20260709 13:12:36.679952   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:36.680877   416 raft_consensus.cc:2393] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54e079297e3a4863ac2eccd69f7dbd9c in current term 1: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
I20260709 13:12:36.682221   530 leader_election.cc:304] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:36.683077   718 raft_consensus.cc:3060] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.683554   456 leader_election.cc:304] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:36.684648   747 raft_consensus.cc:2804] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.685299   747 raft_consensus.cc:697] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:36.686427   747 consensus_queue.cc:237] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.689657   715 raft_consensus.cc:493] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.690171   715 raft_consensus.cc:515] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:36.678444 32703 catalog_manager.cc:5697] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.692312   715 leader_election.cc:290] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:36.659031   610 raft_consensus.cc:359] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:36.694154   610 raft_consensus.cc:385] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.694267   718 raft_consensus.cc:2749] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.694468   610 raft_consensus.cc:740] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
W20260709 13:12:36.695346   841 log.cc:927] Time spent T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:12:36.695931   610 consensus_queue.cc:260] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:36.698051   610 ts_tablet_manager.cc:1434] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.081s	user 0.003s	sys 0.003s
I20260709 13:12:36.698649   456 leader_election.cc:304] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:36.699182   610 tablet_bootstrap.cc:492] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:36.700137   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e165c0d45844da9b680b461c2b5493" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:36.700381   620 raft_consensus.cc:2804] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.700889   620 raft_consensus.cc:697] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:36.701742   620 consensus_queue.cc:237] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:36.702636   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e165c0d45844da9b680b461c2b5493" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:36.710367   751 consensus_queue.cc:1048] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.709205   530 leader_election.cc:304] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:36.726713   715 raft_consensus.cc:2749] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.742074 32707 catalog_manager.cc:5697] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:36.786638   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 77516.2us
I20260709 13:12:36.791298   611 tablet_bootstrap.cc:492] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:36.794708   611 ts_tablet_manager.cc:1403] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.190s	user 0.007s	sys 0.010s
I20260709 13:12:36.793733   612 tablet_bootstrap.cc:492] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:36.796226   612 ts_tablet_manager.cc:1403] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.131s	user 0.018s	sys 0.005s
I20260709 13:12:36.801749   833 consensus_queue.cc:1048] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.803831   611 raft_consensus.cc:359] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.804558   611 raft_consensus.cc:385] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.804894   611 raft_consensus.cc:740] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.804677   747 consensus_queue.cc:1048] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.805714   611 consensus_queue.cc:260] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.807943   611 ts_tablet_manager.cc:1434] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
W20260709 13:12:36.809306   457 consensus_peers.cc:597] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.809561   615 tablet_bootstrap.cc:492] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:36.810271   615 ts_tablet_manager.cc:1403] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.294s	user 0.018s	sys 0.039s
I20260709 13:12:36.809333   611 tablet_bootstrap.cc:492] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:36.823535   610 tablet_bootstrap.cc:654] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.835454   563 raft_consensus.cc:3060] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.838850 32703 catalog_manager.cc:5697] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.843640   718 consensus_queue.cc:1048] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.819238   612 raft_consensus.cc:359] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.850987   612 raft_consensus.cc:385] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.851380   612 raft_consensus.cc:740] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.852151   612 consensus_queue.cc:260] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.863524   615 raft_consensus.cc:359] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:36.865088   615 raft_consensus.cc:385] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.868086   612 ts_tablet_manager.cc:1434] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.001s
I20260709 13:12:36.869547   612 tablet_bootstrap.cc:492] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:36.865438   615 raft_consensus.cc:740] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.875146 32703 catalog_manager.cc:5697] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.873173   615 consensus_queue.cc:260] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:36.882938   615 ts_tablet_manager.cc:1434] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.002s
I20260709 13:12:36.887238   615 tablet_bootstrap.cc:492] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:36.878793   690 raft_consensus.cc:493] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.895488   690 raft_consensus.cc:515] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.899935   614 consensus_queue.cc:1048] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.904485   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d8c817825941bdb7e7435a4be4be3e" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:36.905964   694 raft_consensus.cc:493] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.906581   694 raft_consensus.cc:515] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:36.906883   715 consensus_queue.cc:1048] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.909081   694 leader_election.cc:290] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:36.924230   620 consensus_queue.cc:1048] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.924379   831 consensus_queue.cc:1048] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.935196   614 consensus_queue.cc:1048] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.926481   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb8ccdeec5247b58ff52a64999af132" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:36.928224   751 consensus_queue.cc:1048] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.930032   690 leader_election.cc:290] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:36.931756   720 raft_consensus.cc:493] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.932699   615 tablet_bootstrap.cc:654] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.894460   612 tablet_bootstrap.cc:654] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.925402   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb8ccdeec5247b58ff52a64999af132" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:36.925318   304 leader_election.cc:343] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.941743   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d8c817825941bdb7e7435a4be4be3e" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:36.958608   610 tablet_bootstrap.cc:492] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:36.970413   610 ts_tablet_manager.cc:1403] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.271s	user 0.015s	sys 0.021s
I20260709 13:12:36.949863   720 raft_consensus.cc:515] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
W20260709 13:12:36.966841   304 leader_election.cc:343] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.978735   720 leader_election.cc:290] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:36.999877   610 raft_consensus.cc:359] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:37.039054   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:37.042868   307 leader_election.cc:343] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.043572   307 leader_election.cc:304] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:37.038250   610 raft_consensus.cc:385] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.044600   610 raft_consensus.cc:740] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.044835   751 raft_consensus.cc:2749] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:37.046705   307 leader_election.cc:343] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.045313   610 consensus_queue.cc:260] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:37.050181   610 ts_tablet_manager.cc:1434] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.007s
I20260709 13:12:37.051047   611 tablet_bootstrap.cc:654] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.050935   747 consensus_queue.cc:1048] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.051154   610 tablet_bootstrap.cc:492] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:37.054131   307 leader_election.cc:304] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:37.089258   610 tablet_bootstrap.cc:654] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.113005   630 raft_consensus.cc:493] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b79bd4dca614b218791c5293a51c7a9)
I20260709 13:12:37.097194   751 raft_consensus.cc:2749] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.118928   718 raft_consensus.cc:493] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.119495   718 raft_consensus.cc:515] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:37.121750   718 leader_election.cc:290] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:37.125452   612 tablet_bootstrap.cc:492] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
W20260709 13:12:37.127794   382 consensus_peers.cc:597] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.128805   612 ts_tablet_manager.cc:1403] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.260s	user 0.022s	sys 0.021s
I20260709 13:12:37.130596   620 raft_consensus.cc:493] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.131275   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55312d46dd4747c0bacb0d980ca208b1" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:37.131143   620 raft_consensus.cc:515] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.133627   620 leader_election.cc:290] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
W20260709 13:12:37.105100   307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 58465.1us
I20260709 13:12:37.113649   630 raft_consensus.cc:515] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.147826   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:37.144430   831 raft_consensus.cc:493] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.148809   831 raft_consensus.cc:515] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.154717   413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:37.155637   413 raft_consensus.cc:2468] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 2.
I20260709 13:12:37.156744   416 raft_consensus.cc:2468] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:37.157016   456 leader_election.cc:304] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:37.158064   823 raft_consensus.cc:2804] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:37.158449   823 raft_consensus.cc:493] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7b79bd4dca614b218791c5293a51c7a9)
I20260709 13:12:37.158816   823 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.160080   456 leader_election.cc:304] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:37.160830   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:37.161631   490 raft_consensus.cc:2468] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:37.163208   747 raft_consensus.cc:2804] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.163609   747 raft_consensus.cc:493] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.163652   630 leader_election.cc:290] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:37.164098   747 raft_consensus.cc:3060] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.164482   630 raft_consensus.cc:493] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.164994   630 raft_consensus.cc:515] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:37.166509   611 tablet_bootstrap.cc:492] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:37.167023   611 ts_tablet_manager.cc:1403] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.358s	user 0.012s	sys 0.012s
I20260709 13:12:37.167829   630 leader_election.cc:290] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:37.158093   831 leader_election.cc:290] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:37.169855   611 raft_consensus.cc:359] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.170607   612 raft_consensus.cc:359] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:37.174405   379 leader_election.cc:304] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:37.178952   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:37.183507   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:37.184672   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:37.190626   612 raft_consensus.cc:385] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.193209   612 raft_consensus.cc:740] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.190506   611 raft_consensus.cc:385] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.193859   611 raft_consensus.cc:740] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.193964   612 consensus_queue.cc:260] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:37.194725   611 consensus_queue.cc:260] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.206288   611 ts_tablet_manager.cc:1434] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 13:12:37.202682   340 raft_consensus.cc:2468] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:37.208202   611 tablet_bootstrap.cc:492] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:37.203636   338 raft_consensus.cc:2468] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 2.
I20260709 13:12:37.202855   831 raft_consensus.cc:2804] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.209811   831 raft_consensus.cc:493] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.210166   831 raft_consensus.cc:3060] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.198168   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d8c817825941bdb7e7435a4be4be3e" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:37.214267   339 raft_consensus.cc:2468] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:37.192272   747 raft_consensus.cc:515] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.219347   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55312d46dd4747c0bacb0d980ca208b1" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:37.219992   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d8c817825941bdb7e7435a4be4be3e" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:37.221899   562 raft_consensus.cc:3060] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.223184   747 leader_election.cc:290] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:37.227440   561 raft_consensus.cc:3060] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.233282   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:37.192476   823 raft_consensus.cc:515] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.251003   612 ts_tablet_manager.cc:1434] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.122s	user 0.005s	sys 0.003s
I20260709 13:12:37.251988   612 tablet_bootstrap.cc:492] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:37.255878   823 leader_election.cc:290] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
W20260709 13:12:37.262576   457 consensus_peers.cc:597] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.263094   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
W20260709 13:12:37.264743   457 leader_election.cc:343] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.266358   630 consensus_queue.cc:1048] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.268056   612 tablet_bootstrap.cc:654] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.272845   610 tablet_bootstrap.cc:492] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:37.273332   610 ts_tablet_manager.cc:1403] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.222s	user 0.011s	sys 0.028s
I20260709 13:12:37.277033   530 leader_election.cc:304] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:37.269972   831 raft_consensus.cc:515] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.279904   416 raft_consensus.cc:2393] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:37.284664   831 leader_election.cc:290] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:37.287907   615 tablet_bootstrap.cc:492] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:37.288875   610 raft_consensus.cc:359] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.289733   610 raft_consensus.cc:385] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.289827   615 ts_tablet_manager.cc:1403] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.406s	user 0.020s	sys 0.011s
I20260709 13:12:37.290022   610 raft_consensus.cc:740] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.291188   610 consensus_queue.cc:260] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.289155   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:37.296002   415 raft_consensus.cc:2468] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 2.
I20260709 13:12:37.299343   490 raft_consensus.cc:2393] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 in current term 1: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
I20260709 13:12:37.303058   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:37.303776   338 raft_consensus.cc:2468] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:37.301095   456 leader_election.cc:304] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:37.305190   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:37.305546   873 raft_consensus.cc:2804] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:37.305846   338 raft_consensus.cc:3060] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.306128   873 raft_consensus.cc:697] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:37.306972   873 consensus_queue.cc:237] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.309549   872 consensus_queue.cc:1048] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.313410   611 tablet_bootstrap.cc:654] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.315557   610 ts_tablet_manager.cc:1434] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:12:37.316843   610 tablet_bootstrap.cc:492] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:37.321683   381 leader_election.cc:304] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:37.327222   456 leader_election.cc:304] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:37.328825   827 raft_consensus.cc:2804] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:37.329212   827 raft_consensus.cc:493] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.329542   827 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.330592   872 raft_consensus.cc:2804] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.331133   872 raft_consensus.cc:493] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.331547   872 raft_consensus.cc:3060] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.354871   865 raft_consensus.cc:2749] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.355676   831 consensus_queue.cc:1048] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.358203   690 consensus_queue.cc:1048] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.362558   867 raft_consensus.cc:493] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.369172   867 raft_consensus.cc:515] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:37.372170   867 leader_election.cc:290] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:37.363216   338 raft_consensus.cc:2468] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:37.377810   615 raft_consensus.cc:359] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.383514   630 consensus_queue.cc:1048] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.384579   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:37.385450   339 raft_consensus.cc:2393] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:37.385805   694 consensus_queue.cc:1048] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.379902   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0cb63fe6b54741b53e72257d8eea82" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:37.381770   413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0cb63fe6b54741b53e72257d8eea82" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:37.388983   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:37.391562   339 raft_consensus.cc:2393] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 2: Already voted for candidate 70c1750ca53a445883b66469ea339141 in this term.
I20260709 13:12:37.392145   615 raft_consensus.cc:385] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.398291   610 tablet_bootstrap.cc:654] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.392727   615 raft_consensus.cc:740] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.400246   615 consensus_queue.cc:260] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.391216   456 leader_election.cc:304] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:37.406404   615 ts_tablet_manager.cc:1434] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.116s	user 0.006s	sys 0.001s
I20260709 13:12:37.408721   615 tablet_bootstrap.cc:492] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:37.406808   823 raft_consensus.cc:2749] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.424932   612 tablet_bootstrap.cc:492] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:37.391283   381 leader_election.cc:304] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:37.425926   612 ts_tablet_manager.cc:1403] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.174s	user 0.039s	sys 0.022s
I20260709 13:12:37.434574   611 tablet_bootstrap.cc:492] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:37.435142   611 ts_tablet_manager.cc:1403] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.227s	user 0.015s	sys 0.007s
I20260709 13:12:37.424527   827 raft_consensus.cc:515] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
W20260709 13:12:37.438057   381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 46876.1us
I20260709 13:12:37.439461   827 leader_election.cc:290] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 3 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:37.420146   872 raft_consensus.cc:515] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:37.442277   701 raft_consensus.cc:2804] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.443446   872 leader_election.cc:290] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:37.443476 32707 catalog_manager.cc:5697] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 1 to 2, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:37.425372   530 leader_election.cc:304] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:37.452116   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d8c817825941bdb7e7435a4be4be3e" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:37.452164   611 raft_consensus.cc:359] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.455132   611 raft_consensus.cc:385] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.455406   611 raft_consensus.cc:740] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.456111   611 consensus_queue.cc:260] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.458822   720 raft_consensus.cc:493] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.459408   720 raft_consensus.cc:515] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.460318   612 raft_consensus.cc:359] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:37.461007   612 raft_consensus.cc:385] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.461268   612 raft_consensus.cc:740] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.463013   612 consensus_queue.cc:260] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:37.464392   610 tablet_bootstrap.cc:492] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:37.464882   610 ts_tablet_manager.cc:1403] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.148s	user 0.009s	sys 0.015s
I20260709 13:12:37.446420   701 raft_consensus.cc:697] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:37.470906   615 tablet_bootstrap.cc:654] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.471482   701 consensus_queue.cc:237] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
W20260709 13:12:37.474409   457 leader_election.cc:343] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.474566   612 ts_tablet_manager.cc:1434] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 13:12:37.475893   612 tablet_bootstrap.cc:492] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:37.466722   611 ts_tablet_manager.cc:1434] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 13:12:37.477391   611 tablet_bootstrap.cc:492] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:37.489724   612 tablet_bootstrap.cc:654] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.489320   720 leader_election.cc:290] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:37.495626   615 tablet_bootstrap.cc:492] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:37.496125   615 ts_tablet_manager.cc:1403] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.003s
I20260709 13:12:37.499089   615 raft_consensus.cc:359] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:37.499688   615 raft_consensus.cc:385] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.499945   615 raft_consensus.cc:740] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.500847   865 raft_consensus.cc:2749] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:37.500734   615 consensus_queue.cc:260] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:37.504158   615 ts_tablet_manager.cc:1434] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:12:37.505187   615 tablet_bootstrap.cc:492] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:37.504617   611 tablet_bootstrap.cc:654] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.561280   610 raft_consensus.cc:359] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:37.563560   610 raft_consensus.cc:385] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.564337   610 raft_consensus.cc:740] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.565696   610 consensus_queue.cc:260] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:37.572686   630 raft_consensus.cc:493] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.594764   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:37.600699   610 ts_tablet_manager.cc:1434] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.007s
I20260709 13:12:37.606386   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:37.607923   340 raft_consensus.cc:2468] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:37.614571   610 tablet_bootstrap.cc:492] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:37.621884   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:37.623085   338 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.626921   630 raft_consensus.cc:515] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.642930   612 tablet_bootstrap.cc:492] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:37.653827   612 ts_tablet_manager.cc:1403] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.178s	user 0.019s	sys 0.003s
I20260709 13:12:37.674010   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:37.674937   490 raft_consensus.cc:2468] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:37.678246   630 leader_election.cc:290] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:37.696791   381 leader_election.cc:304] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:37.699977   701 raft_consensus.cc:2804] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.700901   701 raft_consensus.cc:493] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.701403   701 raft_consensus.cc:3060] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.711730   615 tablet_bootstrap.cc:654] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.717154   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d8c817825941bdb7e7435a4be4be3e" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:37.722407   340 raft_consensus.cc:3060] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.715476   612 raft_consensus.cc:359] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:37.732956   610 tablet_bootstrap.cc:654] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.733990   612 raft_consensus.cc:385] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.734436   612 raft_consensus.cc:740] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.735327   612 consensus_queue.cc:260] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:37.773217   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:37.774039   341 raft_consensus.cc:2468] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:37.778358   416 raft_consensus.cc:1240] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Rejecting Update request from peer c547e4ecc9ae4f03a72252a7d8049f98 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:37.778951   338 raft_consensus.cc:2468] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 3.
I20260709 13:12:37.781323   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:37.785673   630 consensus_queue.cc:1059] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:37.786912   630 raft_consensus.cc:3055] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:37.787585   893 raft_consensus.cc:493] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.790966   893 raft_consensus.cc:515] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.793845   340 raft_consensus.cc:2468] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:37.794508   893 leader_election.cc:290] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:37.798807   612 ts_tablet_manager.cc:1434] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.144s	user 0.009s	sys 0.002s
I20260709 13:12:37.789352   630 raft_consensus.cc:740] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:37.805140   611 tablet_bootstrap.cc:492] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:37.806031   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4b123ed2a46788fa7fbb6effdff5e" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:37.806193   630 consensus_queue.cc:260] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.806838   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4b123ed2a46788fa7fbb6effdff5e" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:37.781430   701 raft_consensus.cc:515] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
W20260709 13:12:37.810510   304 leader_election.cc:343] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.811120   612 tablet_bootstrap.cc:492] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:37.813035   615 tablet_bootstrap.cc:492] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:37.818156   611 ts_tablet_manager.cc:1403] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.341s	user 0.022s	sys 0.008s
I20260709 13:12:37.825219   381 leader_election.cc:304] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:37.828065   661 raft_consensus.cc:2804] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:37.828660   661 raft_consensus.cc:697] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:37.818756   456 leader_election.cc:304] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:37.830309   823 raft_consensus.cc:2804] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.830722   823 raft_consensus.cc:493] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.831067   823 raft_consensus.cc:3060] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.831399   720 raft_consensus.cc:493] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.831185   661 consensus_queue.cc:237] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.832123   720 raft_consensus.cc:515] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:37.819231   630 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.819945   341 raft_consensus.cc:1240] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Rejecting Update request from peer c547e4ecc9ae4f03a72252a7d8049f98 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:37.839287   563 raft_consensus.cc:3060] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.843819   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b138e8469b435e9f167c96d962a892" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:37.834925   456 leader_election.cc:304] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
W20260709 13:12:37.846338   382 leader_election.cc:343] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.847805   620 raft_consensus.cc:2804] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.848459   620 raft_consensus.cc:697] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:37.849472   620 consensus_queue.cc:237] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
W20260709 13:12:37.849345   306 leader_election.cc:343] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.851328   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b138e8469b435e9f167c96d962a892" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:37.851583   306 leader_election.cc:304] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:37.853591   690 raft_consensus.cc:2749] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.855125   615 ts_tablet_manager.cc:1403] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.350s	user 0.023s	sys 0.004s
I20260709 13:12:37.855684   720 leader_election.cc:290] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
W20260709 13:12:37.857095   379 leader_election.cc:343] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.857628   379 leader_election.cc:304] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:37.861935   415 raft_consensus.cc:2393] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:37.865634   701 leader_election.cc:290] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:37.866824   827 raft_consensus.cc:2749] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.868949   615 raft_consensus.cc:359] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:37.863387 32706 catalog_manager.cc:5697] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.870043   615 raft_consensus.cc:385] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.870496   615 raft_consensus.cc:740] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.866024   611 raft_consensus.cc:359] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:37.872095   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:37.872174   611 raft_consensus.cc:385] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.873208   611 raft_consensus.cc:740] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.874068   611 consensus_queue.cc:260] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:37.875849   612 tablet_bootstrap.cc:654] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.877358   611 ts_tablet_manager.cc:1434] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 13:12:37.878732   611 tablet_bootstrap.cc:492] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:37.880498   615 consensus_queue.cc:260] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:37.883965   865 raft_consensus.cc:493] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c547e4ecc9ae4f03a72252a7d8049f98)
I20260709 13:12:37.884740   865 raft_consensus.cc:515] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:37.888465   615 ts_tablet_manager.cc:1434] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:12:37.901160   615 tablet_bootstrap.cc:492] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:37.880318   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:37.912683   340 raft_consensus.cc:3060] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.921298   612 tablet_bootstrap.cc:492] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:37.922119   612 ts_tablet_manager.cc:1403] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.111s	user 0.007s	sys 0.017s
I20260709 13:12:37.928946   611 tablet_bootstrap.cc:654] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.932669   340 raft_consensus.cc:2468] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:37.934023   381 leader_election.cc:304] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:37.934988   661 raft_consensus.cc:2804] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.935236   615 tablet_bootstrap.cc:654] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.936239   661 raft_consensus.cc:697] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:37.937323   661 consensus_queue.cc:237] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.909402   823 raft_consensus.cc:515] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:37.951647   490 raft_consensus.cc:2393] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 in current term 1: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
I20260709 13:12:37.954569   823 leader_election.cc:290] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:37.956198   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:37.956342   612 raft_consensus.cc:359] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:37.957083   612 raft_consensus.cc:385] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.957374   612 raft_consensus.cc:740] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.958117   612 consensus_queue.cc:260] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:37.955220   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:37.963613   340 raft_consensus.cc:2393] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:37.970932   612 ts_tablet_manager.cc:1434] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:12:37.972930   612 tablet_bootstrap.cc:492] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:37.972862   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40791a3fd5f24fcc97260df7cb88f115" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:37.975482   456 leader_election.cc:304] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:37.977505   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40791a3fd5f24fcc97260df7cb88f115" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:37.980369   701 consensus_queue.cc:1048] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.981801   530 leader_election.cc:304] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:37.985577   866 raft_consensus.cc:2749] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:37.979200   865 leader_election.cc:290] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:37.997066   612 tablet_bootstrap.cc:654] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.002377   561 raft_consensus.cc:3060] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.012401   610 tablet_bootstrap.cc:492] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:38.012990   610 ts_tablet_manager.cc:1403] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.399s	user 0.012s	sys 0.011s
I20260709 13:12:38.004356   823 raft_consensus.cc:2749] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:12:38.019373 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:38.023980   823 raft_consensus.cc:493] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.024721   823 raft_consensus.cc:515] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.030778 32706 catalog_manager.cc:5697] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.038940   661 consensus_queue.cc:1048] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.040589   615 tablet_bootstrap.cc:492] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:38.041163   615 ts_tablet_manager.cc:1403] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.152s	user 0.017s	sys 0.009s
I20260709 13:12:38.052666   615 raft_consensus.cc:359] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.053462   615 raft_consensus.cc:385] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.063009   615 raft_consensus.cc:740] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.064183   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb8ccdeec5247b58ff52a64999af132" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:38.066387   457 leader_election.cc:343] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.069753   823 leader_election.cc:290] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:38.071130   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb8ccdeec5247b58ff52a64999af132" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:38.072306   338 raft_consensus.cc:2468] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:38.073634   456 leader_election.cc:304] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:38.075146   620 raft_consensus.cc:2804] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.075547   620 raft_consensus.cc:493] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.075958   620 raft_consensus.cc:3060] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.073892   610 raft_consensus.cc:359] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.077629   610 raft_consensus.cc:385] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.079952   610 raft_consensus.cc:740] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.081354   615 consensus_queue.cc:260] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.085846   893 raft_consensus.cc:493] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.087664   620 raft_consensus.cc:515] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.087896   893 raft_consensus.cc:515] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.096482   610 consensus_queue.cc:260] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.106829   620 leader_election.cc:290] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:38.115510   615 ts_tablet_manager.cc:1434] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:12:38.116662   612 tablet_bootstrap.cc:492] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:38.117201   612 ts_tablet_manager.cc:1403] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.001s
I20260709 13:12:38.117492   615 tablet_bootstrap.cc:492] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:38.121537   893 leader_election.cc:290] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:38.125939   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb8ccdeec5247b58ff52a64999af132" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:38.126699   338 raft_consensus.cc:3060] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.126894   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:38.127743   415 raft_consensus.cc:2468] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:38.129112   306 leader_election.cc:304] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:38.129740   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb8ccdeec5247b58ff52a64999af132" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:38.129981   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:38.131453   893 raft_consensus.cc:2804] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:38.131870   457 leader_election.cc:343] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:38.134097   307 leader_election.cc:343] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.135805 32703 catalog_manager.cc:5697] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.131906   893 raft_consensus.cc:493] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.138141 32703 catalog_manager.cc:5697] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 2 to 3, leader changed from c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195) to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.140887   610 ts_tablet_manager.cc:1434] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.003s
I20260709 13:12:38.141131   338 raft_consensus.cc:2468] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:38.137663   893 raft_consensus.cc:3060] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.142124   612 raft_consensus.cc:359] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.142266   610 tablet_bootstrap.cc:492] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:38.146078   612 raft_consensus.cc:385] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.150782   612 raft_consensus.cc:740] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.148885   456 leader_election.cc:304] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:38.153826   823 raft_consensus.cc:2804] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.158002   612 consensus_queue.cc:260] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.157128   823 raft_consensus.cc:697] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:38.160785   866 raft_consensus.cc:493] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.160837   823 consensus_queue.cc:237] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.161365   866 raft_consensus.cc:515] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.165267   611 tablet_bootstrap.cc:492] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:38.165887   611 ts_tablet_manager.cc:1403] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.288s	user 0.024s	sys 0.004s
I20260709 13:12:38.168442   866 leader_election.cc:290] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:38.170365   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d8c817825941bdb7e7435a4be4be3e" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:38.171264   340 raft_consensus.cc:2393] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54e079297e3a4863ac2eccd69f7dbd9c in current term 1: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
I20260709 13:12:38.177078   612 ts_tablet_manager.cc:1434] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.002s
I20260709 13:12:38.178428   612 tablet_bootstrap.cc:492] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:38.188153   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d8c817825941bdb7e7435a4be4be3e" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:38.191403   528 leader_election.cc:304] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:38.173000   611 raft_consensus.cc:359] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.193388   611 raft_consensus.cc:385] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.195377   611 raft_consensus.cc:740] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.198565   615 tablet_bootstrap.cc:654] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.194902   661 raft_consensus.cc:493] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.199163   611 consensus_queue.cc:260] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.193470   866 raft_consensus.cc:3060] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.203181   865 raft_consensus.cc:493] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.203147   661 raft_consensus.cc:515] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.203975   865 raft_consensus.cc:515] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.206386   865 leader_election.cc:290] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:38.206650   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4b123ed2a46788fa7fbb6effdff5e" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:38.207357   340 raft_consensus.cc:2468] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:38.209072   381 leader_election.cc:304] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:38.210166   827 raft_consensus.cc:2804] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.210541   827 raft_consensus.cc:493] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.210888   827 raft_consensus.cc:3060] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.210754   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d975e40654d90b138939a2c9bc659" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:38.219244   694 raft_consensus.cc:493] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.218376   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4b123ed2a46788fa7fbb6effdff5e" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:38.222625   612 tablet_bootstrap.cc:654] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.214772   661 leader_election.cc:290] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
W20260709 13:12:38.224431   379 leader_election.cc:343] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.226320   611 ts_tablet_manager.cc:1434] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:12:38.220743   694 raft_consensus.cc:515] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.231595   611 tablet_bootstrap.cc:492] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:38.232872   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac98fcdb54dc49569e1bed91b70763d6" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:38.231724   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d975e40654d90b138939a2c9bc659" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:38.234434   694 leader_election.cc:290] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:38.236470   610 tablet_bootstrap.cc:654] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:38.237591   307 leader_election.cc:343] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.237486   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac98fcdb54dc49569e1bed91b70763d6" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
W20260709 13:12:38.257462   306 leader_election.cc:343] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.257970   306 leader_election.cc:304] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:38.259325   694 raft_consensus.cc:2749] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.265625   827 raft_consensus.cc:515] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.266307   866 raft_consensus.cc:2749] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.244035   611 tablet_bootstrap.cc:654] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.238919   893 raft_consensus.cc:515] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.270491   893 leader_election.cc:290] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:38.250139 32706 catalog_manager.cc:5697] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.254824   528 leader_election.cc:304] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:38.273121   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:38.273420   865 raft_consensus.cc:2749] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.273936   416 raft_consensus.cc:3060] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.275772   612 tablet_bootstrap.cc:492] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:38.276363   612 ts_tablet_manager.cc:1403] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.098s	user 0.006s	sys 0.006s
I20260709 13:12:38.277765   615 tablet_bootstrap.cc:492] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:38.278267   615 ts_tablet_manager.cc:1403] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.161s	user 0.020s	sys 0.030s
I20260709 13:12:38.282979   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:38.284159   615 raft_consensus.cc:359] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.284929   615 raft_consensus.cc:385] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:38.285071   307 leader_election.cc:343] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.287454   612 raft_consensus.cc:359] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.288341   612 raft_consensus.cc:385] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.288669   612 raft_consensus.cc:740] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.289404   612 consensus_queue.cc:260] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.285205   615 raft_consensus.cc:740] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.292691   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4b123ed2a46788fa7fbb6effdff5e" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:38.293380   340 raft_consensus.cc:3060] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.293450   416 raft_consensus.cc:2468] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:38.295179   306 leader_election.cc:304] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:38.297257   893 raft_consensus.cc:2804] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.297849   893 raft_consensus.cc:697] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:38.298811   893 consensus_queue.cc:237] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.292661   615 consensus_queue.cc:260] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.302521   340 raft_consensus.cc:2468] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:38.306210   381 leader_election.cc:304] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:38.308813   620 consensus_queue.cc:1048] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.311530   661 raft_consensus.cc:2804] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.312111   661 raft_consensus.cc:697] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:38.313024   661 consensus_queue.cc:237] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.315649 32706 catalog_manager.cc:5697] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.308846   615 ts_tablet_manager.cc:1434] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.002s
I20260709 13:12:38.324110   615 tablet_bootstrap.cc:492] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:38.333540   615 tablet_bootstrap.cc:654] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.334595   611 tablet_bootstrap.cc:492] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:38.335968   611 ts_tablet_manager.cc:1403] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.003s
I20260709 13:12:38.344982   701 consensus_queue.cc:1048] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.348311 32706 catalog_manager.cc:5697] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.350492   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4b123ed2a46788fa7fbb6effdff5e" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:38.354208   611 raft_consensus.cc:359] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.355079   611 raft_consensus.cc:385] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.355579   611 raft_consensus.cc:740] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.356431   611 consensus_queue.cc:260] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
W20260709 13:12:38.359851   379 leader_election.cc:343] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.360051   611 ts_tablet_manager.cc:1434] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:12:38.361697   611 tablet_bootstrap.cc:492] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:38.362082   827 leader_election.cc:290] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:38.363432   612 ts_tablet_manager.cc:1434] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.000s
I20260709 13:12:38.367043   612 tablet_bootstrap.cc:492] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:38.388363   341 raft_consensus.cc:1275] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Refusing update from remote peer 7b79bd4dca614b218791c5293a51c7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:38.395305   611 tablet_bootstrap.cc:654] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.397632   612 tablet_bootstrap.cc:654] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.403002   615 tablet_bootstrap.cc:492] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:38.403494   615 ts_tablet_manager.cc:1403] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.011s
I20260709 13:12:38.405678   891 consensus_queue.cc:1048] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.406211   615 raft_consensus.cc:359] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.406898   615 raft_consensus.cc:385] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.407155   615 raft_consensus.cc:740] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.407788   615 consensus_queue.cc:260] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.409744   720 consensus_queue.cc:1048] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.415527   615 ts_tablet_manager.cc:1434] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:38.431645   661 consensus_queue.cc:1048] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.432459   615 tablet_bootstrap.cc:492] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:38.441406   615 tablet_bootstrap.cc:654] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.458065   610 tablet_bootstrap.cc:492] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:38.458595   610 ts_tablet_manager.cc:1403] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.317s	user 0.010s	sys 0.008s
I20260709 13:12:38.483429   490 raft_consensus.cc:1275] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Refusing update from remote peer 7b79bd4dca614b218791c5293a51c7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:12:38.483924   490 pending_rounds.cc:85] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98: Aborting all ops after (but not including) 1
I20260709 13:12:38.484244   490 pending_rounds.cc:107] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:12:38.484576   490 raft_consensus.cc:2889] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:38.484786   620 raft_consensus.cc:493] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.485494   612 tablet_bootstrap.cc:492] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:38.486112   612 ts_tablet_manager.cc:1403] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.031s
I20260709 13:12:38.485719   620 raft_consensus.cc:515] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.490072   620 leader_election.cc:290] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:38.495440   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b138e8469b435e9f167c96d962a892" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:38.495618   661 consensus_queue.cc:1048] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.496233   416 raft_consensus.cc:2468] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:38.497219   611 tablet_bootstrap.cc:492] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:38.495440   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b138e8469b435e9f167c96d962a892" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:38.497781   611 ts_tablet_manager.cc:1403] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.019s
I20260709 13:12:38.498567   456 leader_election.cc:304] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
W20260709 13:12:38.499689   457 leader_election.cc:343] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.500869   611 raft_consensus.cc:359] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.502002   611 raft_consensus.cc:385] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.502331   611 raft_consensus.cc:740] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.501792   620 raft_consensus.cc:2804] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.504020   620 raft_consensus.cc:493] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.504326   720 raft_consensus.cc:493] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.504383   620 raft_consensus.cc:3060] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.505110   611 consensus_queue.cc:260] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.504974   720 raft_consensus.cc:515] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.507369   611 ts_tablet_manager.cc:1434] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:38.508972   720 leader_election.cc:290] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:38.510762   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac98fcdb54dc49569e1bed91b70763d6" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:38.511469   339 raft_consensus.cc:2468] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:38.504717   612 raft_consensus.cc:359] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.513367   612 raft_consensus.cc:385] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.513717   612 raft_consensus.cc:740] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.514032   381 leader_election.cc:304] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:38.514420   612 consensus_queue.cc:260] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.515323   720 raft_consensus.cc:2804] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.516115   720 raft_consensus.cc:493] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.516960   720 raft_consensus.cc:3060] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.520342   612 ts_tablet_manager.cc:1434] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:12:38.521498   612 tablet_bootstrap.cc:492] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:38.524613   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac98fcdb54dc49569e1bed91b70763d6" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:38.525810   611 tablet_bootstrap.cc:492] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:38.525970   382 leader_election.cc:343] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.535537   610 raft_consensus.cc:359] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.536172   610 raft_consensus.cc:385] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.536520   610 raft_consensus.cc:740] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.541688   615 tablet_bootstrap.cc:492] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:38.542217   615 ts_tablet_manager.cc:1403] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.007s
I20260709 13:12:38.537734   620 raft_consensus.cc:515] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.552438   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b138e8469b435e9f167c96d962a892" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:38.553180   416 raft_consensus.cc:3060] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.565768   610 consensus_queue.cc:260] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.569427   610 ts_tablet_manager.cc:1434] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.111s	user 0.004s	sys 0.003s
I20260709 13:12:38.571525   611 tablet_bootstrap.cc:654] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.567881   615 raft_consensus.cc:359] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.573120   615 raft_consensus.cc:385] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.573393   615 raft_consensus.cc:740] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.574749   615 consensus_queue.cc:260] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.576515   610 tablet_bootstrap.cc:492] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
W20260709 13:12:38.581889   457 consensus_peers.cc:597] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:38.586871   610 tablet_bootstrap.cc:654] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.577347   615 ts_tablet_manager.cc:1434] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:12:38.579627   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b138e8469b435e9f167c96d962a892" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:38.589603   565 raft_consensus.cc:3060] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.592867   720 raft_consensus.cc:515] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.595162   612 tablet_bootstrap.cc:654] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.580144   620 leader_election.cc:290] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:38.597442   615 tablet_bootstrap.cc:492] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:38.602082   720 leader_election.cc:290] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:38.603266   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac98fcdb54dc49569e1bed91b70763d6" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:38.604025   338 raft_consensus.cc:3060] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.606490   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac98fcdb54dc49569e1bed91b70763d6" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:38.608448   382 leader_election.cc:343] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.613131   565 raft_consensus.cc:2468] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:38.616422   457 leader_election.cc:304] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:38.618124   620 raft_consensus.cc:2804] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.618960   620 raft_consensus.cc:697] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:38.620111   620 consensus_queue.cc:237] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.624797   865 raft_consensus.cc:493] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.625465   865 raft_consensus.cc:515] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.626616   416 raft_consensus.cc:2468] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:38.627120   561 raft_consensus.cc:3060] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.627818   865 leader_election.cc:290] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:38.630697   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:38.631889   338 raft_consensus.cc:2468] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:38.633239   381 leader_election.cc:304] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:38.634594   720 raft_consensus.cc:2804] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.635203   720 raft_consensus.cc:697] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:38.636116   720 consensus_queue.cc:237] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.637523   615 tablet_bootstrap.cc:654] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.645862   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:38.647336   610 tablet_bootstrap.cc:492] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:38.648686   610 ts_tablet_manager.cc:1403] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.072s	user 0.029s	sys 0.022s
I20260709 13:12:38.649550   416 raft_consensus.cc:2393] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54e079297e3a4863ac2eccd69f7dbd9c in current term 1: Already voted for candidate 70c1750ca53a445883b66469ea339141 in this term.
I20260709 13:12:38.652395   530 leader_election.cc:304] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:38.653131   823 consensus_queue.cc:1048] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.653872   865 raft_consensus.cc:3060] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.652057   610 raft_consensus.cc:359] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.659659   610 raft_consensus.cc:385] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.660188   610 raft_consensus.cc:740] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.660956   610 consensus_queue.cc:260] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.670446   610 ts_tablet_manager.cc:1434] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:12:38.675127   610 tablet_bootstrap.cc:492] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:38.677831   661 raft_consensus.cc:493] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.679103   661 raft_consensus.cc:515] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.680048   612 tablet_bootstrap.cc:492] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:38.680569   612 ts_tablet_manager.cc:1403] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.159s	user 0.007s	sys 0.010s
I20260709 13:12:38.682757   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22622dd6074222841290f4d737acf2" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:38.683145   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22622dd6074222841290f4d737acf2" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:38.683810   490 raft_consensus.cc:2468] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:38.687439   612 raft_consensus.cc:359] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.688246   612 raft_consensus.cc:385] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.688607   612 raft_consensus.cc:740] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.689252   612 consensus_queue.cc:260] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.690637   893 raft_consensus.cc:493] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.692251   379 leader_election.cc:304] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:38.691136   893 raft_consensus.cc:515] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.684484   661 leader_election.cc:290] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
W20260709 13:12:38.695531   382 leader_election.cc:343] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.707557 32704 catalog_manager.cc:5697] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:38.708904   893 leader_election.cc:290] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:38.710268   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8879df9852da4e428d5432830c645ea9" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:38.694325   720 raft_consensus.cc:2804] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.714393   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8879df9852da4e428d5432830c645ea9" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:38.717483   720 raft_consensus.cc:493] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.717934   720 raft_consensus.cc:3060] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:38.718489   304 leader_election.cc:343] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:38.719481   307 leader_election.cc:343] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.720340   307 leader_election.cc:304] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:38.715178   865 raft_consensus.cc:2749] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.723074   612 ts_tablet_manager.cc:1434] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:12:38.724198   612 tablet_bootstrap.cc:492] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:38.725528   615 tablet_bootstrap.cc:492] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:38.726027   615 ts_tablet_manager.cc:1403] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.129s	user 0.021s	sys 0.003s
I20260709 13:12:38.729061   615 raft_consensus.cc:359] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.729743   615 raft_consensus.cc:385] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.730088   615 raft_consensus.cc:740] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.731545   615 consensus_queue.cc:260] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.722441   694 raft_consensus.cc:2749] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.736264   720 raft_consensus.cc:515] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.733824   615 ts_tablet_manager.cc:1434] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:38.738636   615 tablet_bootstrap.cc:492] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:38.739176 32703 catalog_manager.cc:5697] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.757875   611 tablet_bootstrap.cc:492] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:38.758438   611 ts_tablet_manager.cc:1403] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.233s	user 0.012s	sys 0.006s
I20260709 13:12:38.742662   612 tablet_bootstrap.cc:654] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.750794   694 raft_consensus.cc:493] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.753328   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22622dd6074222841290f4d737acf2" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:38.768561   490 raft_consensus.cc:3060] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.769014   694 raft_consensus.cc:515] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.771526   694 leader_election.cc:290] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:38.763695   610 tablet_bootstrap.cc:654] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.764057   720 leader_election.cc:290] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:38.772536   701 consensus_queue.cc:1048] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:38.761549   611 raft_consensus.cc:359] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.777120   611 raft_consensus.cc:385] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.777462   611 raft_consensus.cc:740] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.782716   611 consensus_queue.cc:260] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.781677   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:38.787490   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:38.787544   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22622dd6074222841290f4d737acf2" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:38.790182   304 leader_election.cc:343] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:38.791736   307 leader_election.cc:343] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.793601   307 leader_election.cc:304] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:38.794432   694 raft_consensus.cc:2749] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.797075   701 raft_consensus.cc:493] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:38.797978   382 leader_election.cc:343] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.797801   701 raft_consensus.cc:515] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.799527   615 tablet_bootstrap.cc:654] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.802979   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cc376e2d944e4cab791e761af1be67" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:38.804381   382 leader_election.cc:343] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.800839   701 leader_election.cc:290] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:38.806674   611 ts_tablet_manager.cc:1434] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:12:38.807161   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cc376e2d944e4cab791e761af1be67" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:38.808377   341 raft_consensus.cc:2468] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:38.812666   611 tablet_bootstrap.cc:492] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:38.806221   490 raft_consensus.cc:2468] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:38.815701   379 leader_election.cc:304] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:38.816847   381 leader_election.cc:304] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:38.821839   720 raft_consensus.cc:2804] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.822247   720 raft_consensus.cc:493] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.822690   720 raft_consensus.cc:3060] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.825788   611 tablet_bootstrap.cc:654] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.830559   615 tablet_bootstrap.cc:492] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:38.831087   661 raft_consensus.cc:2804] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.831677   661 raft_consensus.cc:697] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:38.832595   661 consensus_queue.cc:237] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.831075   615 ts_tablet_manager.cc:1403] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.001s
I20260709 13:12:38.839195   615 raft_consensus.cc:359] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.840107   615 raft_consensus.cc:385] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.840443   615 raft_consensus.cc:740] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.841200   615 consensus_queue.cc:260] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.843986   615 ts_tablet_manager.cc:1434] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:38.847394   615 tablet_bootstrap.cc:492] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:38.849327   490 raft_consensus.cc:3060] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.862533   615 tablet_bootstrap.cc:654] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.867470 32704 catalog_manager.cc:5697] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.871006   610 tablet_bootstrap.cc:492] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:38.882817   610 ts_tablet_manager.cc:1403] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.208s	user 0.007s	sys 0.010s
I20260709 13:12:38.875190   720 raft_consensus.cc:515] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.876988   615 tablet_bootstrap.cc:492] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:38.877890   831 consensus_queue.cc:1048] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.888005   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cc376e2d944e4cab791e761af1be67" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:38.888669   339 raft_consensus.cc:3060] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.889086   865 raft_consensus.cc:493] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.889673   865 raft_consensus.cc:515] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.890698   615 ts_tablet_manager.cc:1403] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.001s
I20260709 13:12:38.892102   865 leader_election.cc:290] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:38.893711   615 raft_consensus.cc:359] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.894421   615 raft_consensus.cc:385] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.894694   615 raft_consensus.cc:740] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.897045   339 raft_consensus.cc:2468] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:38.897744   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cc376e2d944e4cab791e761af1be67" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:38.897081   720 leader_election.cc:290] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:38.898267   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb8ccdeec5247b58ff52a64999af132" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:38.900032   612 tablet_bootstrap.cc:492] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:38.899745   615 consensus_queue.cc:260] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.900501   612 ts_tablet_manager.cc:1403] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.177s	user 0.015s	sys 0.023s
I20260709 13:12:38.898458   381 leader_election.cc:304] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
W20260709 13:12:38.901973   382 leader_election.cc:343] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.902429   720 raft_consensus.cc:2804] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.902977   720 raft_consensus.cc:697] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:38.903820   720 consensus_queue.cc:237] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.904875   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb8ccdeec5247b58ff52a64999af132" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:38.904830   612 raft_consensus.cc:359] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.907349   612 raft_consensus.cc:385] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.907652   612 raft_consensus.cc:740] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.907444   530 leader_election.cc:304] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:38.909142   865 raft_consensus.cc:2749] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.901979   615 ts_tablet_manager.cc:1434] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:12:38.911401   615 tablet_bootstrap.cc:492] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:38.911139   610 raft_consensus.cc:359] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.912185   610 raft_consensus.cc:385] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.912619   610 raft_consensus.cc:740] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.914175   610 consensus_queue.cc:260] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.908655   612 consensus_queue.cc:260] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:38.917443   610 ts_tablet_manager.cc:1434] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:12:38.918033   893 consensus_queue.cc:1048] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.921060   615 tablet_bootstrap.cc:654] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.921550   610 tablet_bootstrap.cc:492] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:38.924999   620 raft_consensus.cc:493] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b79bd4dca614b218791c5293a51c7a9)
I20260709 13:12:38.925611   620 raft_consensus.cc:515] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.929466   694 consensus_queue.cc:1048] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.930253   612 ts_tablet_manager.cc:1434] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.006s
I20260709 13:12:38.931702   612 tablet_bootstrap.cc:492] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:38.941798   610 tablet_bootstrap.cc:654] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.948088   620 leader_election.cc:290] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:38.948776   612 tablet_bootstrap.cc:654] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.949843   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4b123ed2a46788fa7fbb6effdff5e" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:38.950316   611 tablet_bootstrap.cc:492] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:38.954679   611 ts_tablet_manager.cc:1403] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.018s
I20260709 13:12:38.956544   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4b123ed2a46788fa7fbb6effdff5e" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:38.964843   610 tablet_bootstrap.cc:492] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:38.965121   611 raft_consensus.cc:359] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.973697   611 raft_consensus.cc:385] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.965773   456 leader_election.cc:304] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:38.973999   611 raft_consensus.cc:740] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.975637   620 raft_consensus.cc:2749] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:38.965469   610 ts_tablet_manager.cc:1403] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.004s
I20260709 13:12:38.975521   611 consensus_queue.cc:260] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:38.968305   612 tablet_bootstrap.cc:492] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:38.978271   612 ts_tablet_manager.cc:1403] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.006s
I20260709 13:12:38.978672   611 ts_tablet_manager.cc:1434] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:12:38.979779   611 tablet_bootstrap.cc:492] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:38.983256   610 raft_consensus.cc:359] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.983999   610 raft_consensus.cc:385] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.984314   610 raft_consensus.cc:740] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.986538   612 raft_consensus.cc:359] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.987337   612 raft_consensus.cc:385] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.987615   612 raft_consensus.cc:740] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.988358   612 consensus_queue.cc:260] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.990067   612 ts_tablet_manager.cc:1434] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:38.993212   823 raft_consensus.cc:493] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.993808   823 raft_consensus.cc:515] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:38.994143   720 raft_consensus.cc:493] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.991808   610 consensus_queue.cc:260] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.994617   720 raft_consensus.cc:515] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:38.995934   823 leader_election.cc:290] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:38.996731   720 leader_election.cc:290] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:38.996537   610 ts_tablet_manager.cc:1434] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:12:38.998107   610 tablet_bootstrap.cc:492] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:39.002727   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62ccb3929543488daa15130eed287a" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:39.003479   490 raft_consensus.cc:2468] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:39.003647   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8879df9852da4e428d5432830c645ea9" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:39.004302   339 raft_consensus.cc:2468] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:39.004452   610 tablet_bootstrap.cc:654] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.007194   456 leader_election.cc:304] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:39.007871   612 tablet_bootstrap.cc:492] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:39.005506   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62ccb3929543488daa15130eed287a" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:39.008085   823 raft_consensus.cc:2804] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.008693   823 raft_consensus.cc:493] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.009016   823 raft_consensus.cc:3060] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.009851   379 leader_election.cc:304] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
W20260709 13:12:39.011382   382 leader_election.cc:343] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.012359   720 raft_consensus.cc:2804] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.012797   720 raft_consensus.cc:493] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.013154   720 raft_consensus.cc:3060] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.014688   612 tablet_bootstrap.cc:654] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.015573   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8879df9852da4e428d5432830c645ea9" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:39.010020 32706 catalog_manager.cc:5697] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.038604   823 raft_consensus.cc:515] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:39.041847   823 leader_election.cc:290] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:39.055609   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8879df9852da4e428d5432830c645ea9" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:39.057358   620 consensus_queue.cc:1048] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.061630   562 raft_consensus.cc:2468] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:39.063457   895 raft_consensus.cc:493] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.064079   895 raft_consensus.cc:515] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.065914   615 tablet_bootstrap.cc:492] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:39.066499   615 ts_tablet_manager.cc:1403] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.155s	user 0.027s	sys 0.023s
I20260709 13:12:39.066895   895 leader_election.cc:290] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:39.071511   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a993590f1841ea8bb26eaab3ffbca0" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:39.073324   382 leader_election.cc:343] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.076287   612 tablet_bootstrap.cc:492] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:39.076848   612 ts_tablet_manager.cc:1403] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.016s
I20260709 13:12:39.071311   615 raft_consensus.cc:359] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.077822   615 raft_consensus.cc:385] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.078269   615 raft_consensus.cc:740] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.079447   615 consensus_queue.cc:260] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.082054   615 ts_tablet_manager.cc:1434] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:12:39.083652   615 tablet_bootstrap.cc:492] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:39.094733   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8879df9852da4e428d5432830c645ea9" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:39.095513   339 raft_consensus.cc:3060] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.106763   611 tablet_bootstrap.cc:700] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Time spent opening tablet: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:12:39.107527   611 tablet_bootstrap.cc:654] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.108425   751 raft_consensus.cc:493] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.109011   751 raft_consensus.cc:515] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.113781   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:39.114692   414 raft_consensus.cc:2468] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:39.120968   306 leader_election.cc:304] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:39.122474   694 raft_consensus.cc:2804] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.122583   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a993590f1841ea8bb26eaab3ffbca0" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:39.123080   694 raft_consensus.cc:493] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.123595   694 raft_consensus.cc:3060] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.130460   701 consensus_queue.cc:1048] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.079458   612 raft_consensus.cc:359] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.134802   612 raft_consensus.cc:385] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.135128   612 raft_consensus.cc:740] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.121371   720 raft_consensus.cc:515] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:39.136073   612 consensus_queue.cc:260] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.136281   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:39.138082   381 leader_election.cc:343] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.138243   720 leader_election.cc:290] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:39.138592   381 leader_election.cc:304] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141
I20260709 13:12:39.114663   751 leader_election.cc:290] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:39.143432   720 raft_consensus.cc:2749] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.153270   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62ccb3929543488daa15130eed287a" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
W20260709 13:12:39.147472   304 leader_election.cc:343] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.146310   339 raft_consensus.cc:2468] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:39.162885   612 ts_tablet_manager.cc:1434] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.002s
I20260709 13:12:39.149020   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62ccb3929543488daa15130eed287a" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:39.153956   490 raft_consensus.cc:3060] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:39.171788   382 leader_election.cc:343] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.181450   456 leader_election.cc:304] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:39.184077   630 raft_consensus.cc:2804] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.187628   630 raft_consensus.cc:697] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:39.188508   630 consensus_queue.cc:237] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:39.188966   562 raft_consensus.cc:3060] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.194283   612 tablet_bootstrap.cc:492] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:39.196504   610 tablet_bootstrap.cc:492] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:39.197439   610 ts_tablet_manager.cc:1403] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.200s	user 0.041s	sys 0.016s
I20260709 13:12:39.202288   611 tablet_bootstrap.cc:492] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:39.202937   611 ts_tablet_manager.cc:1403] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.223s	user 0.018s	sys 0.010s
I20260709 13:12:39.214766   565 raft_consensus.cc:3060] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.217265   615 tablet_bootstrap.cc:654] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.221479   611 raft_consensus.cc:359] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:39.224243   611 raft_consensus.cc:385] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.224445   611 raft_consensus.cc:740] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.228281   611 consensus_queue.cc:260] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:39.231784   610 raft_consensus.cc:359] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.232662   610 raft_consensus.cc:385] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.233085   610 raft_consensus.cc:740] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
W20260709 13:12:39.232463 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:39.233981   610 consensus_queue.cc:260] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.241081   610 ts_tablet_manager.cc:1434] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 13:12:39.252156   490 raft_consensus.cc:2468] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:39.251943   694 raft_consensus.cc:515] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.254510   611 ts_tablet_manager.cc:1434] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.051s	user 0.001s	sys 0.006s
I20260709 13:12:39.255095   379 leader_election.cc:304] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:39.256287   720 raft_consensus.cc:2804] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.256819   720 raft_consensus.cc:697] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:39.257802   827 consensus_queue.cc:1048] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.257666   720 consensus_queue.cc:237] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:39.261224   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:39.261962   416 raft_consensus.cc:3060] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.270586   694 leader_election.cc:290] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:39.281235   612 tablet_bootstrap.cc:654] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.269353   416 raft_consensus.cc:2468] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:39.285831   611 tablet_bootstrap.cc:492] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:39.288595   610 tablet_bootstrap.cc:492] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:39.299767   306 leader_election.cc:304] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:39.300704   694 raft_consensus.cc:2804] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.301204   694 raft_consensus.cc:697] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:39.302312   694 consensus_queue.cc:237] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.340216   610 tablet_bootstrap.cc:654] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.343184 32706 catalog_manager.cc:5697] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.346771   701 raft_consensus.cc:493] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.347286   701 raft_consensus.cc:515] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.349313   701 leader_election.cc:290] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:39.352073   611 tablet_bootstrap.cc:654] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.352993   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218260d1606649edb1f8c91d1392ed7f" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
W20260709 13:12:39.351997   382 consensus_peers.cc:597] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.355000   381 leader_election.cc:343] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.342056 32707 catalog_manager.cc:5697] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.364588   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:39.366318   615 tablet_bootstrap.cc:492] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:39.366817   615 ts_tablet_manager.cc:1403] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.284s	user 0.018s	sys 0.004s
I20260709 13:12:39.372747   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218260d1606649edb1f8c91d1392ed7f" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:39.373451   490 raft_consensus.cc:2468] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:39.375002   379 leader_election.cc:304] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:39.379099   615 raft_consensus.cc:359] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:39.380178   615 raft_consensus.cc:385] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.380520   615 raft_consensus.cc:740] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.382295   895 raft_consensus.cc:2804] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.382766   895 raft_consensus.cc:493] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.383080   895 raft_consensus.cc:3060] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.391199   615 consensus_queue.cc:260] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:39.392055   865 raft_consensus.cc:493] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.392720   865 raft_consensus.cc:515] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.393720   615 ts_tablet_manager.cc:1434] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:12:39.394711   615 tablet_bootstrap.cc:492] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:39.394780   865 leader_election.cc:290] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:39.402583 32703 catalog_manager.cc:5697] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.416795   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cc376e2d944e4cab791e761af1be67" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:39.423207   831 consensus_queue.cc:1048] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.425942   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cc376e2d944e4cab791e761af1be67" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:39.426836   341 raft_consensus.cc:2393] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54e079297e3a4863ac2eccd69f7dbd9c in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:39.433584   701 consensus_queue.cc:1048] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.436918   530 leader_election.cc:304] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:39.439460   865 raft_consensus.cc:3060] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:39.469273   304 leader_election.cc:343] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.473189   612 tablet_bootstrap.cc:492] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:39.477008   612 ts_tablet_manager.cc:1403] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.296s	user 0.014s	sys 0.010s
I20260709 13:12:39.475528   865 raft_consensus.cc:2749] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.493539   610 tablet_bootstrap.cc:492] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:39.494145   610 ts_tablet_manager.cc:1403] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.210s	user 0.023s	sys 0.001s
I20260709 13:12:39.477753   895 raft_consensus.cc:515] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.500545   893 raft_consensus.cc:493] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:39.480358   381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 61326.4us
I20260709 13:12:39.501137   893 raft_consensus.cc:515] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:39.503336   893 leader_election.cc:290] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
W20260709 13:12:39.496354   962 log.cc:927] Time spent T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:12:39.523646   611 tablet_bootstrap.cc:492] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:39.524235   611 ts_tablet_manager.cc:1403] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.248s	user 0.016s	sys 0.002s
I20260709 13:12:39.527330   611 raft_consensus.cc:359] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.528003   611 raft_consensus.cc:385] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.528299   611 raft_consensus.cc:740] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.529990   611 consensus_queue.cc:260] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.530818   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218260d1606649edb1f8c91d1392ed7f" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:39.531211   827 consensus_queue.cc:1048] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.531533   490 raft_consensus.cc:3060] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.532946   611 ts_tablet_manager.cc:1434] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:39.534098   611 tablet_bootstrap.cc:492] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:39.537075   612 raft_consensus.cc:359] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.538234   612 raft_consensus.cc:385] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.538676   612 raft_consensus.cc:740] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.546350   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218260d1606649edb1f8c91d1392ed7f" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:39.528141   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7fe5c08e134e6297971768dca0caa0" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:39.559506   611 tablet_bootstrap.cc:654] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.599589   615 tablet_bootstrap.cc:654] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.562016   612 consensus_queue.cc:260] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.512749   895 leader_election.cc:290] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:39.581370   490 raft_consensus.cc:2468] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:39.625808   612 ts_tablet_manager.cc:1434] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.148s	user 0.012s	sys 0.002s
I20260709 13:12:39.634287   610 raft_consensus.cc:359] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.639180   610 raft_consensus.cc:385] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.639605   610 raft_consensus.cc:740] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
W20260709 13:12:39.622622   304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:39781, user_credentials={real_user=slave}} blocked reactor thread for 121620us
W20260709 13:12:39.644060   307 leader_election.cc:343] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.567405   958 consensus_queue.cc:1048] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.062s
I20260709 13:12:39.646184   968 raft_consensus.cc:493] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.622938   891 consensus_queue.cc:1048] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:12:39.651118   610 consensus_queue.cc:260] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.655893   379 leader_election.cc:304] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:39.656818   831 raft_consensus.cc:2804] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.657297   831 raft_consensus.cc:697] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:39.658854   831 consensus_queue.cc:237] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.651217   968 raft_consensus.cc:515] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.665413   564 raft_consensus.cc:3060] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:39.670214   381 leader_election.cc:343] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.681388   610 ts_tablet_manager.cc:1434] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.187s	user 0.008s	sys 0.001s
I20260709 13:12:39.682143   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a993590f1841ea8bb26eaab3ffbca0" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:39.682646   610 tablet_bootstrap.cc:492] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:39.682870   416 raft_consensus.cc:2468] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:39.684224   530 leader_election.cc:304] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:39.685767   865 raft_consensus.cc:2804] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.686306   865 raft_consensus.cc:493] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.688546   612 tablet_bootstrap.cc:492] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:39.689095   865 raft_consensus.cc:3060] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.704975   865 raft_consensus.cc:515] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.733721   895 consensus_queue.cc:1048] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.685918   968 leader_election.cc:290] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:39.706180   615 tablet_bootstrap.cc:492] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:39.684798   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a993590f1841ea8bb26eaab3ffbca0" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:39.708415   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7fe5c08e134e6297971768dca0caa0" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:39.717705   610 tablet_bootstrap.cc:654] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.736317   895 raft_consensus.cc:493] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.743387   615 ts_tablet_manager.cc:1403] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.349s	user 0.022s	sys 0.002s
W20260709 13:12:39.753806   304 leader_election.cc:343] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.748656   895 raft_consensus.cc:515] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:39.756106   304 leader_election.cc:304] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:39.758463   895 leader_election.cc:290] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:39.758555   751 raft_consensus.cc:2749] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.760711   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa1d8bf64d4c509074630610c02e52" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:39.761703   611 tablet_bootstrap.cc:492] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:39.762250   611 ts_tablet_manager.cc:1403] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.228s	user 0.027s	sys 0.017s
W20260709 13:12:39.764359   379 leader_election.cc:343] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:39.765635   456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 57861.3us
I20260709 13:12:39.746562   339 raft_consensus.cc:2468] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:39.770053   560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa1d8bf64d4c509074630610c02e52" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:39.770655   611 raft_consensus.cc:359] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.772014   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a993590f1841ea8bb26eaab3ffbca0" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
W20260709 13:12:39.772709   382 leader_election.cc:343] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.773171   382 leader_election.cc:304] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:39.773874   611 raft_consensus.cc:385] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.774168   611 raft_consensus.cc:740] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.774567   720 raft_consensus.cc:2749] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.781750   611 consensus_queue.cc:260] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.784158   490 raft_consensus.cc:3060] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.785099   615 raft_consensus.cc:359] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:39.785866   615 raft_consensus.cc:385] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.786123   615 raft_consensus.cc:740] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.786790   615 consensus_queue.cc:260] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:39.793710   975 consensus_queue.cc:1048] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:39.797374   611 ts_tablet_manager.cc:1434] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:12:39.797633   615 ts_tablet_manager.cc:1434] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:12:39.801105   615 tablet_bootstrap.cc:492] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:39.807075   612 tablet_bootstrap.cc:654] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:39.814695   382 consensus_peers.cc:597] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.811534   694 consensus_queue.cc:1048] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:39.811654   865 leader_election.cc:290] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:39.811002   975 raft_consensus.cc:493] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.818420   975 raft_consensus.cc:515] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.820688   975 leader_election.cc:290] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:39.825139   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a993590f1841ea8bb26eaab3ffbca0" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:39.825870   416 raft_consensus.cc:3060] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.816911   611 tablet_bootstrap.cc:492] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:39.843745   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:39.844581   415 raft_consensus.cc:2468] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:39.847523   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:39.848232   456 leader_election.cc:304] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:39.849800   694 consensus_queue.cc:1048] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.813714 32706 catalog_manager.cc:5697] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.863456   611 tablet_bootstrap.cc:654] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.870600   612 tablet_bootstrap.cc:492] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:39.871093   612 ts_tablet_manager.cc:1403] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.223s	user 0.015s	sys 0.005s
I20260709 13:12:39.877202   612 raft_consensus.cc:359] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:39.878216   612 raft_consensus.cc:385] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.878594   612 raft_consensus.cc:740] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.813331   615 tablet_bootstrap.cc:654] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.879621   612 consensus_queue.cc:260] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:39.881521   630 raft_consensus.cc:2804] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:39.882040   630 raft_consensus.cc:493] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:39.882418   630 raft_consensus.cc:3060] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.883440   612 ts_tablet_manager.cc:1434] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:39.884802   612 tablet_bootstrap.cc:492] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:39.888636   611 tablet_bootstrap.cc:492] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:39.889176   611 ts_tablet_manager.cc:1403] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.008s
I20260709 13:12:39.891970   611 raft_consensus.cc:359] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.892648   611 raft_consensus.cc:385] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.892889   611 raft_consensus.cc:740] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.893499   611 consensus_queue.cc:260] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.894994   611 ts_tablet_manager.cc:1434] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:39.895949   611 tablet_bootstrap.cc:492] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:39.902786   611 tablet_bootstrap.cc:654] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.911134   416 raft_consensus.cc:2468] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:39.916797   610 tablet_bootstrap.cc:492] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:39.918076   610 ts_tablet_manager.cc:1403] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.236s	user 0.020s	sys 0.008s
I20260709 13:12:39.923393   612 tablet_bootstrap.cc:654] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.922240   530 leader_election.cc:304] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:39.926898   611 tablet_bootstrap.cc:492] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:39.927441   611 ts_tablet_manager.cc:1403] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.007s
I20260709 13:12:39.931452   610 raft_consensus.cc:359] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:39.932056   610 raft_consensus.cc:385] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.932299   610 raft_consensus.cc:740] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.931280   865 raft_consensus.cc:2804] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.934062   865 raft_consensus.cc:697] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:39.935333   611 raft_consensus.cc:359] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.936151   611 raft_consensus.cc:385] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.936408   611 raft_consensus.cc:740] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.937053   611 consensus_queue.cc:260] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.940331   611 ts_tablet_manager.cc:1434] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:12:39.941273   611 tablet_bootstrap.cc:492] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:39.941448   865 consensus_queue.cc:237] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:39.926894   630 raft_consensus.cc:515] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:39.944415   630 leader_election.cc:290] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:39.946201   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:39.951345   610 consensus_queue.cc:260] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:39.947970   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:39.962075   610 ts_tablet_manager.cc:1434] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.003s
I20260709 13:12:39.974001   456 leader_election.cc:304] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:39.975129   620 raft_consensus.cc:2749] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:39.998128   610 tablet_bootstrap.cc:492] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:40.068332   694 raft_consensus.cc:493] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.074059   339 raft_consensus.cc:3060] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.069128   694 raft_consensus.cc:515] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.091804   967 raft_consensus.cc:493] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.092458   967 raft_consensus.cc:515] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.103998   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
W20260709 13:12:40.107640   306 leader_election.cc:343] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.121662 32706 catalog_manager.cc:5697] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 1 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.124199   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22622dd6074222841290f4d737acf2" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:40.110348   615 tablet_bootstrap.cc:492] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:40.128697   615 ts_tablet_manager.cc:1403] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.328s	user 0.019s	sys 0.011s
I20260709 13:12:40.110915   612 tablet_bootstrap.cc:492] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:40.129377   612 ts_tablet_manager.cc:1403] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.245s	user 0.033s	sys 0.036s
I20260709 13:12:40.111295   967 leader_election.cc:290] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:40.113013   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22622dd6074222841290f4d737acf2" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:40.131445   615 raft_consensus.cc:359] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:40.129047   895 consensus_queue.cc:1048] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.131983   612 raft_consensus.cc:359] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.132735   612 raft_consensus.cc:385] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.133023   612 raft_consensus.cc:740] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.132877   720 consensus_queue.cc:1048] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.134001   528 leader_election.cc:304] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:40.114883   611 tablet_bootstrap.cc:654] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.117496   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:40.135169   751 raft_consensus.cc:493] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.135708   751 raft_consensus.cc:515] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.116401   694 leader_election.cc:290] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
W20260709 13:12:40.135928   304 leader_election.cc:343] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.137398   304 leader_election.cc:304] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:40.138410   751 leader_election.cc:290] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:40.138584   972 raft_consensus.cc:2749] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.139350   612 consensus_queue.cc:260] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.132169   615 raft_consensus.cc:385] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.141923   612 ts_tablet_manager.cc:1434] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:40.140903   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218260d1606649edb1f8c91d1392ed7f" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:40.146355   615 raft_consensus.cc:740] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.119861   610 tablet_bootstrap.cc:654] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.140414   865 raft_consensus.cc:2749] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.147045   615 consensus_queue.cc:260] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:40.154078   615 ts_tablet_manager.cc:1434] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:12:40.155159   615 tablet_bootstrap.cc:492] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:40.157078   612 tablet_bootstrap.cc:492] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:40.161208   615 tablet_bootstrap.cc:654] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.172753   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218260d1606649edb1f8c91d1392ed7f" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:40.178761   612 tablet_bootstrap.cc:654] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.179826   306 leader_election.cc:304] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:40.190953   694 raft_consensus.cc:2749] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.193835   610 tablet_bootstrap.cc:492] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:40.194366   610 ts_tablet_manager.cc:1403] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.197s	user 0.016s	sys 0.001s
I20260709 13:12:40.195093   661 raft_consensus.cc:493] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.195601   661 raft_consensus.cc:515] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.199086   661 leader_election.cc:290] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:40.199875   560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1743042f2d04b94808274ce1c08af42" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:40.200088   610 raft_consensus.cc:359] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.201107   610 raft_consensus.cc:385] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.201459   610 raft_consensus.cc:740] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
W20260709 13:12:40.201639   382 leader_election.cc:343] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.203908   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1743042f2d04b94808274ce1c08af42" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:40.204417   615 tablet_bootstrap.cc:492] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
W20260709 13:12:40.206466   379 leader_election.cc:343] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.207170   379 leader_election.cc:304] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:40.209128   661 raft_consensus.cc:2749] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.207378   615 ts_tablet_manager.cc:1403] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.002s
I20260709 13:12:40.211182   610 consensus_queue.cc:260] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.213819   610 ts_tablet_manager.cc:1434] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:12:40.220142   615 raft_consensus.cc:359] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.224669   615 raft_consensus.cc:385] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.225083   615 raft_consensus.cc:740] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.226024   615 consensus_queue.cc:260] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.228825   610 tablet_bootstrap.cc:492] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:40.248633   611 tablet_bootstrap.cc:492] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:40.249320   611 ts_tablet_manager.cc:1403] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.308s	user 0.008s	sys 0.004s
I20260709 13:12:40.250329   610 tablet_bootstrap.cc:654] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.252202   611 raft_consensus.cc:359] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.252956   611 raft_consensus.cc:385] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.253257   611 raft_consensus.cc:740] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.254464   611 consensus_queue.cc:260] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.256788   611 ts_tablet_manager.cc:1434] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:40.263348   560 raft_consensus.cc:3060] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.268038   958 raft_consensus.cc:493] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.268707   958 raft_consensus.cc:515] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.274329   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:40.275827   457 leader_election.cc:343] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.280643   958 leader_election.cc:290] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:40.284822   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:40.291409   615 ts_tablet_manager.cc:1434] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
I20260709 13:12:40.292161   339 raft_consensus.cc:2468] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:40.293833   456 leader_election.cc:304] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:40.296427   620 raft_consensus.cc:2804] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.296859   620 raft_consensus.cc:493] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.297194   620 raft_consensus.cc:3060] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.306347   610 tablet_bootstrap.cc:492] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:40.307025   611 tablet_bootstrap.cc:492] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:40.307020   610 ts_tablet_manager.cc:1403] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.015s
I20260709 13:12:40.309991   612 tablet_bootstrap.cc:492] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:40.310554   612 ts_tablet_manager.cc:1403] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.154s	user 0.046s	sys 0.026s
I20260709 13:12:40.310353   610 raft_consensus.cc:359] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.296448   615 tablet_bootstrap.cc:492] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:40.313374   610 raft_consensus.cc:385] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.313831   610 raft_consensus.cc:740] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.314620   610 consensus_queue.cc:260] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.317022   610 ts_tablet_manager.cc:1434] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:12:40.318243   610 tablet_bootstrap.cc:492] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
W20260709 13:12:40.319516 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:40.320595   488 raft_consensus.cc:1240] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Rejecting Update request from peer 70c1750ca53a445883b66469ea339141 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:40.322791   694 consensus_queue.cc:1059] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:40.323771   972 raft_consensus.cc:3055] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:40.324514   972 raft_consensus.cc:740] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:40.324834   610 tablet_bootstrap.cc:654] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.325753   972 consensus_queue.cc:260] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.327250   972 raft_consensus.cc:3060] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.331174   611 tablet_bootstrap.cc:654] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.337010   615 tablet_bootstrap.cc:654] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.338248   620 raft_consensus.cc:515] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.338924   751 raft_consensus.cc:493] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.341395   751 raft_consensus.cc:515] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:40.327032   612 raft_consensus.cc:359] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.342948   612 raft_consensus.cc:385] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.343293   612 raft_consensus.cc:740] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.344017   612 consensus_queue.cc:260] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.350834   612 ts_tablet_manager.cc:1434] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:12:40.354022   620 leader_election.cc:290] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:40.357023   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:40.357772   339 raft_consensus.cc:3060] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.358088   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d997035dbd4e7d88a1f947b2f915bb" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:40.358407   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:40.359321   564 raft_consensus.cc:3060] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.353915   751 leader_election.cc:290] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
W20260709 13:12:40.362993   307 leader_election.cc:343] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.369402   339 raft_consensus.cc:2468] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:40.370569   456 leader_election.cc:304] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:40.377810   612 tablet_bootstrap.cc:492] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:40.375730   958 raft_consensus.cc:2804] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.385000   610 tablet_bootstrap.cc:492] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:40.385635   958 raft_consensus.cc:697] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:40.386147   610 ts_tablet_manager.cc:1403] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.068s	user 0.004s	sys 0.011s
I20260709 13:12:40.386673   958 consensus_queue.cc:237] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.376384   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d997035dbd4e7d88a1f947b2f915bb" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:40.395220   414 raft_consensus.cc:2468] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:40.398348   306 leader_election.cc:304] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:40.407341   694 raft_consensus.cc:2804] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.407800   694 raft_consensus.cc:493] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.408183   694 raft_consensus.cc:3060] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.416383   610 raft_consensus.cc:359] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.418242   610 raft_consensus.cc:385] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.418692   610 raft_consensus.cc:740] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.419747   610 consensus_queue.cc:260] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.422901   694 raft_consensus.cc:515] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:40.425949   694 leader_election.cc:290] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:40.429920   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d997035dbd4e7d88a1f947b2f915bb" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:40.432385   307 leader_election.cc:343] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.440881   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d997035dbd4e7d88a1f947b2f915bb" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:40.442320   415 raft_consensus.cc:3060] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.444674   610 ts_tablet_manager.cc:1434] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.005s
I20260709 13:12:40.447799   615 tablet_bootstrap.cc:492] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:40.448367   615 ts_tablet_manager.cc:1403] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.016s
I20260709 13:12:40.449218   612 tablet_bootstrap.cc:654] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.455761   564 raft_consensus.cc:2468] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:40.452397   415 raft_consensus.cc:2468] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:40.462706   751 raft_consensus.cc:493] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.456861   615 raft_consensus.cc:359] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.461161   306 leader_election.cc:304] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:40.456267 32707 catalog_manager.cc:5697] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.463388   751 raft_consensus.cc:515] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.464059   615 raft_consensus.cc:385] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.464372   615 raft_consensus.cc:740] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.465073   615 consensus_queue.cc:260] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.466034   972 raft_consensus.cc:2804] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.466677   610 tablet_bootstrap.cc:492] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:40.467497   611 tablet_bootstrap.cc:492] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:40.469314   972 raft_consensus.cc:697] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:40.470017   611 ts_tablet_manager.cc:1403] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.163s	user 0.017s	sys 0.023s
I20260709 13:12:40.470243   972 consensus_queue.cc:237] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:40.471782   615 ts_tablet_manager.cc:1434] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 13:12:40.473043   611 raft_consensus.cc:359] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.473739   611 raft_consensus.cc:385] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.473976   611 raft_consensus.cc:740] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.481140   615 tablet_bootstrap.cc:492] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:40.494277   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd9ae6a2eb4b90be3ad7a183c00b8a" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:40.494982   416 raft_consensus.cc:2468] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:40.495841   610 tablet_bootstrap.cc:654] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.496515   967 consensus_queue.cc:1048] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.499768   611 consensus_queue.cc:260] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.512130   339 raft_consensus.cc:3060] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.530611   751 leader_election.cc:290] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:40.525460   979 raft_consensus.cc:493] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.540784   979 raft_consensus.cc:515] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.543154   979 leader_election.cc:290] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:40.549533   701 raft_consensus.cc:493] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.550076   701 raft_consensus.cc:515] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.554579   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:40.535776   306 leader_election.cc:304] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:40.587661   339 raft_consensus.cc:2468] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
W20260709 13:12:40.587795   306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.194:35023, user_credentials={real_user=slave}} blocked reactor thread for 62894.4us
I20260709 13:12:40.588685   751 raft_consensus.cc:2804] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.589051   751 raft_consensus.cc:493] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.589203   694 raft_consensus.cc:493] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.589398   751 raft_consensus.cc:3060] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.589871   694 raft_consensus.cc:515] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.591060   456 leader_election.cc:304] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:40.591928   620 raft_consensus.cc:2804] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.592190   694 leader_election.cc:290] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:40.557904   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd9ae6a2eb4b90be3ad7a183c00b8a" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:40.536168   865 consensus_queue.cc:1048] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:12:40.562633   701 leader_election.cc:290] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:40.565405   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:40.568101   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:40.596393   416 raft_consensus.cc:2468] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
W20260709 13:12:40.596756   304 leader_election.cc:343] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.574203   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:40.597756   340 raft_consensus.cc:2468] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:40.597937   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:40.599798   304 leader_election.cc:343] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.563443   615 tablet_bootstrap.cc:654] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.574440   611 ts_tablet_manager.cc:1434] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.013s
I20260709 13:12:40.586715   612 tablet_bootstrap.cc:492] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:40.600993   612 ts_tablet_manager.cc:1403] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.224s	user 0.034s	sys 0.040s
I20260709 13:12:40.602315   611 tablet_bootstrap.cc:492] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:40.578122   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 44630us
I20260709 13:12:40.603770   612 raft_consensus.cc:359] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.604490   612 raft_consensus.cc:385] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.604770   612 raft_consensus.cc:740] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.586894   610 tablet_bootstrap.cc:492] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:40.571655   958 raft_consensus.cc:493] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.605933   610 ts_tablet_manager.cc:1403] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.156s	user 0.012s	sys 0.020s
I20260709 13:12:40.605872   958 raft_consensus.cc:515] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.608855   958 leader_election.cc:290] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:40.608978   610 raft_consensus.cc:359] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.609845   610 raft_consensus.cc:385] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.610172   610 raft_consensus.cc:740] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.610806   610 consensus_queue.cc:260] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.612915   610 ts_tablet_manager.cc:1434] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:40.605427   612 consensus_queue.cc:260] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.617435   612 ts_tablet_manager.cc:1434] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:12:40.618297   560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa1d8bf64d4c509074630610c02e52" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:40.618512   612 tablet_bootstrap.cc:492] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:40.618642   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa1d8bf64d4c509074630610c02e52" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:40.619408   416 raft_consensus.cc:2468] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
W20260709 13:12:40.619772   457 leader_election.cc:343] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.592270   620 raft_consensus.cc:493] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.621951   610 tablet_bootstrap.cc:492] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:40.622087   620 raft_consensus.cc:3060] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.621722   456 leader_election.cc:304] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:40.628371   560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:40.629098   979 raft_consensus.cc:2804] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.629542   979 raft_consensus.cc:493] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.629937   979 raft_consensus.cc:3060] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.630556   381 leader_election.cc:304] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:40.631582   720 raft_consensus.cc:2804] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.631932   720 raft_consensus.cc:493] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.632385   720 raft_consensus.cc:3060] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.633718   967 raft_consensus.cc:493] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.634224   967 raft_consensus.cc:515] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.634742   610 tablet_bootstrap.cc:654] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.636265   967 leader_election.cc:290] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:40.637006   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7fe5c08e134e6297971768dca0caa0" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:40.637722   490 raft_consensus.cc:2468] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:40.639536   528 leader_election.cc:304] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
W20260709 13:12:40.640318   307 leader_election.cc:343] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.640527  1009 raft_consensus.cc:2804] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.640838   307 leader_election.cc:304] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:40.640944  1009 raft_consensus.cc:493] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.641409  1009 raft_consensus.cc:3060] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.633759   612 tablet_bootstrap.cc:654] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.645319   720 raft_consensus.cc:515] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.645783   694 raft_consensus.cc:2749] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.648778   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:40.648666   720 leader_election.cc:290] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:40.653647   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:40.654858   339 raft_consensus.cc:3060] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.668571   339 raft_consensus.cc:2468] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:40.674063   381 leader_election.cc:304] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:40.674906   701 raft_consensus.cc:2804] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.675827   701 raft_consensus.cc:697] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:40.676890   701 consensus_queue.cc:237] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.700918   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7fe5c08e134e6297971768dca0caa0" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:40.701692   611 tablet_bootstrap.cc:654] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.702033   339 raft_consensus.cc:2468] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 0.
I20260709 13:12:40.643558   979 raft_consensus.cc:515] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.660725   751 raft_consensus.cc:515] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.727617   610 tablet_bootstrap.cc:492] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:40.728245   610 ts_tablet_manager.cc:1403] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.107s	user 0.025s	sys 0.005s
I20260709 13:12:40.752970   620 raft_consensus.cc:515] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.786756   620 leader_election.cc:290] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:40.791481   487 raft_consensus.cc:2393] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 in current term 1: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
I20260709 13:12:40.800994   615 tablet_bootstrap.cc:492] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:40.801594   615 ts_tablet_manager.cc:1403] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.329s	user 0.014s	sys 0.001s
I20260709 13:12:40.805661   610 raft_consensus.cc:359] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.806344   610 raft_consensus.cc:385] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.806655   610 raft_consensus.cc:740] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.807461   610 consensus_queue.cc:260] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.808279   612 tablet_bootstrap.cc:492] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:40.808787   612 ts_tablet_manager.cc:1403] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.190s	user 0.013s	sys 0.029s
I20260709 13:12:40.808588   615 raft_consensus.cc:359] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.809242   615 raft_consensus.cc:385] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.809523   337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:40.809551   615 raft_consensus.cc:740] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.811892   615 consensus_queue.cc:260] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.811128   610 ts_tablet_manager.cc:1434] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.083s	user 0.003s	sys 0.003s
I20260709 13:12:40.814514  1009 raft_consensus.cc:515] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:40.825264   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd9ae6a2eb4b90be3ad7a183c00b8a" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:40.826471   415 raft_consensus.cc:3060] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.811127   337 raft_consensus.cc:2393] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:40.829654   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd9ae6a2eb4b90be3ad7a183c00b8a" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:40.829716  1018 consensus_queue.cc:1048] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:12:40.838112   304 leader_election.cc:343] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.811847   751 leader_election.cc:290] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:40.859371   415 raft_consensus.cc:2468] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:40.860116   661 raft_consensus.cc:493] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.861259   661 raft_consensus.cc:515] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.863301   661 leader_election.cc:290] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:40.827646   979 leader_election.cc:290] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:40.864306   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:40.873775   612 raft_consensus.cc:359] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.874687   612 raft_consensus.cc:385] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.874985   612 raft_consensus.cc:740] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.875658   612 consensus_queue.cc:260] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.890550   615 ts_tablet_manager.cc:1434] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260709 13:12:40.895210   610 tablet_bootstrap.cc:492] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:40.896193   612 ts_tablet_manager.cc:1434] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
W20260709 13:12:40.901247   379 leader_election.cc:343] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.903321   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa1d8bf64d4c509074630610c02e52" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:40.904335   415 raft_consensus.cc:3060] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.907387   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:40.908905   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:40.912393  1009 leader_election.cc:290] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:40.926355   456 leader_election.cc:304] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:40.924875   615 tablet_bootstrap.cc:492] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:40.933451   415 raft_consensus.cc:2468] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
W20260709 13:12:40.924124   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 52487.1us
I20260709 13:12:40.931079  1018 raft_consensus.cc:2749] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.945293   456 leader_election.cc:304] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:40.948689  1018 raft_consensus.cc:2804] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.959805  1018 raft_consensus.cc:697] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:40.960482   612 tablet_bootstrap.cc:492] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:40.960804  1018 consensus_queue.cc:237] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:40.951501   306 leader_election.cc:304] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:40.962509   972 raft_consensus.cc:2804] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.963202   972 raft_consensus.cc:697] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:40.963922   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa1d8bf64d4c509074630610c02e52" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:40.964174   972 consensus_queue.cc:237] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:40.964852   561 raft_consensus.cc:3060] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:40.964017   382 leader_election.cc:343] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.966277   382 leader_election.cc:304] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:40.971127   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7fe5c08e134e6297971768dca0caa0" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:40.973532   488 raft_consensus.cc:3060] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.974881   661 raft_consensus.cc:2749] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.976997   611 tablet_bootstrap.cc:492] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:40.980902   611 ts_tablet_manager.cc:1403] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.379s	user 0.025s	sys 0.053s
I20260709 13:12:40.990975   612 tablet_bootstrap.cc:654] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.010613   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7fe5c08e134e6297971768dca0caa0" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:41.011320   339 raft_consensus.cc:3060] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.023201   610 tablet_bootstrap.cc:654] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.025799   339 raft_consensus.cc:2468] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:41.028592  1009 raft_consensus.cc:493] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.029122  1009 raft_consensus.cc:515] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:41.031796  1009 leader_election.cc:290] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:41.047091   530 leader_election.cc:304] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:12:41.047960  1014 raft_consensus.cc:2804] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.048517  1014 raft_consensus.cc:697] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:41.049315  1014 consensus_queue.cc:237] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:41.054131   620 raft_consensus.cc:493] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.054884   620 raft_consensus.cc:515] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:41.072105   620 leader_election.cc:290] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:41.073041   561 raft_consensus.cc:2468] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:41.096673   488 raft_consensus.cc:2468] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:41.102695 32707 catalog_manager.cc:5697] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.073802   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62ccb3929543488daa15130eed287a" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:41.120524   620 consensus_queue.cc:1048] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.120999   615 tablet_bootstrap.cc:654] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.073776   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62ccb3929543488daa15130eed287a" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:41.130240   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1743042f2d04b94808274ce1c08af42" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:41.131246   415 raft_consensus.cc:2468] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:41.134500   456 leader_election.cc:304] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:41.136180   630 raft_consensus.cc:2804] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.136706   630 raft_consensus.cc:493] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.137096   630 raft_consensus.cc:3060] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.171717   611 raft_consensus.cc:359] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:41.172497   611 raft_consensus.cc:385] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.172771   611 raft_consensus.cc:740] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.178319   611 consensus_queue.cc:260] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
W20260709 13:12:41.186124   307 consensus_peers.cc:597] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.188270   612 tablet_bootstrap.cc:492] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:41.188786   612 ts_tablet_manager.cc:1403] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.229s	user 0.016s	sys 0.001s
I20260709 13:12:41.192905   611 ts_tablet_manager.cc:1434] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.209s	user 0.004s	sys 0.002s
I20260709 13:12:41.197890   630 raft_consensus.cc:515] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:41.201866   630 leader_election.cc:290] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
W20260709 13:12:41.203898   457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 88303.5us
I20260709 13:12:41.204675   610 tablet_bootstrap.cc:492] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:41.205188   610 ts_tablet_manager.cc:1403] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.360s	user 0.021s	sys 0.020s
I20260709 13:12:41.206583   558 raft_consensus.cc:3060] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.208463   612 raft_consensus.cc:359] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:41.209193   612 raft_consensus.cc:385] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.213531   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1743042f2d04b94808274ce1c08af42" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:41.214263   414 raft_consensus.cc:3060] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.216106   528 leader_election.cc:304] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:41.219161   972 consensus_queue.cc:1048] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.220568   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1743042f2d04b94808274ce1c08af42" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:41.221769   615 tablet_bootstrap.cc:492] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:41.222275   615 ts_tablet_manager.cc:1403] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.321s	user 0.017s	sys 0.004s
W20260709 13:12:41.198730   381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 124654us
I20260709 13:12:41.225162   615 raft_consensus.cc:359] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:41.228742   615 raft_consensus.cc:385] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.229043   615 raft_consensus.cc:740] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.229789   615 consensus_queue.cc:260] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:41.209457   612 raft_consensus.cc:740] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.231359   612 consensus_queue.cc:260] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:41.231845   615 ts_tablet_manager.cc:1434] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:41.231992   610 raft_consensus.cc:359] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:41.233009   895 consensus_queue.cc:1048] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.234365   611 tablet_bootstrap.cc:492] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:41.237603   414 raft_consensus.cc:2468] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:41.242890   610 raft_consensus.cc:385] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.247889   610 raft_consensus.cc:740] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.252646   610 consensus_queue.cc:260] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:41.259744   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1743042f2d04b94808274ce1c08af42" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:41.248811  1018 raft_consensus.cc:493] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.263818  1018 raft_consensus.cc:515] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:41.267263   615 tablet_bootstrap.cc:492] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:41.266893   456 leader_election.cc:304] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:41.268918   612 ts_tablet_manager.cc:1434] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.001s
I20260709 13:12:41.270979   610 ts_tablet_manager.cc:1434] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.002s
I20260709 13:12:41.273833  1036 raft_consensus.cc:2804] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.276777   610 tablet_bootstrap.cc:492] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:41.277225  1036 raft_consensus.cc:697] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:41.270853   895 consensus_queue.cc:1048] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:12:41.278301  1036 consensus_queue.cc:237] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:41.280304   611 tablet_bootstrap.cc:654] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.280807  1018 leader_election.cc:290] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:41.282864   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:41.283556   340 raft_consensus.cc:2468] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:41.285118   456 leader_election.cc:304] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:41.285907   979 raft_consensus.cc:2804] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.286275   979 raft_consensus.cc:493] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.286581   979 raft_consensus.cc:3060] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:41.286875   457 leader_election.cc:343] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.288995  1035 raft_consensus.cc:493] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.289602  1035 raft_consensus.cc:515] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
W20260709 13:12:41.290885   457 leader_election.cc:343] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.297488   612 tablet_bootstrap.cc:492] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:41.349189   865 raft_consensus.cc:493] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.349799   865 raft_consensus.cc:515] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:41.355182   865 leader_election.cc:290] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:41.375545   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:41.379957   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d997035dbd4e7d88a1f947b2f915bb" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:41.380244   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d997035dbd4e7d88a1f947b2f915bb" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:41.383157   530 leader_election.cc:304] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:41.384815   865 raft_consensus.cc:2749] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:41.390408   457 leader_election.cc:343] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.396407   615 tablet_bootstrap.cc:654] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.403880   611 tablet_bootstrap.cc:492] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:41.404426   611 ts_tablet_manager.cc:1403] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.203s	user 0.023s	sys 0.007s
I20260709 13:12:41.412811   560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c308c7d16f484992afc75ec0343d26" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
W20260709 13:12:41.414690   382 leader_election.cc:343] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.414913   620 consensus_queue.cc:1048] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:41.418533 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:41.424222   610 tablet_bootstrap.cc:654] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.428190   979 raft_consensus.cc:515] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:41.451783  1035 leader_election.cc:290] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:41.454056   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c308c7d16f484992afc75ec0343d26" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:41.454849   341 raft_consensus.cc:2468] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:41.457329   381 leader_election.cc:304] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:41.458083   612 tablet_bootstrap.cc:654] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.458581  1035 raft_consensus.cc:2804] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.459008   979 leader_election.cc:290] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:41.459028  1035 raft_consensus.cc:493] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.459575  1035 raft_consensus.cc:3060] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.479094   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:41.479892   341 raft_consensus.cc:3060] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.482245  1027 consensus_queue.cc:1048] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.482338   865 consensus_queue.cc:1048] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.489916   564 raft_consensus.cc:3060] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.491452   560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:41.497674  1018 raft_consensus.cc:493] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.511518  1018 raft_consensus.cc:515] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:41.517961   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd9ae6a2eb4b90be3ad7a183c00b8a" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:41.530025   612 tablet_bootstrap.cc:492] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:41.530659   612 ts_tablet_manager.cc:1403] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.239s	user 0.021s	sys 0.002s
W20260709 13:12:41.531857   457 leader_election.cc:343] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.527572   611 raft_consensus.cc:359] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:41.541529   611 raft_consensus.cc:385] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.542213   611 raft_consensus.cc:740] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.531737  1009 raft_consensus.cc:2749] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.544792   611 consensus_queue.cc:260] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:41.544996   612 raft_consensus.cc:359] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:41.546226   612 raft_consensus.cc:385] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.548218   612 raft_consensus.cc:740] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.551004   979 consensus_queue.cc:1048] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.557641  1018 leader_election.cc:290] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:41.559305  1014 consensus_queue.cc:1048] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.562120   611 ts_tablet_manager.cc:1434] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.157s	user 0.009s	sys 0.003s
I20260709 13:12:41.548966   612 consensus_queue.cc:260] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:41.563352   611 tablet_bootstrap.cc:492] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:41.563988   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd9ae6a2eb4b90be3ad7a183c00b8a" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:41.566648   612 ts_tablet_manager.cc:1434] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:12:41.567734   612 tablet_bootstrap.cc:492] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:41.568588   456 leader_election.cc:304] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:41.574885   620 raft_consensus.cc:2749] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.591859   615 tablet_bootstrap.cc:492] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:41.592497   615 ts_tablet_manager.cc:1403] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.341s	user 0.023s	sys 0.008s
I20260709 13:12:41.596648   611 tablet_bootstrap.cc:654] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.601052   610 tablet_bootstrap.cc:492] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:41.601693   610 ts_tablet_manager.cc:1403] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.325s	user 0.011s	sys 0.026s
I20260709 13:12:41.606185   612 tablet_bootstrap.cc:654] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.591946   341 raft_consensus.cc:2468] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:41.608656   661 raft_consensus.cc:493] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:41.609180   661 raft_consensus.cc:515] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:41.611231   661 leader_election.cc:290] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:41.626559   456 leader_election.cc:304] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:41.616075   610 raft_consensus.cc:359] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:41.629258   610 raft_consensus.cc:385] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.633042   630 raft_consensus.cc:2804] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.633656   630 raft_consensus.cc:697] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:41.634438   630 consensus_queue.cc:237] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:41.636026   488 raft_consensus.cc:3060] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.543696  1035 raft_consensus.cc:515] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:41.644778   615 raft_consensus.cc:359] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:41.645527   615 raft_consensus.cc:385] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.649020   615 raft_consensus.cc:740] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.629563   610 raft_consensus.cc:740] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.662672   610 consensus_queue.cc:260] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:41.647804 32704 catalog_manager.cc:5697] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.613998   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:41.671520   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c308c7d16f484992afc75ec0343d26" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:41.675434   339 raft_consensus.cc:3060] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:41.677636   456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 51176.7us
I20260709 13:12:41.675607   615 consensus_queue.cc:260] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:41.646445  1035 leader_election.cc:290] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:41.647390   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c308c7d16f484992afc75ec0343d26" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:41.667369   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:41.699350   339 raft_consensus.cc:2468] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:41.706300   615 ts_tablet_manager.cc:1434] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.000s
I20260709 13:12:41.708534   487 raft_consensus.cc:2393] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 in current term 2: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
I20260709 13:12:41.724326   610 ts_tablet_manager.cc:1434] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.122s	user 0.007s	sys 0.001s
I20260709 13:12:41.729739   615 tablet_bootstrap.cc:492] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9: Bootstrap starting.
I20260709 13:12:41.709776   341 raft_consensus.cc:2468] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 2.
W20260709 13:12:41.751312  1058 log.cc:927] Time spent T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:12:41.752187   382 leader_election.cc:343] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.729663   979 raft_consensus.cc:493] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.755787   979 raft_consensus.cc:515] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:41.727993  1014 raft_consensus.cc:493] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.758836  1014 raft_consensus.cc:515] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
W20260709 13:12:41.764708  1060 log.cc:927] Time spent T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:41.768929   979 leader_election.cc:290] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:41.770258  1028 consensus_queue.cc:1048] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.104s
I20260709 13:12:41.787726   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:41.811673   457 consensus_peers.cc:597] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.813602   381 leader_election.cc:304] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:41.814673   701 raft_consensus.cc:2804] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.815114   701 raft_consensus.cc:697] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:41.818931   381 leader_election.cc:304] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:41.824961   701 consensus_queue.cc:237] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:41.761444  1014 leader_election.cc:290] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:41.855435   610 tablet_bootstrap.cc:492] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:41.837762   895 raft_consensus.cc:2804] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.868371   338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:41.884997   338 raft_consensus.cc:2393] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54e079297e3a4863ac2eccd69f7dbd9c in current term 1: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
I20260709 13:12:41.851524   341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:41.867827   895 raft_consensus.cc:493] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:41.905591   413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:41.897612   895 raft_consensus.cc:3060] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.893792   341 raft_consensus.cc:2468] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 2.
I20260709 13:12:41.922667   615 tablet_bootstrap.cc:654] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.922866   612 tablet_bootstrap.cc:492] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:41.923482   612 ts_tablet_manager.cc:1403] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.356s	user 0.038s	sys 0.042s
I20260709 13:12:41.950080   611 tablet_bootstrap.cc:492] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:41.950907   611 ts_tablet_manager.cc:1403] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.388s	user 0.024s	sys 0.011s
I20260709 13:12:41.946120   979 consensus_queue.cc:1048] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:12:41.968945   612 raft_consensus.cc:359] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:41.969897   612 raft_consensus.cc:385] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.970269   612 raft_consensus.cc:740] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
W20260709 13:12:41.968230   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 57777.3us
W20260709 13:12:42.020722   307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 56663us
I20260709 13:12:42.030885   610 tablet_bootstrap.cc:654] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:42.031579   456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 89927.7us
I20260709 13:12:42.034577   612 consensus_queue.cc:260] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:42.032313   456 leader_election.cc:304] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:42.047663   612 ts_tablet_manager.cc:1434] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.000s
W20260709 13:12:42.028944   306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:35023, user_credentials={real_user=slave}} blocked reactor thread for 78379.9us
I20260709 13:12:42.050576   611 raft_consensus.cc:359] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:42.043146  1073 raft_consensus.cc:2804] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:42.052232  1067 raft_consensus.cc:493] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.058773  1073 raft_consensus.cc:493] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.064236   611 raft_consensus.cc:385] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:42.035908   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 64512.7us
I20260709 13:12:42.088459   611 raft_consensus.cc:740] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.052971   979 raft_consensus.cc:493] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.099098   611 consensus_queue.cc:260] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:42.091799  1073 raft_consensus.cc:3060] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:42.197925   611 ts_tablet_manager.cc:1434] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.247s	user 0.044s	sys 0.022s
I20260709 13:12:42.141273   979 raft_consensus.cc:515] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:42.200377   720 raft_consensus.cc:493] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.093578  1067 raft_consensus.cc:515] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:42.203058   720 raft_consensus.cc:515] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:42.141134   895 raft_consensus.cc:515] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.186462   530 leader_election.cc:304] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:42.219619  1076 raft_consensus.cc:3060] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:42.219712   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 72929us
I20260709 13:12:42.223863   895 leader_election.cc:290] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:42.224776   413 raft_consensus.cc:2468] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 2.
I20260709 13:12:42.231638   979 leader_election.cc:290] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:42.235236  1067 leader_election.cc:290] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:42.243502   611 tablet_bootstrap.cc:492] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:42.251592  1073 raft_consensus.cc:515] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.253865  1073 leader_election.cc:290] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 3 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:42.263226   720 leader_election.cc:290] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
W20260709 13:12:42.266614  1077 log.cc:927] Time spent T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:12:42.273903   612 tablet_bootstrap.cc:492] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:42.280606   612 tablet_bootstrap.cc:654] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.284312  1074 raft_consensus.cc:493] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.284878  1074 raft_consensus.cc:515] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:42.286999 32704 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52024 (request call id 77) took 1116 ms. Trace:
I20260709 13:12:42.288168  1074 leader_election.cc:290] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:42.294292   491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1743042f2d04b94808274ce1c08af42" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:42.296401   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601d16b32f7947f899a17d9b9c4b1152" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:42.300969   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601d16b32f7947f899a17d9b9c4b1152" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:42.301470   611 tablet_bootstrap.cc:654] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.314152   489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601d16b32f7947f899a17d9b9c4b1152" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:42.315150   489 raft_consensus.cc:2468] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:42.326565   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5bbb7df494a0ba42cdb90d573ce1e" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:42.287645 32704 rpcz_store.cc:276] 0709 13:12:41.171973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.172137 (+   164us) service_pool.cc:224] Handling call
0709 13:12:42.286641 (+1114504us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:41.702163 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:41.774586 (+ 72423us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:41.774625 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:12:41.774643 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:41.775179 (+   536us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:41.775246 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:41.775277 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:41.775467 (+   190us) tablet.cc:701] Row locks acquired
0709 13:12:41.775481 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:12:41.775653 (+   172us) write_op.cc:270] Start()
0709 13:12:41.775774 (+   121us) write_op.cc:276] Timestamp: P: 1783602761775604 usec, L: 0
0709 13:12:41.775795 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:12:41.776446 (+   651us) log.cc:844] Serialized 543 byte log entry
0709 13:12:41.778471 (+  2025us) op_driver.cc:464] REPLICATION: finished
0709 13:12:41.778905 (+   434us) write_op.cc:301] APPLY: starting
0709 13:12:41.778984 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:41.779091 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:41.779198 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:41.779406 (+   208us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:41.779575 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:41.779627 (+    52us) write_op.cc:312] APPLY: finished
0709 13:12:41.779826 (+   199us) log.cc:844] Serialized 22 byte log entry
0709 13:12:41.780002 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:41.780090 (+    88us) write_op.cc:454] Released schema lock
0709 13:12:41.780134 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:41.780456 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:41.780486 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3127,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":250,"apply.run_cpu_time_us":1513,"apply.run_wall_time_us":1511,"num_ops":1,"prepare.queue_time_us":934,"prepare.run_cpu_time_us":3202,"prepare.run_wall_time_us":86658,"replication_time_us":2554}]]}
W20260709 13:12:42.346277   457 leader_election.cc:343] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.354255 32706 catalog_manager.cc:5697] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:42.355036   307 leader_election.cc:343] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:42.365139   382 leader_election.cc:343] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.371316  1076 raft_consensus.cc:2749] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:42.375667   381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 170814us
I20260709 13:12:42.388613   612 tablet_bootstrap.cc:492] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:42.390202   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:42.418372   487 raft_consensus.cc:2368] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 for earlier term 2. Current term is 3.
I20260709 13:12:42.420054   612 ts_tablet_manager.cc:1403] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.146s	user 0.008s	sys 0.006s
I20260709 13:12:42.390549 32706 catalog_manager.cc:5697] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 1 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } }
I20260709 13:12:42.422202 32706 catalog_manager.cc:5697] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.423280   612 raft_consensus.cc:359] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:42.425263   337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:42.426059   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1743042f2d04b94808274ce1c08af42" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:42.405670   558 raft_consensus.cc:3060] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.424069 32706 catalog_manager.cc:5697] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.427510   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5bbb7df494a0ba42cdb90d573ce1e" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:42.403117   304 leader_election.cc:304] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:42.433874   340 raft_consensus.cc:2468] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:42.435885  1086 raft_consensus.cc:2804] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.436412  1086 raft_consensus.cc:493] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.436823  1086 raft_consensus.cc:3060] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.424052   612 raft_consensus.cc:385] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.441128   612 raft_consensus.cc:740] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.441947   612 consensus_queue.cc:260] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:42.443755   337 raft_consensus.cc:2468] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 2.
I20260709 13:12:42.444496  1083 consensus_queue.cc:1048] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:42.451996   612 ts_tablet_manager.cc:1434] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
I20260709 13:12:42.453727   381 leader_election.cc:304] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:42.460832  1083 raft_consensus.cc:2804] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.461350  1083 raft_consensus.cc:493] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.461439   381 leader_election.cc:304] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:42.461831  1083 raft_consensus.cc:3060] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.462394   701 raft_consensus.cc:2804] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:42.476224   701 raft_consensus.cc:697] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
W20260709 13:12:42.468780   457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 53736.3us
I20260709 13:12:42.472383   611 tablet_bootstrap.cc:492] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:42.473527   530 leader_election.cc:304] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:42.477867   611 ts_tablet_manager.cc:1403] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.235s	user 0.011s	sys 0.009s
I20260709 13:12:42.468835   612 tablet_bootstrap.cc:492] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
W20260709 13:12:42.469237   615 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.007s
W20260709 13:12:42.479313   615 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.006s	sys 0.007s
I20260709 13:12:42.449213  1086 raft_consensus.cc:515] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:42.476821   701 consensus_queue.cc:237] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.488591  1069 consensus_queue.cc:1048] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:42.489317   339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:42.490170   339 raft_consensus.cc:3060] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:42.496362   489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601d16b32f7947f899a17d9b9c4b1152" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:42.497154   489 raft_consensus.cc:3060] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.505934   610 tablet_bootstrap.cc:492] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:42.506502   610 ts_tablet_manager.cc:1403] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.680s	user 0.017s	sys 0.014s
I20260709 13:12:42.508594   337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601d16b32f7947f899a17d9b9c4b1152" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:42.509459   337 raft_consensus.cc:2393] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 1: Already voted for candidate 70c1750ca53a445883b66469ea339141 in this term.
I20260709 13:12:42.510231   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdba3586e7ba42179a320766690f44bc" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:42.510673   379 leader_election.cc:400] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Vote denied by peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781) with higher term. Message: Invalid argument: T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 for earlier term 2. Current term is 3.
I20260709 13:12:42.519107   339 raft_consensus.cc:2468] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 3.
I20260709 13:12:42.523934   610 raft_consensus.cc:359] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:42.530164   610 raft_consensus.cc:385] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.530635   610 raft_consensus.cc:740] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.532936   456 leader_election.cc:304] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141
I20260709 13:12:42.532743   610 consensus_queue.cc:260] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:42.534307  1009 raft_consensus.cc:2749] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.536128   610 ts_tablet_manager.cc:1434] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:12:42.536733  1073 consensus_queue.cc:1048] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:42.538200  1089 log.cc:927] Time spent T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:12:42.544149   610 tablet_bootstrap.cc:492] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:42.544222   611 raft_consensus.cc:359] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.545148   611 raft_consensus.cc:385] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.546630   456 leader_election.cc:304] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:42.545518   611 raft_consensus.cc:740] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.551007   630 raft_consensus.cc:2804] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:42.551537   630 raft_consensus.cc:697] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:42.552461   615 tablet_bootstrap.cc:492] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9: No bootstrap required, opened a new log
I20260709 13:12:42.553121   615 ts_tablet_manager.cc:1403] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9: Time spent bootstrapping tablet: real 0.838s	user 0.016s	sys 0.012s
I20260709 13:12:42.553912   611 consensus_queue.cc:260] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.552426   630 consensus_queue.cc:237] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.533816  1086 leader_election.cc:290] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:42.578059   611 ts_tablet_manager.cc:1434] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.000s
I20260709 13:12:42.579643   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601d16b32f7947f899a17d9b9c4b1152" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:42.581866 32754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:12:42.574832   382 consensus_peers.cc:597] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Couldn't send request to peer 54e079297e3a4863ac2eccd69f7dbd9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.598542   563 raft_consensus.cc:3060] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.611094   611 tablet_bootstrap.cc:492] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:42.611207   979 raft_consensus.cc:493] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.611781   979 raft_consensus.cc:515] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:42.598673   489 raft_consensus.cc:2468] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:42.625605   304 leader_election.cc:304] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:42.626631  1085 raft_consensus.cc:2804] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.626895  1069 raft_consensus.cc:2749] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.627143  1085 raft_consensus.cc:697] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:42.621217   615 raft_consensus.cc:359] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.639011   615 raft_consensus.cc:385] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.639374   615 raft_consensus.cc:740] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.641861   615 consensus_queue.cc:260] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.628120  1085 consensus_queue.cc:237] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:42.661922   615 ts_tablet_manager.cc:1434] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9: Time spent starting tablet: real 0.108s	user 0.010s	sys 0.000s
I20260709 13:12:42.626652  1083 raft_consensus.cc:515] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:42.668864  1083 leader_election.cc:290] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:42.669912   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5bbb7df494a0ba42cdb90d573ce1e" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:42.671482   382 leader_election.cc:343] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.672263  1083 raft_consensus.cc:493] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.672747  1083 raft_consensus.cc:515] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.674352   336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5bbb7df494a0ba42cdb90d573ce1e" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:42.675288   336 raft_consensus.cc:3060] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.677297   337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4a00d69b74c98ab81dd2996356c83" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:42.678005   337 raft_consensus.cc:2468] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 0.
I20260709 13:12:42.679488   381 leader_election.cc:304] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:42.684221  1083 leader_election.cc:290] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:42.687968   610 tablet_bootstrap.cc:654] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.681581   563 raft_consensus.cc:2468] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:42.698489   612 tablet_bootstrap.cc:654] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.700950   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:42.701622   416 raft_consensus.cc:2468] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 0.
I20260709 13:12:42.702951   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:42.690420  1035 raft_consensus.cc:2804] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.704509  1035 raft_consensus.cc:493] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.704923  1035 raft_consensus.cc:3060] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.707306   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4a00d69b74c98ab81dd2996356c83" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:42.663973   979 leader_election.cc:290] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
W20260709 13:12:42.710350   457 leader_election.cc:343] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:42.717381   379 leader_election.cc:343] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.717648   456 leader_election.cc:304] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:42.719295  1069 raft_consensus.cc:2804] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.719717  1069 raft_consensus.cc:493] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.720098  1069 raft_consensus.cc:3060] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.727972   611 tablet_bootstrap.cc:654] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.741269   336 raft_consensus.cc:2468] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:42.769093   381 leader_election.cc:304] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:42.774914  1082 raft_consensus.cc:2804] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.790777  1082 raft_consensus.cc:697] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:42.807405   612 tablet_bootstrap.cc:492] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:42.813894   612 ts_tablet_manager.cc:1403] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.345s	user 0.014s	sys 0.008s
I20260709 13:12:42.826041 32703 catalog_manager.cc:5697] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.829943  1082 consensus_queue.cc:237] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:42.834824  1035 raft_consensus.cc:515] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.838989   340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4a00d69b74c98ab81dd2996356c83" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
I20260709 13:12:42.839716   340 raft_consensus.cc:3060] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.841177 32706 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52032 (request call id 83) took 1089 ms. Trace:
I20260709 13:12:42.846644   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4a00d69b74c98ab81dd2996356c83" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:42.847550   340 raft_consensus.cc:2468] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:42.849764   610 tablet_bootstrap.cc:492] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:42.870383   610 ts_tablet_manager.cc:1403] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.326s	user 0.017s	sys 0.000s
I20260709 13:12:42.854700  1069 raft_consensus.cc:515] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:42.874944  1069 leader_election.cc:290] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:42.841481   612 raft_consensus.cc:359] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
W20260709 13:12:42.876127   379 leader_election.cc:343] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.837317  1035 leader_election.cc:290] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:42.877081   612 raft_consensus.cc:385] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.877949   610 raft_consensus.cc:359] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.878672   610 raft_consensus.cc:385] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.878927   610 raft_consensus.cc:740] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.877871   612 raft_consensus.cc:740] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.881290   612 consensus_queue.cc:260] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:42.883919   381 leader_election.cc:304] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:42.885689   612 ts_tablet_manager.cc:1434] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:12:42.885660   610 consensus_queue.cc:260] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.887302   612 tablet_bootstrap.cc:492] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:42.889719   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:42.890833   416 raft_consensus.cc:3060] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.894040  1087 raft_consensus.cc:2804] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.895396  1087 raft_consensus.cc:697] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:42.896674  1087 consensus_queue.cc:237] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.901080   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:42.903906   610 ts_tablet_manager.cc:1434] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
W20260709 13:12:42.906562   457 leader_election.cc:343] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.911453   611 tablet_bootstrap.cc:492] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: No bootstrap required, opened a new log
I20260709 13:12:42.912005   611 ts_tablet_manager.cc:1403] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.301s	user 0.030s	sys 0.006s
I20260709 13:12:42.914788   611 raft_consensus.cc:359] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:42.915444   611 raft_consensus.cc:385] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.915740   611 raft_consensus.cc:740] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.916456   611 consensus_queue.cc:260] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:42.918285   611 ts_tablet_manager.cc:1434] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:42.919116 32704 catalog_manager.cc:5697] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.921200   610 tablet_bootstrap.cc:492] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98: Bootstrap starting.
I20260709 13:12:42.866868 32706 rpcz_store.cc:276] 0709 13:12:41.751371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.752718 (+  1347us) service_pool.cc:224] Handling call
0709 13:12:42.841111 (+1088393us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:42.590322 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:42.621512 (+ 31190us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:42.621550 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:12:42.621584 (+    34us) tablet.cc:662] Decoding operations
0709 13:12:42.622258 (+   674us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:42.622346 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:42.622377 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:12:42.622771 (+   394us) tablet.cc:701] Row locks acquired
0709 13:12:42.622791 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:12:42.622941 (+   150us) write_op.cc:270] Start()
0709 13:12:42.623052 (+   111us) write_op.cc:276] Timestamp: P: 1783602762622903 usec, L: 0
0709 13:12:42.623070 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:12:42.623675 (+   605us) log.cc:844] Serialized 1717 byte log entry
0709 13:12:42.720528 (+ 96853us) op_driver.cc:464] REPLICATION: finished
0709 13:12:42.796275 (+ 75747us) write_op.cc:301] APPLY: starting
0709 13:12:42.796355 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:42.796498 (+   143us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:42.796881 (+   383us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:42.801524 (+  4643us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:42.801743 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:12:42.801791 (+    48us) write_op.cc:312] APPLY: finished
0709 13:12:42.802020 (+   229us) log.cc:844] Serialized 40 byte log entry
0709 13:12:42.802193 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:42.802313 (+   120us) write_op.cc:454] Released schema lock
0709 13:12:42.802359 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:42.802734 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:42.802772 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":128661,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":75490,"apply.run_cpu_time_us":2622,"apply.run_wall_time_us":6440,"num_ops":4,"prepare.queue_time_us":122388,"prepare.run_cpu_time_us":3367,"prepare.run_wall_time_us":48123,"replication_time_us":97314,"thread_start_us":122575,"threads_started":2}]]}
I20260709 13:12:42.941336   487 raft_consensus.cc:1240] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 LEADER]: Rejecting Update request from peer 7b79bd4dca614b218791c5293a51c7a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:42.942487   416 raft_consensus.cc:2468] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:42.944056  1082 consensus_queue.cc:1059] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:42.944969  1082 consensus_queue.cc:1243] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Peer c547e4ecc9ae4f03a72252a7d8049f98 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:12:42.945534  1082 raft_consensus.cc:3055] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:42.945896  1082 raft_consensus.cc:740] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:42.947319   610 tablet_bootstrap.cc:654] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.935629 32703 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52010 (request call id 82) took 1085 ms. Trace:
I20260709 13:12:42.947788 32703 rpcz_store.cc:276] 0709 13:12:41.850900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.851062 (+   162us) service_pool.cc:224] Handling call
0709 13:12:42.935565 (+1084503us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:42.831213 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:42.831781 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:42.831823 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:12:42.831841 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:42.832220 (+   379us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:42.832294 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:42.832331 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:42.832547 (+   216us) tablet.cc:701] Row locks acquired
0709 13:12:42.832570 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:12:42.832704 (+   134us) write_op.cc:270] Start()
0709 13:12:42.832822 (+   118us) write_op.cc:276] Timestamp: P: 1783602762832659 usec, L: 0
0709 13:12:42.832846 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:12:42.833466 (+   620us) log.cc:844] Serialized 543 byte log entry
0709 13:12:42.882142 (+ 48676us) op_driver.cc:464] REPLICATION: finished
0709 13:12:42.895584 (+ 13442us) write_op.cc:301] APPLY: starting
0709 13:12:42.895673 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:42.895971 (+   298us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:42.896063 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:42.896276 (+   213us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:42.896416 (+   140us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:42.896457 (+    41us) write_op.cc:312] APPLY: finished
0709 13:12:42.896646 (+   189us) log.cc:844] Serialized 22 byte log entry
0709 13:12:42.896816 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:42.896910 (+    94us) write_op.cc:454] Released schema lock
0709 13:12:42.896947 (+    37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":451519,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":160,"apply.run_cpu_time_us":1682,"apply.run_wall_time_us":1682,"num_ops":1,"prepare.queue_time_us":192,"prepare.run_cpu_time_us":2579,"prepare.run_wall_time_us":4034,"replication_time_us":43673}]]}
I20260709 13:12:42.950788   456 leader_election.cc:304] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:42.975347   979 raft_consensus.cc:2804] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.975872   979 raft_consensus.cc:697] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:42.976738   979 consensus_queue.cc:237] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:42.952921   558 raft_consensus.cc:3060] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.946950  1082 consensus_queue.cc:260] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:42.969622   610 tablet_bootstrap.cc:492] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98: No bootstrap required, opened a new log
I20260709 13:12:42.989352   610 ts_tablet_manager.cc:1403] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent bootstrapping tablet: real 0.068s	user 0.019s	sys 0.000s
I20260709 13:12:42.970521   612 tablet_bootstrap.cc:654] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.003989  1082 raft_consensus.cc:3060] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:42.993314   610 raft_consensus.cc:359] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:43.017875   610 raft_consensus.cc:385] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.018338   610 raft_consensus.cc:740] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.020696   610 consensus_queue.cc:260] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:43.068084   972 raft_consensus.cc:493] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.068838   972 raft_consensus.cc:515] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:43.096423   610 ts_tablet_manager.cc:1434] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98: Time spent starting tablet: real 0.107s	user 0.011s	sys 0.001s
I20260709 13:12:43.099805   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c071a99756034ba58ef554450a637513" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:43.100358   972 leader_election.cc:290] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:43.100786   487 raft_consensus.cc:2468] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 0.
I20260709 13:12:43.102713   304 leader_election.cc:304] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:43.103842   972 raft_consensus.cc:2804] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.104296   972 raft_consensus.cc:493] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.104661   972 raft_consensus.cc:3060] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.026535 32706 catalog_manager.cc:5697] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 1 to 3, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.113778   612 tablet_bootstrap.cc:492] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:43.114418   612 ts_tablet_manager.cc:1403] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.227s	user 0.014s	sys 0.000s
I20260709 13:12:43.118736   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c071a99756034ba58ef554450a637513" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:43.119185   339 raft_consensus.cc:1275] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Refusing update from remote peer c547e4ecc9ae4f03a72252a7d8049f98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:12:43.121730   307 leader_election.cc:343] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.121588  1078 consensus_queue.cc:1048] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.123541   630 raft_consensus.cc:493] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.124064   630 raft_consensus.cc:515] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:43.125890  1073 consensus_queue.cc:1048] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:43.126500   612 raft_consensus.cc:359] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:43.127345   612 raft_consensus.cc:385] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.127627   612 raft_consensus.cc:740] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.128345   612 consensus_queue.cc:260] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:43.129789   630 leader_election.cc:290] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:43.131529   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4a00d69b74c98ab81dd2996356c83" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:43.139369   612 ts_tablet_manager.cc:1434] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:12:43.140542   612 tablet_bootstrap.cc:492] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:43.145591   336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4a00d69b74c98ab81dd2996356c83" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:43.146715   336 raft_consensus.cc:2393] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 1: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:43.148656   456 leader_election.cc:304] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:43.149845   630 raft_consensus.cc:3060] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.161463 32704 catalog_manager.cc:5697] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.164404 32704 catalog_manager.cc:5697] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.168689   630 raft_consensus.cc:2749] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.138525   972 raft_consensus.cc:515] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:43.180009 32706 catalog_manager.cc:5697] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.181862  1009 raft_consensus.cc:493] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.184250  1009 raft_consensus.cc:515] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:43.193274   972 leader_election.cc:290] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:43.194839   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c071a99756034ba58ef554450a637513" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:43.195508   487 raft_consensus.cc:3060] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.201779   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c071a99756034ba58ef554450a637513" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:43.208009   307 leader_election.cc:343] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.215466  1009 leader_election.cc:290] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:43.217052   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:43.218303   416 raft_consensus.cc:2393] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54e079297e3a4863ac2eccd69f7dbd9c in current term 1: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
I20260709 13:12:43.219920   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:43.223513   415 raft_consensus.cc:1275] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Refusing update from remote peer c547e4ecc9ae4f03a72252a7d8049f98: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:12:43.223914   415 pending_rounds.cc:85] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9: Aborting all ops after (but not including) 1
I20260709 13:12:43.224138   415 pending_rounds.cc:107] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:12:43.224383   415 raft_consensus.cc:2889] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.233791  1079 consensus_queue.cc:1048] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:43.238040   530 leader_election.cc:304] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:43.244629   487 raft_consensus.cc:2468] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 1.
I20260709 13:12:43.247923 32703 catalog_manager.cc:5697] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.249118  1009 raft_consensus.cc:3060] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.256886   720 consensus_queue.cc:1048] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:43.260569   612 tablet_bootstrap.cc:654] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.263474   304 leader_election.cc:304] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:12:43.265975  1011 consensus_queue.cc:1048] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.267894  1085 raft_consensus.cc:2804] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.268602  1085 raft_consensus.cc:697] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:43.269960  1085 consensus_queue.cc:237] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:43.274088   612 tablet_bootstrap.cc:492] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:43.274724   612 ts_tablet_manager.cc:1403] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.134s	user 0.007s	sys 0.007s
I20260709 13:12:43.292850   612 raft_consensus.cc:359] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:43.293673   612 raft_consensus.cc:385] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.294010   612 raft_consensus.cc:740] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.297446   612 consensus_queue.cc:260] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:43.301554   612 ts_tablet_manager.cc:1434] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:12:43.305341   612 tablet_bootstrap.cc:492] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c: Bootstrap starting.
I20260709 13:12:43.320014   612 tablet_bootstrap.cc:654] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.323565  1009 raft_consensus.cc:2749] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.358264 32706 catalog_manager.cc:5697] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.390367   612 tablet_bootstrap.cc:492] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c: No bootstrap required, opened a new log
I20260709 13:12:43.391052   612 ts_tablet_manager.cc:1403] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.019s
I20260709 13:12:43.394533   612 raft_consensus.cc:359] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:43.395320   612 raft_consensus.cc:385] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.395617   612 raft_consensus.cc:740] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.396487   612 consensus_queue.cc:260] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:43.398792   612 ts_tablet_manager.cc:1434] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:43.422567  1073 consensus_queue.cc:1048] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.434077   563 raft_consensus.cc:3060] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.459949   630 consensus_queue.cc:1048] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.501462   720 consensus_queue.cc:1048] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.515220  1035 consensus_queue.cc:1048] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.520069  1035 consensus_queue.cc:1048] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:43.587929   457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 51381.7us
I20260709 13:12:43.731658   972 consensus_queue.cc:1048] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.765314   563 raft_consensus.cc:3060] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.775302  1078 consensus_queue.cc:1048] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.288898 25395 tablet_server.cc:179] TabletServer@127.24.204.193:0 shutting down...
W20260709 13:12:45.298242   530 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:12:45.321161   530 consensus_peers.cc:597] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.342099   456 consensus_peers.cc:597] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.344101   381 consensus_peers.cc:597] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.347642   456 consensus_peers.cc:597] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.347440   381 consensus_peers.cc:597] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.358361 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:45.359321 25395 tablet_replica.cc:333] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.360347 25395 raft_consensus.cc:2243] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.361533 25395 raft_consensus.cc:2272] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.363526 25395 tablet_replica.cc:333] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.364173 25395 raft_consensus.cc:2243] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.364588 25395 raft_consensus.cc:2272] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.366816 25395 tablet_replica.cc:333] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.367648 25395 raft_consensus.cc:2243] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.368577 25395 raft_consensus.cc:2272] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.370874 25395 tablet_replica.cc:333] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.371423 25395 raft_consensus.cc:2243] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.371832 25395 raft_consensus.cc:2272] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.373638 25395 tablet_replica.cc:333] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.374185 25395 raft_consensus.cc:2243] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.374593 25395 raft_consensus.cc:2272] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.376598 25395 tablet_replica.cc:333] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.377372 25395 raft_consensus.cc:2243] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.377866 25395 raft_consensus.cc:2272] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.380018 25395 tablet_replica.cc:333] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.380612 25395 raft_consensus.cc:2243] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.381060 25395 raft_consensus.cc:2272] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.384102 25395 tablet_replica.cc:333] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.384902 25395 raft_consensus.cc:2243] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.385403 25395 raft_consensus.cc:2272] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.388011 25395 tablet_replica.cc:333] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.388943 25395 raft_consensus.cc:2243] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.389453 25395 raft_consensus.cc:2272] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.392154 25395 tablet_replica.cc:333] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.393006 25395 raft_consensus.cc:2243] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.393491 25395 raft_consensus.cc:2272] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:45.401858   456 consensus_peers.cc:597] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.403893   381 consensus_peers.cc:597] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.405234 25395 tablet_replica.cc:333] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.406154 25395 raft_consensus.cc:2243] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.406683 25395 raft_consensus.cc:2272] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.409976 25395 tablet_replica.cc:333] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.411194 25395 raft_consensus.cc:2243] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.419029 25395 raft_consensus.cc:2272] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:45.421726   381 consensus_peers.cc:597] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.426786 25395 tablet_replica.cc:333] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.427678 25395 raft_consensus.cc:2243] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:45.427821   456 consensus_peers.cc:597] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.429358   381 consensus_peers.cc:597] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.431072 25395 raft_consensus.cc:2272] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:45.434203   530 consensus_peers.cc:597] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.435222 25395 tablet_replica.cc:333] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.436255 25395 raft_consensus.cc:2243] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.436890 25395 raft_consensus.cc:2272] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.439530 25395 tablet_replica.cc:333] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.440451 25395 raft_consensus.cc:2243] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.441015 25395 raft_consensus.cc:2272] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.443593 25395 tablet_replica.cc:333] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.444447 25395 raft_consensus.cc:2243] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.445077 25395 raft_consensus.cc:2272] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.448292 25395 tablet_replica.cc:333] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.449203 25395 raft_consensus.cc:2243] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.450330 25395 raft_consensus.cc:2272] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.453325 25395 tablet_replica.cc:333] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.454213 25395 raft_consensus.cc:2243] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.455274 25395 raft_consensus.cc:2272] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.458676 25395 tablet_replica.cc:333] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.459561 25395 raft_consensus.cc:2243] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:45.459951   381 consensus_peers.cc:597] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.460115   456 consensus_peers.cc:597] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.460104 25395 raft_consensus.cc:2272] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.463516 25395 tablet_replica.cc:333] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.464404 25395 raft_consensus.cc:2243] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.464998 25395 raft_consensus.cc:2272] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:45.467007   456 consensus_peers.cc:597] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.468226 25395 tablet_replica.cc:333] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.469230 25395 raft_consensus.cc:2243] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.470538 25395 raft_consensus.cc:2272] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.473966 25395 tablet_replica.cc:333] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.474869 25395 raft_consensus.cc:2243] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.475488 25395 raft_consensus.cc:2272] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.478410 25395 tablet_replica.cc:333] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.479403 25395 raft_consensus.cc:2243] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.480540 25395 raft_consensus.cc:2272] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.483150 25395 tablet_replica.cc:333] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.484004 25395 raft_consensus.cc:2243] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.484556 25395 raft_consensus.cc:2272] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.487255 25395 tablet_replica.cc:333] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.488109 25395 raft_consensus.cc:2243] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.488691 25395 raft_consensus.cc:2272] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:45.490262   381 consensus_peers.cc:597] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.491750 25395 tablet_replica.cc:333] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.492693 25395 raft_consensus.cc:2243] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.493191 25395 raft_consensus.cc:2272] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:45.495525   381 consensus_peers.cc:597] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.495935 25395 tablet_replica.cc:333] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.496843 25395 raft_consensus.cc:2243] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.497953 25395 raft_consensus.cc:2272] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.500813 25395 tablet_replica.cc:333] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.501628 25395 raft_consensus.cc:2243] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.502168 25395 raft_consensus.cc:2272] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.505271 25395 tablet_replica.cc:333] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.506160 25395 raft_consensus.cc:2243] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.506727 25395 raft_consensus.cc:2272] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.509820 25395 tablet_replica.cc:333] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
W20260709 13:12:45.510046   456 consensus_peers.cc:597] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.510717 25395 raft_consensus.cc:2243] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.511435 25395 raft_consensus.cc:2272] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.514477 25395 tablet_replica.cc:333] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.515326 25395 raft_consensus.cc:2243] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.515893 25395 raft_consensus.cc:2272] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:45.518898   456 consensus_peers.cc:597] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.518939 25395 tablet_replica.cc:333] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.520269 25395 raft_consensus.cc:2243] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:45.520889   381 consensus_peers.cc:597] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.521494 25395 raft_consensus.cc:2272] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.524427 25395 tablet_replica.cc:333] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.525311 25395 raft_consensus.cc:2243] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.526470 25395 raft_consensus.cc:2272] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:45.528606   381 consensus_peers.cc:597] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.529011 25395 tablet_replica.cc:333] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.529806 25395 raft_consensus.cc:2243] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.530280 25395 raft_consensus.cc:2272] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.533411 25395 tablet_replica.cc:333] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.534233 25395 raft_consensus.cc:2243] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.535030 25395 raft_consensus.cc:2272] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.537293 25395 tablet_replica.cc:333] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.538010 25395 raft_consensus.cc:2243] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.538496 25395 raft_consensus.cc:2272] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.541056 25395 tablet_replica.cc:333] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: stopping tablet replica
W20260709 13:12:45.541531   530 consensus_peers.cc:597] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.541848 25395 raft_consensus.cc:2243] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.542842 25395 raft_consensus.cc:2272] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.545367 25395 tablet_replica.cc:333] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.546144 25395 raft_consensus.cc:2243] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.546656 25395 raft_consensus.cc:2272] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.549319 25395 tablet_replica.cc:333] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.550093 25395 raft_consensus.cc:2243] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.550580 25395 raft_consensus.cc:2272] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:45.551224   456 consensus_peers.cc:597] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.552484 25395 tablet_replica.cc:333] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.553319 25395 raft_consensus.cc:2243] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.553807 25395 raft_consensus.cc:2272] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.555872 25395 tablet_replica.cc:333] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.556411 25395 raft_consensus.cc:2243] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:45.557318 25395 raft_consensus.cc:2272] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.559757 25395 tablet_replica.cc:333] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.560442 25395 raft_consensus.cc:2243] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.560891 25395 raft_consensus.cc:2272] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.563378 25395 tablet_replica.cc:333] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.564085 25395 raft_consensus.cc:2243] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.564574 25395 raft_consensus.cc:2272] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.566792 25395 tablet_replica.cc:333] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: stopping tablet replica
I20260709 13:12:45.567432 25395 raft_consensus.cc:2243] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.567862 25395 raft_consensus.cc:2272] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:45.570487 25395 tablet_replica.cc:333] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: stopping tablet replica
W20260709 13:12:45.570773   381 consensus_peers.cc:597] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.571165 25395 raft_consensus.cc:2243] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:45.571756 25395 raft_consensus.cc:2272] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:45.657986   381 consensus_peers.cc:597] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.659334 25395 tablet_server.cc:196] TabletServer@127.24.204.193:0 shutdown complete.
W20260709 13:12:45.683123   381 consensus_peers.cc:597] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.753052   530 consensus_peers.cc:597] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.754980   381 consensus_peers.cc:597] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.756806   381 consensus_peers.cc:597] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.758255   456 consensus_peers.cc:597] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.769506 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:45.798666   381 consensus_peers.cc:597] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.841194   456 consensus_peers.cc:597] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.849213  1157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:45.856673  1158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:45.862900   381 consensus_peers.cc:597] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:45.904713  1160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:45.905165 25395 server_base.cc:1061] running on GCE node
I20260709 13:12:45.910902 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:45.911265 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:45.911510 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602765911485 us; error 0 us; skew 500 ppm
I20260709 13:12:45.912331 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:45.918388 25395 webserver.cc:533] Webserver started at http://127.24.204.193:35565/ using document root <none> and password file <none>
I20260709 13:12:45.919080 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:45.919325 25395 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:12:45.927034 25395 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:12:45.956475  1165 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:45.961606 25395 fs_manager.cc:730] Time spent opening block manager: real 0.024s	user 0.005s	sys 0.004s
I20260709 13:12:45.962011 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-0-root
uuid: "70c1750ca53a445883b66469ea339141"
format_stamp: "Formatted at 2026-07-09 13:12:30 on dist-test-slave-qv7r"
I20260709 13:12:45.962734 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602508284650-25395-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:46.084398 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:46.085985 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:46.087687 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:46.094348  1174 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:12:46.342738  1175 raft_consensus.cc:493] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.343333  1175 raft_consensus.cc:515] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.347144   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c071a99756034ba58ef554450a637513" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:46.363082   530 leader_election.cc:336] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.363706   530 leader_election.cc:304] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:46.346592  1175 leader_election.cc:290] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.365664  1175 raft_consensus.cc:2749] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:46.465333 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:12:46.465796 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.374s	user 0.010s	sys 0.001s
I20260709 13:12:46.466158 25395 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:12:46.470456  1156 raft_consensus.cc:493] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.471082  1156 raft_consensus.cc:515] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
W20260709 13:12:46.477440   530 leader_election.cc:336] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.478246  1156 leader_election.cc:290] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:46.479539  1174 tablet_bootstrap.cc:492] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:46.479668   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77cacfdc1e943a6ae75838391278350" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:46.481228   530 leader_election.cc:304] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:46.482370  1156 raft_consensus.cc:2749] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:46.495335  1137 raft_consensus.cc:493] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.495942  1137 raft_consensus.cc:515] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.499195   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55312d46dd4747c0bacb0d980ca208b1" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:46.504830  1137 leader_election.cc:290] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
W20260709 13:12:46.509579   456 leader_election.cc:336] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.509855  1174 tablet_bootstrap.cc:492] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:46.510217   456 leader_election.cc:304] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141
I20260709 13:12:46.510875  1174 tablet_bootstrap.cc:492] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:46.511089  1137 raft_consensus.cc:2749] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:46.513036  1174 ts_tablet_manager.cc:1403] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.000s
I20260709 13:12:46.516163  1174 raft_consensus.cc:359] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.516810  1174 raft_consensus.cc:740] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.517515  1174 consensus_queue.cc:260] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.542836  1174 ts_tablet_manager.cc:1434] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.029s	user 0.018s	sys 0.004s
I20260709 13:12:46.543926  1174 tablet_bootstrap.cc:492] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:46.555159  1137 raft_consensus.cc:493] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.555718  1137 raft_consensus.cc:515] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.558377   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601d16b32f7947f899a17d9b9c4b1152" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:46.559749  1156 raft_consensus.cc:493] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.560266  1156 raft_consensus.cc:515] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.562250  1156 leader_election.cc:290] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.566249   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55312d46dd4747c0bacb0d980ca208b1" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:46.566893  1137 leader_election.cc:290] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.566989   490 raft_consensus.cc:2468] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:46.568265   528 leader_election.cc:304] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
W20260709 13:12:46.566701   456 leader_election.cc:336] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.569525   456 leader_election.cc:304] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141
I20260709 13:12:46.570706  1137 raft_consensus.cc:2749] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:46.572359   530 leader_election.cc:336] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.572901  1156 raft_consensus.cc:2804] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:46.573529  1156 raft_consensus.cc:493] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.573974  1156 raft_consensus.cc:3060] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.581667  1156 raft_consensus.cc:515] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.584173  1156 leader_election.cc:290] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.585076   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55312d46dd4747c0bacb0d980ca208b1" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:46.585762   490 raft_consensus.cc:3060] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.590864  1174 tablet_bootstrap.cc:492] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:46.592036  1174 tablet_bootstrap.cc:492] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:46.592823  1174 ts_tablet_manager.cc:1403] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.016s
I20260709 13:12:46.596024  1174 raft_consensus.cc:359] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.596880  1174 raft_consensus.cc:740] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.597783  1174 consensus_queue.cc:260] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.600383  1174 ts_tablet_manager.cc:1434] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:12:46.601394  1174 tablet_bootstrap.cc:492] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:46.603936   530 leader_election.cc:336] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.605192   490 raft_consensus.cc:2468] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
I20260709 13:12:46.610348  1137 raft_consensus.cc:493] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.611092  1142 raft_consensus.cc:493] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.610898  1137 raft_consensus.cc:515] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:46.611590  1142 raft_consensus.cc:515] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.606462   528 leader_election.cc:304] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:46.616909  1175 raft_consensus.cc:493] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.618019   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc6d1809c204b7c8dbca7216cfc3121" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:46.617417  1175 raft_consensus.cc:515] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:46.620893  1175 leader_election.cc:290] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:46.621377  1175 raft_consensus.cc:2804] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:46.623481   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:46.623746  1171 raft_consensus.cc:493] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.624213  1171 raft_consensus.cc:515] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:46.626358  1171 leader_election.cc:290] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
W20260709 13:12:46.627979   456 leader_election.cc:336] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.627857   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd9ae6a2eb4b90be3ad7a183c00b8a" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:46.630479  1137 leader_election.cc:290] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:46.632440   720 raft_consensus.cc:493] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.632995   720 raft_consensus.cc:515] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:46.635068   720 leader_election.cc:290] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.635560  1142 leader_election.cc:290] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.636930   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:46.639595   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d997035dbd4e7d88a1f947b2f915bb" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:46.647766  1175 raft_consensus.cc:697] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:46.645210   456 leader_election.cc:304] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:46.649986  1069 raft_consensus.cc:2749] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:46.652275   530 leader_election.cc:336] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.652781   530 leader_election.cc:304] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:46.648689  1175 consensus_queue.cc:237] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.658867  1138 raft_consensus.cc:2749] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:46.660808   381 leader_election.cc:336] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.661393   381 leader_election.cc:304] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:46.662329   720 raft_consensus.cc:2749] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:46.663653  1174 tablet_bootstrap.cc:492] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:46.667491   381 leader_election.cc:336] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.669620   381 leader_election.cc:304] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141
W20260709 13:12:46.670704   381 leader_election.cc:336] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.671209   381 leader_election.cc:304] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141
I20260709 13:12:46.672583  1174 tablet_bootstrap.cc:492] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:46.673485  1174 ts_tablet_manager.cc:1403] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.072s	user 0.029s	sys 0.031s
I20260709 13:12:46.671356  1171 raft_consensus.cc:2749] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:46.676569  1174 raft_consensus.cc:359] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.677414  1174 raft_consensus.cc:740] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.678315  1174 consensus_queue.cc:260] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.679466   720 raft_consensus.cc:2749] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:46.685438  1174 ts_tablet_manager.cc:1434] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:12:46.687592  1174 tablet_bootstrap.cc:492] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:46.692202  1148 raft_consensus.cc:493] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.692886  1148 raft_consensus.cc:515] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:46.697234  1148 leader_election.cc:290] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:46.706123   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0cb63fe6b54741b53e72257d8eea82" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
W20260709 13:12:46.715914   530 leader_election.cc:336] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.718189   530 leader_election.cc:304] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:46.719924  1156 raft_consensus.cc:2749] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:46.720639  1137 raft_consensus.cc:493] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.721491  1137 raft_consensus.cc:515] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.727140  1148 raft_consensus.cc:493] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.727816  1148 raft_consensus.cc:515] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.730844  1148 leader_election.cc:290] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.733412   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601d16b32f7947f899a17d9b9c4b1152" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:46.734198   490 raft_consensus.cc:2468] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:46.735226 32704 catalog_manager.cc:5697] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 2 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.740118   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c071a99756034ba58ef554450a637513" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:46.740279   528 leader_election.cc:304] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:46.740861   561 raft_consensus.cc:2468] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
W20260709 13:12:46.741195   530 leader_election.cc:336] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.742683  1148 raft_consensus.cc:2804] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:46.743146  1148 raft_consensus.cc:493] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.743571  1148 raft_consensus.cc:3060] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.751796  1142 raft_consensus.cc:493] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.752478  1142 raft_consensus.cc:515] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:46.763332   457 leader_election.cc:304] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:46.764554  1069 raft_consensus.cc:2804] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:46.765262  1069 raft_consensus.cc:493] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.765983  1069 raft_consensus.cc:3060] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.766775  1137 leader_election.cc:290] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.753943  1148 raft_consensus.cc:515] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.773895   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e165c0d45844da9b680b461c2b5493" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:46.781147   720 raft_consensus.cc:493] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.781883   720 raft_consensus.cc:515] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:46.781690  1069 raft_consensus.cc:515] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.787017   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c071a99756034ba58ef554450a637513" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:46.787766   561 raft_consensus.cc:3060] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.788836   720 leader_election.cc:290] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
W20260709 13:12:46.790254   381 leader_election.cc:336] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.790741   381 leader_election.cc:304] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141
I20260709 13:12:46.792074  1171 raft_consensus.cc:2749] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:46.796079   381 leader_election.cc:336] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.774905  1142 leader_election.cc:290] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.803339  1069 leader_election.cc:290] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.805505   561 raft_consensus.cc:2468] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 2.
I20260709 13:12:46.807374   457 leader_election.cc:304] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:46.808382  1069 raft_consensus.cc:2804] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:46.808939  1069 raft_consensus.cc:697] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:46.815925  1069 consensus_queue.cc:237] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.818713   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601d16b32f7947f899a17d9b9c4b1152" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:46.819419   490 raft_consensus.cc:3060] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:46.820326   456 leader_election.cc:336] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
W20260709 13:12:46.825915   456 leader_election.cc:336] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.827376  1174 tablet_bootstrap.cc:492] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:46.827425   720 raft_consensus.cc:493] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.828128   720 raft_consensus.cc:515] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:46.828574  1174 tablet_bootstrap.cc:492] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:46.829301  1174 ts_tablet_manager.cc:1403] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.142s	user 0.033s	sys 0.019s
I20260709 13:12:46.830101   720 leader_election.cc:290] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.830916   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:46.831494   563 raft_consensus.cc:2468] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:46.834311   490 raft_consensus.cc:2468] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
I20260709 13:12:46.836604   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:46.837227   490 raft_consensus.cc:2468] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:46.835439   528 leader_election.cc:304] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:46.832821   382 leader_election.cc:304] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:46.829944  1142 raft_consensus.cc:493] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.844360   379 leader_election.cc:304] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:46.846969  1138 raft_consensus.cc:2804] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:46.846086  1142 raft_consensus.cc:515] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:46.851886  1142 leader_election.cc:290] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:46.852448  1138 raft_consensus.cc:697] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:46.846268  1148 leader_election.cc:290] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.853216  1138 consensus_queue.cc:237] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.854780  1184 raft_consensus.cc:2804] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:46.855322  1184 raft_consensus.cc:493] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.855669  1184 raft_consensus.cc:3060] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.840629  1175 raft_consensus.cc:493] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.846004  1168 raft_consensus.cc:2804] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:46.846539  1153 raft_consensus.cc:493] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.845391  1171 raft_consensus.cc:493] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.857666  1168 raft_consensus.cc:493] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.858374  1168 raft_consensus.cc:3060] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.858117  1171 raft_consensus.cc:515] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:46.861140  1171 leader_election.cc:290] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.861735  1153 raft_consensus.cc:515] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:46.861982  1175 raft_consensus.cc:515] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:46.864006  1153 leader_election.cc:290] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:46.864486  1175 leader_election.cc:290] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:46.868520   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd9ae6a2eb4b90be3ad7a183c00b8a" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:46.869235   415 raft_consensus.cc:2468] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
W20260709 13:12:46.870484   456 leader_election.cc:336] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.871454   456 leader_election.cc:304] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:46.872855  1153 raft_consensus.cc:2804] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:46.872941   381 leader_election.cc:336] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.873373  1153 raft_consensus.cc:493] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
W20260709 13:12:46.874346   381 leader_election.cc:336] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
W20260709 13:12:46.874855   381 leader_election.cc:336] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.873922  1153 raft_consensus.cc:3060] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.877230  1174 raft_consensus.cc:359] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:46.880122  1174 raft_consensus.cc:740] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.881206  1174 consensus_queue.cc:260] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:46.885257  1185 raft_consensus.cc:493] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.886088  1185 raft_consensus.cc:515] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:46.889056  1185 leader_election.cc:290] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:46.892434  1153 raft_consensus.cc:515] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:46.894161  1168 raft_consensus.cc:515] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:46.895890   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:46.896771   415 raft_consensus.cc:2468] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:46.897318  1168 leader_election.cc:290] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
W20260709 13:12:46.897908   456 leader_election.cc:336] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:46.899024   456 leader_election.cc:304] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:46.899742   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:46.900445   490 raft_consensus.cc:2468] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:46.902601  1174 ts_tablet_manager.cc:1434] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.073s	user 0.010s	sys 0.000s
I20260709 13:12:46.903753  1174 tablet_bootstrap.cc:492] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:46.922293  1137 raft_consensus.cc:493] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:46.922869  1137 raft_consensus.cc:515] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:46.924865  1137 leader_election.cc:290] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:46.927672  1184 raft_consensus.cc:515] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:46.929131   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f70da72b449609b0b4f28f6589ab3" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:46.930011   563 raft_consensus.cc:2468] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 1.
I20260709 13:12:46.932170   457 leader_election.cc:304] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:46.932631   379 leader_election.cc:304] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:46.947876  1184 leader_election.cc:290] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
W20260709 13:12:46.965306   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:35023, user_credentials={real_user=slave}} blocked reactor thread for 123058us
W20260709 13:12:46.964705   528 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:39781, user_credentials={real_user=slave}} blocked reactor thread for 129324us
W20260709 13:12:46.997433   379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:39781, user_credentials={real_user=slave}} blocked reactor thread for 62829.1us
I20260709 13:12:46.937891  1185 raft_consensus.cc:2804] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:47.005688   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d997035dbd4e7d88a1f947b2f915bb" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:46.944115  1168 raft_consensus.cc:2804] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:47.007853   415 raft_consensus.cc:2468] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:47.009845   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0cb63fe6b54741b53e72257d8eea82" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:47.010778   563 raft_consensus.cc:2468] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:47.004231  1190 raft_consensus.cc:2804] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:47.023378   720 raft_consensus.cc:493] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:47.024282   720 raft_consensus.cc:515] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.007500  1185 raft_consensus.cc:493] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:47.028520   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
W20260709 13:12:47.035197   457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 103150us
I20260709 13:12:47.035777   488 raft_consensus.cc:3060] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.033921   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:47.037914   563 raft_consensus.cc:3060] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.011693  1138 raft_consensus.cc:493] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:47.040587   720 leader_election.cc:290] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:47.026952  1190 raft_consensus.cc:493] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:47.047024  1190 raft_consensus.cc:3060] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.008795  1168 raft_consensus.cc:493] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:47.050755  1174 tablet_bootstrap.cc:492] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:47.050318   488 raft_consensus.cc:2468] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 2.
I20260709 13:12:47.078478  1153 leader_election.cc:290] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:47.046482  1138 raft_consensus.cc:515] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.036738  1185 raft_consensus.cc:3060] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.028113  1187 raft_consensus.cc:493] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70c1750ca53a445883b66469ea339141)
W20260709 13:12:47.111153   381 leader_election.cc:336] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.105347   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77cacfdc1e943a6ae75838391278350" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:47.112273   561 raft_consensus.cc:2468] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 1.
I20260709 13:12:47.108419   563 raft_consensus.cc:2468] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 2.
W20260709 13:12:47.111691   381 leader_election.cc:336] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.059612  1168 raft_consensus.cc:3060] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.110844   382 leader_election.cc:304] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:47.114109 32706 catalog_manager.cc:5697] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.132128  1174 tablet_bootstrap.cc:492] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:47.133188  1174 ts_tablet_manager.cc:1403] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.230s	user 0.023s	sys 0.016s
I20260709 13:12:47.133754   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bcd9ae6a2eb4b90be3ad7a183c00b8a" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:47.134302   416 raft_consensus.cc:3060] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.135833   379 leader_election.cc:304] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:47.118716  1138 leader_election.cc:290] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:47.141896 25395 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:12:47.149515 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.683s	user 0.310s	sys 0.005s
I20260709 13:12:47.192058   416 raft_consensus.cc:2468] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 2.
I20260709 13:12:47.192761  1207 raft_consensus.cc:2804] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.138566  1196 raft_consensus.cc:2804] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:47.193346  1207 raft_consensus.cc:697] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:47.119460  1187 raft_consensus.cc:515] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
W20260709 13:12:47.213654   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 86591.5us
W20260709 13:12:47.219987   381 leader_election.cc:336] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
W20260709 13:12:47.218432   456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:35023, user_credentials={real_user=slave}} blocked reactor thread for 84609.2us
I20260709 13:12:47.223171   530 leader_election.cc:304] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:47.225066   456 leader_election.cc:304] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
W20260709 13:12:47.226150   382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 90194.4us
I20260709 13:12:47.196399  1196 raft_consensus.cc:493] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:47.244652  1174 raft_consensus.cc:359] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.248378  1190 raft_consensus.cc:515] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
W20260709 13:12:47.252009   456 leader_election.cc:336] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.252805  1187 leader_election.cc:290] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:47.254385  1207 consensus_queue.cc:237] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:47.257185   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f70da72b449609b0b4f28f6589ab3" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:47.257846   563 raft_consensus.cc:3060] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.231141  1138 raft_consensus.cc:2804] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:47.263409  1138 raft_consensus.cc:493] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:47.263780  1138 raft_consensus.cc:3060] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:47.267241   530 leader_election.cc:336] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.268654  1190 leader_election.cc:290] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:47.269359   563 raft_consensus.cc:2468] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c547e4ecc9ae4f03a72252a7d8049f98 in term 2.
I20260709 13:12:47.270506   457 leader_election.cc:304] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:47.271308  1190 raft_consensus.cc:2804] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.271783  1190 raft_consensus.cc:697] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:47.272094   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e165c0d45844da9b680b461c2b5493" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
W20260709 13:12:47.268078   530 leader_election.cc:336] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.272682  1190 consensus_queue.cc:237] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:47.238425  1196 raft_consensus.cc:3060] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.273304   416 raft_consensus.cc:2468] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:47.285230   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc6d1809c204b7c8dbca7216cfc3121" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:47.245448  1174 raft_consensus.cc:740] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.288424  1174 consensus_queue.cc:260] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.290475  1174 ts_tablet_manager.cc:1434] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.157s	user 0.006s	sys 0.000s
I20260709 13:12:47.291249  1174 tablet_bootstrap.cc:492] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:47.291777   490 raft_consensus.cc:1275] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:47.292531   382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 65320.2us
I20260709 13:12:47.285881   415 raft_consensus.cc:2468] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 1.
I20260709 13:12:47.293787   382 leader_election.cc:304] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:47.297485  1192 raft_consensus.cc:2804] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.300653  1148 consensus_queue.cc:1048] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:47.306835   530 leader_election.cc:336] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.306965  1196 raft_consensus.cc:515] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
W20260709 13:12:47.307385   530 consensus_peers.cc:597] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:47.307979   530 leader_election.cc:336] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.310333  1192 raft_consensus.cc:697] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 LEADER]: Becoming Leader. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:47.311029  1185 raft_consensus.cc:515] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:47.311296  1192 consensus_queue.cc:237] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:47.311977   530 leader_election.cc:304] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141
W20260709 13:12:47.312119   456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 59095.2us
I20260709 13:12:47.313151   530 leader_election.cc:304] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:47.314877  1188 raft_consensus.cc:2804] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:47.315264  1188 raft_consensus.cc:493] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:47.315606  1188 raft_consensus.cc:3060] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.315948   382 leader_election.cc:304] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:47.316561   720 raft_consensus.cc:2804] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:47.316943   720 raft_consensus.cc:493] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:47.317394   720 raft_consensus.cc:3060] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.321362  1191 raft_consensus.cc:2804] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.322530  1191 raft_consensus.cc:697] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:47.323817  1191 consensus_queue.cc:237] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
W20260709 13:12:47.325600   530 consensus_peers.cc:597] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.313211  1185 leader_election.cc:290] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:47.313733  1148 raft_consensus.cc:2804] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:47.326359  1148 raft_consensus.cc:493] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70c1750ca53a445883b66469ea339141)
I20260709 13:12:47.326783  1148 raft_consensus.cc:3060] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.310945 32706 catalog_manager.cc:5697] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 2 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.328855  1168 raft_consensus.cc:515] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:47.308578 32704 catalog_manager.cc:5697] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.344653   720 raft_consensus.cc:515] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.349758   411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:47.365298   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77cacfdc1e943a6ae75838391278350" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
W20260709 13:12:47.365885   456 leader_election.cc:336] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.366185   564 raft_consensus.cc:3060] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.366930   720 leader_election.cc:290] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:47.371659   411 raft_consensus.cc:2393] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c547e4ecc9ae4f03a72252a7d8049f98 in current term 2: Already voted for candidate 7b79bd4dca614b218791c5293a51c7a9 in this term.
I20260709 13:12:47.381050  1168 leader_election.cc:290] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:47.382869   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:47.383664   488 raft_consensus.cc:2393] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b79bd4dca614b218791c5293a51c7a9 in current term 2: Already voted for candidate c547e4ecc9ae4f03a72252a7d8049f98 in this term.
W20260709 13:12:47.384841   381 leader_election.cc:336] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.387542  1188 raft_consensus.cc:515] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
W20260709 13:12:47.388147   381 leader_election.cc:336] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.389178   379 leader_election.cc:304] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:47.394924  1184 raft_consensus.cc:2749] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:47.395085   411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc6d1809c204b7c8dbca7216cfc3121" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:47.387956   561 raft_consensus.cc:1275] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer c547e4ecc9ae4f03a72252a7d8049f98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.390995  1196 leader_election.cc:290] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:47.392633   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0cb63fe6b54741b53e72257d8eea82" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:47.396358   563 raft_consensus.cc:3060] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.395807   411 raft_consensus.cc:3060] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.402299  1193 consensus_queue.cc:1048] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:47.405038   381 leader_election.cc:336] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.410115   564 raft_consensus.cc:2468] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 2.
I20260709 13:12:47.411839   382 leader_election.cc:304] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:47.414192   563 raft_consensus.cc:2468] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 2.
I20260709 13:12:47.416934  1171 raft_consensus.cc:2804] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.417603  1171 raft_consensus.cc:697] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:47.418807  1171 consensus_queue.cc:237] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.419663   411 raft_consensus.cc:2468] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
W20260709 13:12:47.436685   456 leader_election.cc:336] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
W20260709 13:12:47.437855   456 leader_election.cc:336] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.438359   456 leader_election.cc:304] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:47.446053  1185 raft_consensus.cc:2749] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:47.377725  1138 raft_consensus.cc:515] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.446753   382 leader_election.cc:304] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:47.448225  1138 leader_election.cc:290] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:47.448228   720 raft_consensus.cc:2804] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.449262   720 raft_consensus.cc:697] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:47.450141   720 consensus_queue.cc:237] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.443097   530 leader_election.cc:304] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:47.458633   411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55d997035dbd4e7d88a1f947b2f915bb" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:47.459515   411 raft_consensus.cc:3060] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:47.460145   381 consensus_peers.cc:597] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:47.460991  1138 raft_consensus.cc:2804] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.435002  1188 leader_election.cc:290] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:47.461540  1138 raft_consensus.cc:697] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:47.462527  1138 consensus_queue.cc:237] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:47.439299  1148 raft_consensus.cc:515] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
W20260709 13:12:47.476145   456 consensus_peers.cc:597] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:47.477629   530 leader_election.cc:336] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
W20260709 13:12:47.478684   530 leader_election.cc:336] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.468163 32706 catalog_manager.cc:5697] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.486022   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e165c0d45844da9b680b461c2b5493" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:47.486639   415 raft_consensus.cc:3060] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.476929  1148 leader_election.cc:290] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:47.507638   415 raft_consensus.cc:2468] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
I20260709 13:12:47.516296   530 leader_election.cc:304] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:47.521759   490 raft_consensus.cc:1275] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.535672 32703 catalog_manager.cc:5697] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.541651   411 raft_consensus.cc:2468] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
I20260709 13:12:47.542646  1138 raft_consensus.cc:2804] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.542480  1187 consensus_queue.cc:1048] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:47.543383  1138 raft_consensus.cc:697] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:47.544304  1138 consensus_queue.cc:237] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.558853   530 leader_election.cc:304] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:47.561118  1187 raft_consensus.cc:2804] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.561295 32704 catalog_manager.cc:5697] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 2 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.562181  1187 raft_consensus.cc:697] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:12:47.564041  1187 consensus_queue.cc:237] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
W20260709 13:12:47.561638   530 leader_election.cc:336] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111)
I20260709 13:12:47.566088 32706 catalog_manager.cc:5697] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.568499 32706 catalog_manager.cc:5697] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.570297 32706 catalog_manager.cc:5697] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.624377 32704 catalog_manager.cc:5697] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 2 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.637858 32704 catalog_manager.cc:5697] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 1 to 2, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 2 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:47.664480   456 consensus_peers.cc:597] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:47.672657  1177 raft_consensus.cc:493] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.673310  1177 raft_consensus.cc:515] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:47.678730  1177 leader_election.cc:290] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:47.697062  1174 tablet_bootstrap.cc:492] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:47.703032  1174 tablet_bootstrap.cc:492] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:47.703927   490 raft_consensus.cc:1275] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 7b79bd4dca614b218791c5293a51c7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.704945  1174 ts_tablet_manager.cc:1403] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.414s	user 0.020s	sys 0.000s
I20260709 13:12:47.710592   720 consensus_queue.cc:1048] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:47.707784  1174 raft_consensus.cc:359] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:47.711627  1174 raft_consensus.cc:740] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.713677  1174 consensus_queue.cc:260] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:47.717334  1174 ts_tablet_manager.cc:1434] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:12:47.723333  1174 tablet_bootstrap.cc:492] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:47.731441   561 raft_consensus.cc:1275] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer c547e4ecc9ae4f03a72252a7d8049f98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:47.732470   456 consensus_peers.cc:597] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.733124  1190 consensus_queue.cc:1048] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:47.740335   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:47.750792   530 consensus_peers.cc:597] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:47.755004  1174 tablet_bootstrap.cc:492] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:47.756045  1174 tablet_bootstrap.cc:492] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:47.756815  1174 ts_tablet_manager.cc:1403] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.006s
I20260709 13:12:47.759505  1174 raft_consensus.cc:359] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.760421  1174 raft_consensus.cc:740] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
W20260709 13:12:47.748093   456 consensus_peers.cc:597] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:47.812476   456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 64214.6us
I20260709 13:12:47.844024   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:47.856688  1170 leader_election.cc:304] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
W20260709 13:12:47.857904   381 consensus_peers.cc:597] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.761109  1174 consensus_queue.cc:260] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:47.864161  1177 raft_consensus.cc:493] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.883155  1177 raft_consensus.cc:515] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:47.895810  1177 leader_election.cc:290] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:47.896610  1177 raft_consensus.cc:2749] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:47.905531   564 raft_consensus.cc:1275] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer 7b79bd4dca614b218791c5293a51c7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.906690   563 raft_consensus.cc:1275] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer 7b79bd4dca614b218791c5293a51c7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.921450   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:47.930541   456 consensus_peers.cc:597] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.943646  1206 consensus_queue.cc:1048] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:47.948040  1205 consensus_queue.cc:1048] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:47.954784   416 raft_consensus.cc:1275] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:47.961232   530 consensus_peers.cc:597] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:47.964303  1170 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 108233us
I20260709 13:12:47.966776   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:47.968992  1170 leader_election.cc:304] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:47.970969  1243 raft_consensus.cc:2749] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:47.971805   456 consensus_peers.cc:597] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:47.990689   416 raft_consensus.cc:1275] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer c547e4ecc9ae4f03a72252a7d8049f98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:47.999490   456 consensus_peers.cc:597] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.009958  1174 ts_tablet_manager.cc:1434] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.253s	user 0.020s	sys 0.018s
W20260709 13:12:48.010340   381 consensus_peers.cc:597] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.010934   381 consensus_peers.cc:597] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:48.011741  1174 tablet_bootstrap.cc:492] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:48.020539  1188 consensus_queue.cc:1048] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:12:48.039587   560 raft_consensus.cc:1275] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer 7b79bd4dca614b218791c5293a51c7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:48.043543   530 consensus_peers.cc:597] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:48.079505   381 consensus_peers.cc:597] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.080883  1209 consensus_queue.cc:1048] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:48.086180  1200 consensus_queue.cc:1048] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:48.090847   381 consensus_peers.cc:597] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.092062   381 consensus_peers.cc:597] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.098726   381 consensus_peers.cc:597] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:48.099330   381 consensus_peers.cc:597] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.102617   530 consensus_peers.cc:597] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.110507   412 raft_consensus.cc:1275] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:48.128257   456 consensus_peers.cc:597] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.133869   530 consensus_peers.cc:597] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.116156  1242 raft_consensus.cc:493] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.135147  1242 raft_consensus.cc:515] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
W20260709 13:12:48.126009   381 consensus_peers.cc:597] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.138165   381 consensus_peers.cc:597] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.138702   381 consensus_peers.cc:597] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.157985   381 consensus_peers.cc:597] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:48.159973   381 consensus_peers.cc:597] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.185298  1243 raft_consensus.cc:493] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.186968  1243 raft_consensus.cc:515] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:48.191506  1242 leader_election.cc:290] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
W20260709 13:12:48.195570   456 consensus_peers.cc:597] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.205828  1243 leader_election.cc:290] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
W20260709 13:12:48.232220   530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:35023, user_credentials={real_user=slave}} blocked reactor thread for 53036.8us
I20260709 13:12:48.234877  1188 consensus_queue.cc:1048] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:48.246919   416 raft_consensus.cc:1275] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:48.253720   381 consensus_peers.cc:597] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.259100   381 consensus_peers.cc:597] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.281885   558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7fe5c08e134e6297971768dca0caa0" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:48.289867  1258 consensus_queue.cc:1048] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:48.313066   530 consensus_peers.cc:597] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:48.319615   530 consensus_peers.cc:597] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.321357   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ce075819b848f9849ae714b57964f7" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
W20260709 13:12:48.324565   456 consensus_peers.cc:597] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.326980   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b7fe5c08e134e6297971768dca0caa0" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:48.350440  1174 tablet_bootstrap.cc:492] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:48.351646  1174 tablet_bootstrap.cc:492] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:48.352383  1174 ts_tablet_manager.cc:1403] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.341s	user 0.038s	sys 0.028s
I20260709 13:12:48.361389  1166 leader_election.cc:304] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:48.364307  1243 raft_consensus.cc:2749] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:48.373095   381 consensus_peers.cc:597] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.367354  1174 raft_consensus.cc:359] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:48.375236  1174 raft_consensus.cc:740] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
W20260709 13:12:48.374832   456 consensus_peers.cc:597] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.385650  1174 consensus_queue.cc:260] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:48.394030  1174 ts_tablet_manager.cc:1434] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.004s
I20260709 13:12:48.395148  1174 tablet_bootstrap.cc:492] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:48.416319   381 consensus_peers.cc:597] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.430920   456 consensus_peers.cc:597] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.431706   456 consensus_peers.cc:597] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.446615   381 consensus_peers.cc:597] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.447149   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ce075819b848f9849ae714b57964f7" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:48.450783  1169 leader_election.cc:304] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:48.452039  1243 raft_consensus.cc:2749] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.476815  1174 tablet_bootstrap.cc:492] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:48.478124  1174 tablet_bootstrap.cc:492] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:48.478909  1174 ts_tablet_manager.cc:1403] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.022s
I20260709 13:12:48.482218  1174 raft_consensus.cc:359] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:48.483327  1174 raft_consensus.cc:740] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.484732  1174 consensus_queue.cc:260] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:48.488171  1174 ts_tablet_manager.cc:1434] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:48.489495  1174 tablet_bootstrap.cc:492] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:48.525339  1174 tablet_bootstrap.cc:492] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:48.527364  1174 tablet_bootstrap.cc:492] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
W20260709 13:12:48.527853   381 consensus_peers.cc:597] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.528163  1174 ts_tablet_manager.cc:1403] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.005s
I20260709 13:12:48.531575  1174 raft_consensus.cc:359] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:48.532472  1174 raft_consensus.cc:740] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.533444  1174 consensus_queue.cc:260] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:48.536038  1174 ts_tablet_manager.cc:1434] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:48.537298  1174 tablet_bootstrap.cc:492] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:48.547245   381 consensus_peers.cc:597] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.554399   456 consensus_peers.cc:597] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:48.577284  1174 tablet_bootstrap.cc:492] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:48.578651  1174 tablet_bootstrap.cc:492] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:48.579547  1174 ts_tablet_manager.cc:1403] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.007s
I20260709 13:12:48.583374  1174 raft_consensus.cc:359] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:48.584271  1174 raft_consensus.cc:740] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.585927  1174 consensus_queue.cc:260] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:48.588320  1174 ts_tablet_manager.cc:1434] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:48.589550  1174 tablet_bootstrap.cc:492] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:48.718279  1174 tablet_bootstrap.cc:492] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:48.719363  1174 tablet_bootstrap.cc:492] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:48.720216  1174 ts_tablet_manager.cc:1403] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.131s	user 0.055s	sys 0.054s
I20260709 13:12:48.723992  1174 raft_consensus.cc:359] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:48.724674  1174 raft_consensus.cc:740] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.725442  1174 consensus_queue.cc:260] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:48.729117  1174 ts_tablet_manager.cc:1434] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:48.732321  1174 tablet_bootstrap.cc:492] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:48.785027  1174 tablet_bootstrap.cc:492] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:48.786288  1174 tablet_bootstrap.cc:492] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:48.787184  1174 ts_tablet_manager.cc:1403] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.018s
I20260709 13:12:48.790952  1174 raft_consensus.cc:359] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:48.791941  1174 raft_consensus.cc:740] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.793071  1174 consensus_queue.cc:260] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:48.796309  1174 ts_tablet_manager.cc:1434] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:48.797713  1174 tablet_bootstrap.cc:492] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:48.844204  1174 tablet_bootstrap.cc:492] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:48.845281  1174 tablet_bootstrap.cc:492] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:48.845980  1174 ts_tablet_manager.cc:1403] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.011s
I20260709 13:12:48.848534 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.193:40765
I20260709 13:12:48.848537  1310 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.193:40765 every 8 connection(s)
I20260709 13:12:48.848863  1174 raft_consensus.cc:359] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:48.850103  1174 raft_consensus.cc:740] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.851099  1174 consensus_queue.cc:260] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:48.854034  1174 ts_tablet_manager.cc:1434] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:48.855243  1174 tablet_bootstrap.cc:492] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:48.863281  1243 raft_consensus.cc:493] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.864005  1243 raft_consensus.cc:515] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:48.867192  1243 leader_election.cc:290] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:48.871809   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:48.873354   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:48.875066  1170 leader_election.cc:304] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, c547e4ecc9ae4f03a72252a7d8049f98
I20260709 13:12:48.875918  1243 raft_consensus.cc:2749] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.908950  1174 tablet_bootstrap.cc:492] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:48.911051  1313 heartbeater.cc:344] Connected to a master server at 127.24.204.254:46115
I20260709 13:12:48.911293  1174 tablet_bootstrap.cc:492] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:48.911654  1313 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:48.912711  1313 heartbeater.cc:507] Master 127.24.204.254:46115 requested a full tablet report, sending...
I20260709 13:12:48.912871  1174 ts_tablet_manager.cc:1403] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.006s
I20260709 13:12:48.916672  1174 raft_consensus.cc:359] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:48.917454  1174 raft_consensus.cc:740] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.918251  1174 consensus_queue.cc:260] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:48.920563  1174 ts_tablet_manager.cc:1434] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:12:48.921486  1174 tablet_bootstrap.cc:492] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:48.935847  1283 raft_consensus.cc:3060] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.954079  1174 tablet_bootstrap.cc:492] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:48.958669  1174 tablet_bootstrap.cc:492] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:48.959792  1174 ts_tablet_manager.cc:1403] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.005s
I20260709 13:12:48.962862  1174 raft_consensus.cc:359] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:48.963959  1174 raft_consensus.cc:740] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.964830  1174 consensus_queue.cc:260] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:48.978156  1174 ts_tablet_manager.cc:1434] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:48.979261  1243 raft_consensus.cc:493] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7b79bd4dca614b218791c5293a51c7a9)
I20260709 13:12:48.979895  1243 raft_consensus.cc:515] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:48.990121   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:48.991962  1174 tablet_bootstrap.cc:492] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:48.996953 32707 ts_manager.cc:194] Re-registered known tserver with Master: 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765)
I20260709 13:12:49.008795  1205 raft_consensus.cc:493] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.009479  1205 raft_consensus.cc:515] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.011981  1205 leader_election.cc:290] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:49.013159  1283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141" is_pre_election: true
I20260709 13:12:49.026556  1174 tablet_bootstrap.cc:492] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.026592   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" is_pre_election: true
I20260709 13:12:49.028033  1174 tablet_bootstrap.cc:492] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:49.028153   490 raft_consensus.cc:2468] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 2.
I20260709 13:12:49.028895  1174 ts_tablet_manager.cc:1403] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.005s
I20260709 13:12:49.032883  1174 raft_consensus.cc:359] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:49.033718  1174 raft_consensus.cc:740] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
W20260709 13:12:49.040853   381 leader_election.cc:343] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.041925   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee683cad470a4e5389da6f91a92664a4" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:49.044684  1169 leader_election.cc:304] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:49.045687  1318 raft_consensus.cc:2749] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:49.047950  1243 leader_election.cc:290] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:49.053656   379 leader_election.cc:304] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:49.053516  1174 consensus_queue.cc:260] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:49.055096  1184 raft_consensus.cc:2804] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:49.055529  1184 raft_consensus.cc:493] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.055877  1184 raft_consensus.cc:3060] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:49.057551  1174 ts_tablet_manager.cc:1434] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:12:49.058535  1174 tablet_bootstrap.cc:492] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:49.076839  1243 raft_consensus.cc:493] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.077459  1243 raft_consensus.cc:515] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:49.085338 32707 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42562
I20260709 13:12:49.085526   415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72cfaa775c3b4fb2a7756d6042ab17b9" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b79bd4dca614b218791c5293a51c7a9" is_pre_election: true
I20260709 13:12:49.086344  1243 leader_election.cc:290] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:49.089655   560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72cfaa775c3b4fb2a7756d6042ab17b9" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" is_pre_election: true
I20260709 13:12:49.091431  1170 leader_election.cc:304] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70c1750ca53a445883b66469ea339141; no voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9
I20260709 13:12:49.093400  1243 raft_consensus.cc:2749] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:49.105727  1174 tablet_bootstrap.cc:492] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.106962  1174 tablet_bootstrap.cc:492] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:49.107628  1174 ts_tablet_manager.cc:1403] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.005s
I20260709 13:12:49.093881  1313 heartbeater.cc:499] Master 127.24.204.254:46115 was elected leader, sending a full tablet report...
I20260709 13:12:49.119400  1184 raft_consensus.cc:515] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.130401  1174 raft_consensus.cc:359] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.131484  1174 raft_consensus.cc:740] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.132345  1174 consensus_queue.cc:260] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.134613  1174 ts_tablet_manager.cc:1434] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:12:49.135582  1174 tablet_bootstrap.cc:492] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:49.136133   490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:49.136869   490 raft_consensus.cc:3060] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:49.141294  1279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30b99a7946e406280df3352194e0545" candidate_uuid: "7b79bd4dca614b218791c5293a51c7a9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70c1750ca53a445883b66469ea339141"
W20260709 13:12:49.143716   381 leader_election.cc:343] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.145676  1279 raft_consensus.cc:3060] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.170346  1174 tablet_bootstrap.cc:492] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.171458  1174 tablet_bootstrap.cc:492] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:49.172147  1174 ts_tablet_manager.cc:1403] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.012s
I20260709 13:12:49.173684  1184 leader_election.cc:290] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 3 election: Requested vote from peers 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:49.175262  1174 raft_consensus.cc:359] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:49.176023  1174 raft_consensus.cc:740] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.176862  1174 consensus_queue.cc:260] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:49.179056  1174 ts_tablet_manager.cc:1434] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:49.179979  1174 tablet_bootstrap.cc:492] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:49.179095   490 raft_consensus.cc:2468] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b79bd4dca614b218791c5293a51c7a9 in term 3.
I20260709 13:12:49.182159   379 leader_election.cc:304] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b79bd4dca614b218791c5293a51c7a9, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 70c1750ca53a445883b66469ea339141
I20260709 13:12:49.184021  1184 raft_consensus.cc:2804] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:49.186776  1184 raft_consensus.cc:697] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 LEADER]: Becoming Leader. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:49.213090  1184 consensus_queue.cc:237] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.225746  1174 tablet_bootstrap.cc:492] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.227419  1174 tablet_bootstrap.cc:492] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:49.228365  1174 ts_tablet_manager.cc:1403] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.000s
I20260709 13:12:49.237901  1174 raft_consensus.cc:359] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.238701  1174 raft_consensus.cc:740] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.239566  1174 consensus_queue.cc:260] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.242350  1174 ts_tablet_manager.cc:1434] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:12:49.245676  1174 tablet_bootstrap.cc:492] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:49.263931 32707 catalog_manager.cc:5697] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 reported cstate change: term changed from 1 to 3, leader changed from 70c1750ca53a445883b66469ea339141 (127.24.204.193) to 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194). New cstate: current_term: 3 leader_uuid: "7b79bd4dca614b218791c5293a51c7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.302042  1174 tablet_bootstrap.cc:492] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.303719  1174 tablet_bootstrap.cc:492] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:49.304478  1174 ts_tablet_manager.cc:1403] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.009s
I20260709 13:12:49.307937  1174 raft_consensus.cc:359] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.308899  1174 raft_consensus.cc:740] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.309733  1279 raft_consensus.cc:3060] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.309964  1174 consensus_queue.cc:260] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.319568  1174 ts_tablet_manager.cc:1434] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:12:49.320468  1174 tablet_bootstrap.cc:492] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:49.393987  1174 tablet_bootstrap.cc:492] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.396410  1174 tablet_bootstrap.cc:492] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:49.397373  1174 ts_tablet_manager.cc:1403] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.024s
I20260709 13:12:49.403298  1174 raft_consensus.cc:359] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:49.404053  1174 raft_consensus.cc:740] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.405114  1174 consensus_queue.cc:260] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:49.407413  1174 ts_tablet_manager.cc:1434] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:12:49.408960  1174 tablet_bootstrap.cc:492] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:49.445622  1174 tablet_bootstrap.cc:492] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.448132  1174 tablet_bootstrap.cc:492] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:49.448819  1174 ts_tablet_manager.cc:1403] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.041s	user 0.004s	sys 0.020s
I20260709 13:12:49.451570  1174 raft_consensus.cc:359] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:49.452229  1174 raft_consensus.cc:740] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.452970  1174 consensus_queue.cc:260] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:49.455905  1174 ts_tablet_manager.cc:1434] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:49.460418  1174 tablet_bootstrap.cc:492] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:49.483865  1174 tablet_bootstrap.cc:492] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.484951  1174 tablet_bootstrap.cc:492] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:49.485703  1174 ts_tablet_manager.cc:1403] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 13:12:49.488142  1174 raft_consensus.cc:359] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.488696  1174 raft_consensus.cc:740] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.489367  1174 consensus_queue.cc:260] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:49.495679  1174 ts_tablet_manager.cc:1434] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:49.496645  1174 tablet_bootstrap.cc:492] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:49.522130  1174 tablet_bootstrap.cc:492] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.523115  1174 tablet_bootstrap.cc:492] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:49.523736  1174 ts_tablet_manager.cc:1403] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.003s
I20260709 13:12:49.526335  1174 raft_consensus.cc:359] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:49.527020  1174 raft_consensus.cc:740] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.527757  1174 consensus_queue.cc:260] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:49.530134  1174 ts_tablet_manager.cc:1434] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:12:49.530941  1174 tablet_bootstrap.cc:492] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:49.557350  1279 raft_consensus.cc:3060] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.560196  1174 tablet_bootstrap.cc:492] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.561403  1174 tablet_bootstrap.cc:492] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:49.562201  1174 ts_tablet_manager.cc:1403] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.008s
I20260709 13:12:49.564886  1174 raft_consensus.cc:359] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:49.565593  1174 raft_consensus.cc:740] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.566293  1174 consensus_queue.cc:260] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:49.672575   488 raft_consensus.cc:1275] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Refusing update from remote peer 7b79bd4dca614b218791c5293a51c7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:12:49.672956   530 consensus_peers.cc:597] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.674543  1184 consensus_queue.cc:1048] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:49.790705  1174 ts_tablet_manager.cc:1434] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.228s	user 0.064s	sys 0.113s
I20260709 13:12:49.814025  1174 tablet_bootstrap.cc:492] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:49.934466  1343 log.cc:927] Time spent T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:12:49.956012   381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 154613us
W20260709 13:12:50.011046   382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.196:42975, user_credentials={real_user=slave}} blocked reactor thread for 264808us
W20260709 13:12:50.013296   530 consensus_peers.cc:597] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:50.015859  1282 raft_consensus.cc:3060] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.049707  1279 raft_consensus.cc:3060] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.098603  1279 raft_consensus.cc:1275] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Refusing update from remote peer 7b79bd4dca614b218791c5293a51c7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:50.136284  1174 tablet_bootstrap.cc:492] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.137409  1174 tablet_bootstrap.cc:492] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:50.138085  1174 ts_tablet_manager.cc:1403] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.339s	user 0.007s	sys 0.023s
I20260709 13:12:50.172907  1174 raft_consensus.cc:359] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:50.192093  1174 raft_consensus.cc:740] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.197306  1174 consensus_queue.cc:260] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:50.231014  1174 ts_tablet_manager.cc:1434] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.092s	user 0.004s	sys 0.004s
I20260709 13:12:50.232095  1174 tablet_bootstrap.cc:492] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:50.242292  1369 consensus_queue.cc:1048] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:50.278775  1174 tablet_bootstrap.cc:492] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:50.294317   381 consensus_peers.cc:597] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:50.298689  1174 tablet_bootstrap.cc:492] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:50.300124  1174 ts_tablet_manager.cc:1403] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.068s	user 0.019s	sys 0.011s
I20260709 13:12:50.303122  1174 raft_consensus.cc:359] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:50.308888  1174 raft_consensus.cc:740] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.310070  1174 consensus_queue.cc:260] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:50.312887  1174 ts_tablet_manager.cc:1434] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:12:50.317220  1174 tablet_bootstrap.cc:492] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:50.379455   456 consensus_peers.cc:597] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:50.406472   456 consensus_peers.cc:597] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:50.410712   381 consensus_peers.cc:597] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:50.415136  1174 tablet_bootstrap.cc:492] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.416213  1174 tablet_bootstrap.cc:492] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:50.416857  1174 ts_tablet_manager.cc:1403] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.100s	user 0.046s	sys 0.043s
I20260709 13:12:50.419286  1174 raft_consensus.cc:359] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:50.419885  1174 raft_consensus.cc:740] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.420735  1174 consensus_queue.cc:260] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:50.423020  1174 ts_tablet_manager.cc:1434] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:50.425247  1174 tablet_bootstrap.cc:492] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:50.438319   530 consensus_peers.cc:597] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:50.455192  1174 tablet_bootstrap.cc:492] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.456342  1174 tablet_bootstrap.cc:492] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:50.457098  1174 ts_tablet_manager.cc:1403] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.007s
I20260709 13:12:50.473165  1174 raft_consensus.cc:359] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:50.474012  1174 raft_consensus.cc:740] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.475008  1174 consensus_queue.cc:260] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:50.477752  1174 ts_tablet_manager.cc:1434] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.004s
I20260709 13:12:50.480391  1174 tablet_bootstrap.cc:492] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:50.505457  1174 tablet_bootstrap.cc:492] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.506520  1174 tablet_bootstrap.cc:492] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:50.507427  1174 ts_tablet_manager.cc:1403] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 13:12:50.510082  1174 raft_consensus.cc:359] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:50.510838  1174 raft_consensus.cc:740] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.511686  1174 consensus_queue.cc:260] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:50.514093  1174 ts_tablet_manager.cc:1434] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:50.514979  1174 tablet_bootstrap.cc:492] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:50.561080  1174 tablet_bootstrap.cc:492] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.562176  1174 tablet_bootstrap.cc:492] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:50.562877  1174 ts_tablet_manager.cc:1403] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.011s
I20260709 13:12:50.565618  1174 raft_consensus.cc:359] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:50.566357  1174 raft_consensus.cc:740] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.567180  1174 consensus_queue.cc:260] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:50.570444  1174 ts_tablet_manager.cc:1434] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:12:50.571362  1174 tablet_bootstrap.cc:492] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:50.575300   456 consensus_peers.cc:597] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:50.594740  1174 tablet_bootstrap.cc:492] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.596345  1174 tablet_bootstrap.cc:492] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:50.597138  1174 ts_tablet_manager.cc:1403] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:12:50.599880  1174 raft_consensus.cc:359] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:50.600653  1174 raft_consensus.cc:740] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.601459  1174 consensus_queue.cc:260] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:50.610466  1174 ts_tablet_manager.cc:1434] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:12:50.612838  1174 tablet_bootstrap.cc:492] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:50.639437   381 consensus_peers.cc:597] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:50.740803  1282 raft_consensus.cc:3060] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:50.779055   456 consensus_peers.cc:597] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:50.782198   381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.193:40765, user_credentials={real_user=slave}} blocked reactor thread for 110757us
I20260709 13:12:50.802548  1276 raft_consensus.cc:3060] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:50.853919   381 consensus_peers.cc:597] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:50.860944   381 consensus_peers.cc:597] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:50.865523  1174 tablet_bootstrap.cc:492] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.866686  1174 tablet_bootstrap.cc:492] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:50.867501  1174 ts_tablet_manager.cc:1403] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.255s	user 0.100s	sys 0.114s
I20260709 13:12:50.870198  1174 raft_consensus.cc:359] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:50.870913  1174 raft_consensus.cc:740] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.871726  1174 consensus_queue.cc:260] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:50.874104  1174 ts_tablet_manager.cc:1434] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:12:50.874221   381 consensus_peers.cc:597] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:50.874987  1174 tablet_bootstrap.cc:492] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
W20260709 13:12:50.886410   381 consensus_peers.cc:597] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:50.916173  1174 tablet_bootstrap.cc:492] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.917490  1174 tablet_bootstrap.cc:492] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:50.918342  1174 ts_tablet_manager.cc:1403] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.000s
I20260709 13:12:50.921145  1174 raft_consensus.cc:359] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:50.921926  1174 raft_consensus.cc:740] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.922631  1174 consensus_queue.cc:260] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:50.930807  1174 ts_tablet_manager.cc:1434] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:12:50.931792  1174 tablet_bootstrap.cc:492] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:50.966068  1174 tablet_bootstrap.cc:492] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:50.967126  1174 tablet_bootstrap.cc:492] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:50.967870  1174 ts_tablet_manager.cc:1403] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.008s
I20260709 13:12:50.973973  1174 raft_consensus.cc:359] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:50.974725  1174 raft_consensus.cc:740] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.975565  1174 consensus_queue.cc:260] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:50.977995  1174 ts_tablet_manager.cc:1434] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:12:50.978839  1174 tablet_bootstrap.cc:492] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:50.981053  1277 raft_consensus.cc:3060] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.002533  1174 tablet_bootstrap.cc:492] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.003567  1174 tablet_bootstrap.cc:492] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:51.004222  1174 ts_tablet_manager.cc:1403] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.010s
I20260709 13:12:51.022548  1174 raft_consensus.cc:359] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:51.023468  1174 raft_consensus.cc:740] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.024158  1174 consensus_queue.cc:260] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:51.027034  1174 ts_tablet_manager.cc:1434] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:12:51.028187  1174 tablet_bootstrap.cc:492] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:51.055965  1174 tablet_bootstrap.cc:492] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.057122  1174 tablet_bootstrap.cc:492] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:51.057972  1174 ts_tablet_manager.cc:1403] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.006s
I20260709 13:12:51.061034  1174 raft_consensus.cc:359] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:51.062047  1174 raft_consensus.cc:740] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.063014  1174 consensus_queue.cc:260] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:51.066181  1174 ts_tablet_manager.cc:1434] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:51.067173  1174 tablet_bootstrap.cc:492] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:51.091847  1174 tablet_bootstrap.cc:492] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.093022  1174 tablet_bootstrap.cc:492] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:51.093885  1174 ts_tablet_manager.cc:1403] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.011s
I20260709 13:12:51.096995  1174 raft_consensus.cc:359] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:51.097878  1174 raft_consensus.cc:740] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.098726  1174 consensus_queue.cc:260] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:51.100970  1174 ts_tablet_manager.cc:1434] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:51.120716  1174 tablet_bootstrap.cc:492] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:51.264987  1174 tablet_bootstrap.cc:492] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.266855  1174 tablet_bootstrap.cc:492] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:51.267647  1174 ts_tablet_manager.cc:1403] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.147s	user 0.039s	sys 0.010s
I20260709 13:12:51.280560  1174 raft_consensus.cc:359] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:51.281366  1174 raft_consensus.cc:740] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.312991  1174 consensus_queue.cc:260] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:51.315352  1174 ts_tablet_manager.cc:1434] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 13:12:51.316272  1174 tablet_bootstrap.cc:492] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:51.358191  1174 tablet_bootstrap.cc:492] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.359161  1174 tablet_bootstrap.cc:492] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:51.359829  1174 ts_tablet_manager.cc:1403] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.005s
I20260709 13:12:51.362385  1174 raft_consensus.cc:359] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:51.363057  1174 raft_consensus.cc:740] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.363720  1174 consensus_queue.cc:260] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:51.365797  1174 ts_tablet_manager.cc:1434] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:12:51.367246  1174 tablet_bootstrap.cc:492] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:51.381608  1174 tablet_bootstrap.cc:492] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.382915  1174 tablet_bootstrap.cc:492] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:51.384176  1174 ts_tablet_manager.cc:1403] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.001s
I20260709 13:12:51.386729  1174 raft_consensus.cc:359] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:51.387428  1174 raft_consensus.cc:740] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.388224  1174 consensus_queue.cc:260] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:51.390352  1174 ts_tablet_manager.cc:1434] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:51.393015  1174 tablet_bootstrap.cc:492] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:51.416625  1277 raft_consensus.cc:3060] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.512529  1174 tablet_bootstrap.cc:492] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.513841  1174 tablet_bootstrap.cc:492] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:51.514592  1174 ts_tablet_manager.cc:1403] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.122s	user 0.043s	sys 0.036s
I20260709 13:12:51.517688  1174 raft_consensus.cc:359] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:51.518596  1174 raft_consensus.cc:740] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.519325  1174 consensus_queue.cc:260] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:12:51.520846  1174 ts_tablet_manager.cc:1434] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:12:51.521826  1174 tablet_bootstrap.cc:492] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:51.541538  1174 tablet_bootstrap.cc:492] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.542480  1174 tablet_bootstrap.cc:492] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:51.543148  1174 ts_tablet_manager.cc:1403] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:12:51.546078  1174 raft_consensus.cc:359] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:51.546691  1174 raft_consensus.cc:740] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.548213  1174 consensus_queue.cc:260] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:51.550247  1174 ts_tablet_manager.cc:1434] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:51.551282  1174 tablet_bootstrap.cc:492] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: Bootstrap starting.
I20260709 13:12:51.632822  1277 raft_consensus.cc:3060] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.665310  1174 tablet_bootstrap.cc:492] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.666554  1174 tablet_bootstrap.cc:492] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: Bootstrap complete.
I20260709 13:12:51.667245  1174 ts_tablet_manager.cc:1403] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: Time spent bootstrapping tablet: real 0.116s	user 0.058s	sys 0.056s
I20260709 13:12:51.669978  1174 raft_consensus.cc:359] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:51.670600  1174 raft_consensus.cc:740] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c1750ca53a445883b66469ea339141, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.671223  1174 consensus_queue.cc:260] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:51.673447  1174 ts_tablet_manager.cc:1434] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:12:51.930410  1276 raft_consensus.cc:3060] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.007652  1277 raft_consensus.cc:3060] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:55.946875   512 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf820 after lost signal to thread 25398
W20260709 13:12:55.948046   512 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4f20 after lost signal to thread 32741
W20260709 13:12:55.949128   512 debug-util.cc:398] Leaking SignalData structure 0x7b08001246c0 after lost signal to thread 440
W20260709 13:12:55.950119   512 debug-util.cc:398] Leaking SignalData structure 0x7b0800243b80 after lost signal to thread 515
W20260709 13:12:55.951092   512 debug-util.cc:398] Leaking SignalData structure 0x7b080038b140 after lost signal to thread 589
W20260709 13:12:55.952128   512 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa920 after lost signal to thread 1310
I20260709 13:12:58.888815 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:58.975005   416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11cc376e2d944e4cab791e761af1be67"
dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:12:58.975776   416 raft_consensus.cc:606] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:12:58.978813   416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557"
dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:12:58.979480   416 raft_consensus.cc:606] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:12:58.982349   416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75"
dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:12:58.983016   416 raft_consensus.cc:606] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:12:58.996559   487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5142c450ae11440bac6ebd5b5ab35bba"
dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:46696
I20260709 13:12:58.997236   487 raft_consensus.cc:606] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:12:59.001000   416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d4a00d69b74c98ab81dd2996356c83"
dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:12:59.001708   416 raft_consensus.cc:606] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:12:59.007702   416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78"
dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:12:59.008356   416 raft_consensus.cc:606] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:12:59.009608 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:59.011202 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:59.032933  1418 raft_consensus.cc:993] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.033841  1431 raft_consensus.cc:1081] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.036407  1275 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11cc376e2d944e4cab791e761af1be67"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45108
I20260709 13:12:59.036984  1275 raft_consensus.cc:493] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.037509  1275 raft_consensus.cc:3060] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.052167  1275 raft_consensus.cc:515] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:59.054914  1275 leader_election.cc:290] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:12:59.056851   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cc376e2d944e4cab791e761af1be67" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:59.057682   563 raft_consensus.cc:3060] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.059031   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11cc376e2d944e4cab791e761af1be67" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:59.059754   416 raft_consensus.cc:3055] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.060335   416 raft_consensus.cc:740] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:59.061542   416 consensus_queue.cc:260] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:59.063380   416 raft_consensus.cc:3060] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.073661   563 raft_consensus.cc:2468] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:12:59.074076   416 raft_consensus.cc:2468] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:12:59.085961  1169 leader_election.cc:304] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:59.089064  1437 raft_consensus.cc:2804] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.104285  1437 raft_consensus.cc:697] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:59.108726  1437 consensus_queue.cc:237] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:12:59.116480  1418 raft_consensus.cc:993] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.117187  1418 raft_consensus.cc:1081] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.119233  1276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45108
I20260709 13:12:59.119779  1276 raft_consensus.cc:493] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.120191  1276 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:59.133704  1276 raft_consensus.cc:515] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.137336  1276 leader_election.cc:290] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 4 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:59.138664   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:59.139062   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194e4343a7d94f87a19e28be0166a557" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:59.139413   416 raft_consensus.cc:3055] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:59.139709   488 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:59.139885   416 raft_consensus.cc:740] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:59.140992   416 consensus_queue.cc:260] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.145153   416 raft_consensus.cc:3060] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:59.155218 32703 catalog_manager.cc:5697] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.177116   416 raft_consensus.cc:2468] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 4.
I20260709 13:12:59.184188  1169 leader_election.cc:304] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:59.185693  1437 raft_consensus.cc:2804] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:59.186479  1437 raft_consensus.cc:697] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 4 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:59.186902   488 raft_consensus.cc:2468] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 4.
I20260709 13:12:59.187548  1437 consensus_queue.cc:237] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.231798 32703 catalog_manager.cc:5697] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 3 to 4, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 4 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.322261  1418 raft_consensus.cc:993] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.322846  1423 raft_consensus.cc:1081] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.324450  1276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45108
I20260709 13:12:59.325016  1276 raft_consensus.cc:493] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.325358  1276 raft_consensus.cc:3060] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.333886  1423 raft_consensus.cc:993] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.333588  1276 raft_consensus.cc:515] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.334607  1431 raft_consensus.cc:1081] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.336251  1276 leader_election.cc:290] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:59.336874   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:59.337525   416 raft_consensus.cc:3055] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.337893   416 raft_consensus.cc:740] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:59.338807   416 consensus_queue.cc:260] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.339078   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da508793a0e245b98ec5b5cb69dc3b78" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:59.339705   488 raft_consensus.cc:3060] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.340333   416 raft_consensus.cc:3060] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.340492  1283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45108
I20260709 13:12:59.341287  1283 raft_consensus.cc:493] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.341737  1283 raft_consensus.cc:3060] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.351142   416 raft_consensus.cc:2468] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:12:59.352373  1169 leader_election.cc:304] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:59.353390  1437 raft_consensus.cc:2804] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.353940  1437 raft_consensus.cc:697] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:59.353807  1283 raft_consensus.cc:515] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.355145  1437 consensus_queue.cc:237] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.356359  1283 leader_election.cc:290] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:59.358232   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:59.358901   487 raft_consensus.cc:3060] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.359946   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a1b61fefe4409aafc26d1c3ad71f75" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:59.360598   414 raft_consensus.cc:3055] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.360927   414 raft_consensus.cc:740] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:59.361644   488 raft_consensus.cc:2468] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:12:59.362391   414 consensus_queue.cc:260] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.364289   414 raft_consensus.cc:3060] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.373544   414 raft_consensus.cc:2468] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:12:59.375049  1169 leader_election.cc:304] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:12:59.379974  1437 raft_consensus.cc:2804] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.380546  1437 raft_consensus.cc:697] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:59.381263  1425 raft_consensus.cc:993] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.381909  1425 raft_consensus.cc:1081] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.381515  1437 consensus_queue.cc:237] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.383548   487 raft_consensus.cc:2468] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:12:59.386055  1283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5142c450ae11440bac6ebd5b5ab35bba"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45098
I20260709 13:12:59.384723 32703 catalog_manager.cc:5697] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.386674  1283 raft_consensus.cc:493] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.387120  1283 raft_consensus.cc:3060] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.395249  1283 raft_consensus.cc:515] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:59.397416  1283 leader_election.cc:290] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:12:59.398082   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5142c450ae11440bac6ebd5b5ab35bba" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:59.398701   487 raft_consensus.cc:3055] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.398990   487 raft_consensus.cc:740] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:12:59.399730   487 consensus_queue.cc:260] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:59.400703   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5142c450ae11440bac6ebd5b5ab35bba" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:12:59.401352   564 raft_consensus.cc:3060] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.407141 32703 catalog_manager.cc:5697] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.411242   564 raft_consensus.cc:2468] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:12:59.412847   487 raft_consensus.cc:3060] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.413213  1170 leader_election.cc:304] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:12:59.414369  1437 raft_consensus.cc:2804] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.415095  1437 raft_consensus.cc:697] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:59.416191  1437 consensus_queue.cc:237] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:12:59.422842   487 raft_consensus.cc:2468] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:12:59.431974 32703 catalog_manager.cc:5697] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.501356   564 raft_consensus.cc:1275] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.502527  1431 raft_consensus.cc:993] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.503072  1431 raft_consensus.cc:1081] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:12:59.502871  1437 consensus_queue.cc:1048] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:59.507138  1276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61d4a00d69b74c98ab81dd2996356c83"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45108
I20260709 13:12:59.507730  1276 raft_consensus.cc:493] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.508080  1276 raft_consensus.cc:3060] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.520947  1276 raft_consensus.cc:515] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.524437   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4a00d69b74c98ab81dd2996356c83" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:12:59.525084   414 raft_consensus.cc:3055] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.525369   414 raft_consensus.cc:740] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:12:59.526198   414 consensus_queue.cc:260] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.527311   414 raft_consensus.cc:3060] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.528250   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4a00d69b74c98ab81dd2996356c83" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:12:59.528838   487 raft_consensus.cc:3060] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.544574   487 raft_consensus.cc:2468] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:12:59.545624  1276 leader_election.cc:290] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:12:59.550964  1166 leader_election.cc:304] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:12:59.552093  1437 raft_consensus.cc:2804] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.557588   414 raft_consensus.cc:2468] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:12:59.563851  1437 raft_consensus.cc:697] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:12:59.566228   414 raft_consensus.cc:1275] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.571668  1453 consensus_queue.cc:1048] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:59.576445  1437 consensus_queue.cc:237] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:12:59.611337   487 raft_consensus.cc:1275] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 4 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:59.612985  1453 consensus_queue.cc:1048] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:59.648716 32703 catalog_manager.cc:5697] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.653527   414 raft_consensus.cc:1275] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 4 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:59.655540  1454 consensus_queue.cc:1048] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:59.743559   414 raft_consensus.cc:1275] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.745054  1454 consensus_queue.cc:1048] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:59.758460   487 raft_consensus.cc:1275] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.760790  1454 consensus_queue.cc:1048] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:59.785091   414 raft_consensus.cc:1275] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.787186  1438 consensus_queue.cc:1048] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:59.797065   487 raft_consensus.cc:1275] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.798810  1438 consensus_queue.cc:1048] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:59.912533   487 raft_consensus.cc:1275] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.914116  1438 consensus_queue.cc:1048] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:59.926332   564 raft_consensus.cc:1275] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.928244  1438 consensus_queue.cc:1048] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.010672   414 raft_consensus.cc:1275] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.012190 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:00.013638  1453 consensus_queue.cc:1048] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:00.077273   489 raft_consensus.cc:1275] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.079069  1438 consensus_queue.cc:1048] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.112325 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:00.181793   414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "208e3c5b595545858696a33f8e73deab"
dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:13:00.182494   414 raft_consensus.cc:606] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:13:00.188648   414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525"
dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:13:00.189402   414 raft_consensus.cc:606] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:13:00.196039   414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88c308c7d16f484992afc75ec0343d26"
dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:13:00.196702   414 raft_consensus.cc:606] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:13:00.199766   414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f"
dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:13:00.200584   414 raft_consensus.cc:606] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:13:00.205022   489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0"
dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:46696
I20260709 13:13:00.205837   489 raft_consensus.cc:606] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:13:00.209952   414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb"
dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:13:00.210779   414 raft_consensus.cc:606] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:13:00.220356  1423 raft_consensus.cc:993] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.220872  1423 raft_consensus.cc:1081] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.225340  1276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45108
I20260709 13:13:00.225438 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:00.225988  1276 raft_consensus.cc:493] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.226475  1276 raft_consensus.cc:3060] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.227424 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:00.231937  1276 raft_consensus.cc:515] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:13:00.235141  1276 leader_election.cc:290] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 3 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:13:00.238508   489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:13:00.239205   489 raft_consensus.cc:3060] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.239535   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644496fb7ce44dc3a989c54110d04525" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:13:00.240248   416 raft_consensus.cc:3055] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:00.240695   416 raft_consensus.cc:740] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:13:00.241509   416 consensus_queue.cc:260] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:13:00.242940   416 raft_consensus.cc:3060] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.246968   489 raft_consensus.cc:2468] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 3.
I20260709 13:13:00.249181  1166 leader_election.cc:304] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:13:00.250538  1454 raft_consensus.cc:2804] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:00.251071  1454 raft_consensus.cc:697] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 3 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:13:00.252225  1454 consensus_queue.cc:237] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:13:00.253918   416 raft_consensus.cc:2468] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 3.
I20260709 13:13:00.278447 32703 catalog_manager.cc:5697] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 2 to 3, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 3 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.334749  1449 raft_consensus.cc:993] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.335273  1449 raft_consensus.cc:1081] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.337627  1276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45108
I20260709 13:13:00.338322  1276 raft_consensus.cc:493] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.338662  1276 raft_consensus.cc:3060] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.344039  1276 raft_consensus.cc:515] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:13:00.346264  1276 leader_election.cc:290] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 3 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:13:00.346596   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:13:00.346807   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e4b48b4e2f471e99335ac86c36167f" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:13:00.347289   416 raft_consensus.cc:3055] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:00.347430   487 raft_consensus.cc:3060] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.347693   416 raft_consensus.cc:740] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:13:00.348605   416 consensus_queue.cc:260] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:13:00.349951   416 raft_consensus.cc:3060] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.354614   487 raft_consensus.cc:2468] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 3.
I20260709 13:13:00.356276  1166 leader_election.cc:304] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:13:00.357161  1454 raft_consensus.cc:2804] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:00.357717  1454 raft_consensus.cc:697] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 3 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:13:00.358872  1454 consensus_queue.cc:237] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:13:00.357699   416 raft_consensus.cc:2468] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 3.
I20260709 13:13:00.385810 32703 catalog_manager.cc:5697] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 2 to 3, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 3 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.423573  1449 raft_consensus.cc:993] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.424157  1418 raft_consensus.cc:1081] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.425714  1276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88c308c7d16f484992afc75ec0343d26"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45108
I20260709 13:13:00.426337  1276 raft_consensus.cc:493] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.426784  1276 raft_consensus.cc:3060] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.436983  1276 raft_consensus.cc:515] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:13:00.439716  1276 leader_election.cc:290] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:13:00.440654   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c308c7d16f484992afc75ec0343d26" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:13:00.440658   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c308c7d16f484992afc75ec0343d26" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:13:00.441618   416 raft_consensus.cc:3055] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.441771   564 raft_consensus.cc:3060] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.442096   416 raft_consensus.cc:740] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:13:00.445905   416 consensus_queue.cc:260] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:13:00.447469   416 raft_consensus.cc:3060] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.449941   564 raft_consensus.cc:2468] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:00.451385  1170 leader_election.cc:304] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:13:00.452423  1454 raft_consensus.cc:2804] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.452951  1454 raft_consensus.cc:697] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:13:00.454035  1454 consensus_queue.cc:237] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:13:00.455873   416 raft_consensus.cc:2468] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:00.473718 32703 catalog_manager.cc:5697] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.496898  1423 raft_consensus.cc:993] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.497426  1418 raft_consensus.cc:1081] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.499119  1276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "208e3c5b595545858696a33f8e73deab"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45108
I20260709 13:13:00.499718  1276 raft_consensus.cc:493] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.500085  1276 raft_consensus.cc:3060] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.508562  1276 raft_consensus.cc:515] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:13:00.511039  1276 leader_election.cc:290] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975), 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023)
I20260709 13:13:00.513080   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208e3c5b595545858696a33f8e73deab" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:13:00.513769   564 raft_consensus.cc:3060] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.514362   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208e3c5b595545858696a33f8e73deab" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:13:00.515100   414 raft_consensus.cc:3055] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.515447   414 raft_consensus.cc:740] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:13:00.516366   414 consensus_queue.cc:260] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:13:00.517887   414 raft_consensus.cc:3060] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.519994   564 raft_consensus.cc:2468] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:00.521466  1170 leader_election.cc:304] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:13:00.522432  1454 raft_consensus.cc:2804] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.523000  1454 raft_consensus.cc:697] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:13:00.524001  1454 consensus_queue.cc:237] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } }
I20260709 13:13:00.548722 32703 catalog_manager.cc:5697] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.556567   414 raft_consensus.cc:2468] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:00.575624  1423 raft_consensus.cc:993] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.576134  1423 raft_consensus.cc:1081] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.577795  1276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45108
I20260709 13:13:00.578311  1276 raft_consensus.cc:493] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.578614  1276 raft_consensus.cc:3060] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.585742  1276 raft_consensus.cc:515] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:13:00.588092  1276 leader_election.cc:290] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:13:00.588368   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:13:00.589074   414 raft_consensus.cc:3055] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.589418   414 raft_consensus.cc:740] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b79bd4dca614b218791c5293a51c7a9, State: Running, Role: LEADER
I20260709 13:13:00.590093   489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ea2fc89ca344de86b1026038aa08bb" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:13:00.590700   489 raft_consensus.cc:3060] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.590283   414 consensus_queue.cc:260] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:13:00.591797   414 raft_consensus.cc:3060] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.596397   489 raft_consensus.cc:2468] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:00.597822  1166 leader_election.cc:304] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:13:00.599511  1454 raft_consensus.cc:2804] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.600047  1454 raft_consensus.cc:697] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:13:00.600972  1454 consensus_queue.cc:237] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } }
I20260709 13:13:00.611022   414 raft_consensus.cc:2468] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:00.631803 32703 catalog_manager.cc:5697] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.683566  1424 raft_consensus.cc:993] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.684176  1430 raft_consensus.cc:1081] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:00.686337  1276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45098
I20260709 13:13:00.686848  1276 raft_consensus.cc:493] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.687177  1276 raft_consensus.cc:3060] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.696317  1276 raft_consensus.cc:515] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:13:00.699615  1276 leader_election.cc:290] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:13:00.699795   489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:13:00.700114   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b68afdb4a44c419ac582ebc689ecf0" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:13:00.700488   489 raft_consensus.cc:3055] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.700776   564 raft_consensus.cc:3060] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.700820   489 raft_consensus.cc:740] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:13:00.701954   489 consensus_queue.cc:260] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:13:00.703240   489 raft_consensus.cc:3060] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.708668   489 raft_consensus.cc:2468] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:00.714564  1166 leader_election.cc:304] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70c1750ca53a445883b66469ea339141, c547e4ecc9ae4f03a72252a7d8049f98; no voters: 
I20260709 13:13:00.715775  1454 raft_consensus.cc:2804] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.716414  1454 raft_consensus.cc:697] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:13:00.717635  1454 consensus_queue.cc:237] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:13:00.718935   564 raft_consensus.cc:2468] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:00.738884 32703 catalog_manager.cc:5697] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.814208   414 raft_consensus.cc:1275] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:00.815654  1454 consensus_queue.cc:1048] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.852324   487 raft_consensus.cc:1275] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:00.855046  1438 consensus_queue.cc:1048] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.861740   414 raft_consensus.cc:1275] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.864672  1454 consensus_queue.cc:1048] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:00.897680   564 raft_consensus.cc:1275] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.902014  1438 consensus_queue.cc:1048] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.937255   487 raft_consensus.cc:1275] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:00.951640  1438 consensus_queue.cc:1048] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:00.969923   416 raft_consensus.cc:1275] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:00.971752  1454 consensus_queue.cc:1048] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:01.004103   487 raft_consensus.cc:1275] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:01.005942  1454 consensus_queue.cc:1048] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:01.023826   416 raft_consensus.cc:1275] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:01.030774  1453 consensus_queue.cc:1048] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:01.047684   564 raft_consensus.cc:1275] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:01.051397  1454 consensus_queue.cc:1048] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:01.074714   416 raft_consensus.cc:1275] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:01.076939  1485 consensus_queue.cc:1048] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:01.228543 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:01.258867   564 raft_consensus.cc:1275] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:01.260342  1454 consensus_queue.cc:1048] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:01.270644 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:01.277410   487 raft_consensus.cc:1275] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:01.286294  1486 consensus_queue.cc:1048] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:01.326913   489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b"
dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
mode: GRACEFUL
new_leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
 from {username='slave'} at 127.0.0.1:46696
I20260709 13:13:01.327616   489 raft_consensus.cc:606] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Received request to transfer leadership to TS 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:13:01.330319   489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1d975e40654d90b138939a2c9bc659"
dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
mode: GRACEFUL
new_leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
 from {username='slave'} at 127.0.0.1:46696
I20260709 13:13:01.330922   489 raft_consensus.cc:606] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Received request to transfer leadership to TS 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:13:01.333742   489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360"
dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:46696
I20260709 13:13:01.334286   489 raft_consensus.cc:606] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:13:01.337713  1436 raft_consensus.cc:993] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:01.337811   489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53"
dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
mode: GRACEFUL
new_leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
 from {username='slave'} at 127.0.0.1:46696
I20260709 13:13:01.338352  1430 raft_consensus.cc:1081] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:01.338474   489 raft_consensus.cc:606] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Received request to transfer leadership to TS 54e079297e3a4863ac2eccd69f7dbd9c
I20260709 13:13:01.340044  1276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45098
I20260709 13:13:01.340525  1276 raft_consensus.cc:493] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:01.340878  1276 raft_consensus.cc:3060] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.341634   489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e"
dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
mode: GRACEFUL
new_leader_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:46696
I20260709 13:13:01.342288   489 raft_consensus.cc:606] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Received request to transfer leadership to TS 70c1750ca53a445883b66469ea339141
I20260709 13:13:01.343843 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:01.345963 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:01.348979  1276 raft_consensus.cc:515] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:13:01.350705  1276 leader_election.cc:290] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:13:01.351780   489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:13:01.352877   489 raft_consensus.cc:3055] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.351786   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a48b926a8e43f98d19342830ebc360" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:13:01.353262   489 raft_consensus.cc:740] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:13:01.353549   564 raft_consensus.cc:3060] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.354259   489 consensus_queue.cc:260] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:13:01.355479   489 raft_consensus.cc:3060] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.359014   564 raft_consensus.cc:2468] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:01.360280  1170 leader_election.cc:304] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:13:01.361218  1486 raft_consensus.cc:2804] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.361747  1486 raft_consensus.cc:697] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:13:01.362649  1486 consensus_queue.cc:237] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:13:01.365381   489 raft_consensus.cc:2468] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:01.375442 32707 catalog_manager.cc:5697] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.552122  1436 raft_consensus.cc:993] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98: : Instructing follower 54e079297e3a4863ac2eccd69f7dbd9c to start an election
I20260709 13:13:01.552605  1436 raft_consensus.cc:1081] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Signalling peer 54e079297e3a4863ac2eccd69f7dbd9c to start an election
I20260709 13:13:01.554332   561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1d975e40654d90b138939a2c9bc659"
dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
 from {username='slave'} at 127.0.0.1:50540
I20260709 13:13:01.554914   561 raft_consensus.cc:493] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:01.555197   561 raft_consensus.cc:3060] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.560333   561 raft_consensus.cc:515] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:13:01.563344   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d975e40654d90b138939a2c9bc659" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:13:01.563936   416 raft_consensus.cc:3060] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.564041   561 leader_election.cc:290] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:13:01.566234   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1d975e40654d90b138939a2c9bc659" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:13:01.566849   487 raft_consensus.cc:3055] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.567305   487 raft_consensus.cc:740] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:13:01.568744   487 consensus_queue.cc:260] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:13:01.570194   487 raft_consensus.cc:3060] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.571904   416 raft_consensus.cc:2468] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
I20260709 13:13:01.573271   530 leader_election.cc:304] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:13:01.574180  1469 raft_consensus.cc:2804] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.574741  1469 raft_consensus.cc:697] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:13:01.575326  1430 raft_consensus.cc:993] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98: : Instructing follower 54e079297e3a4863ac2eccd69f7dbd9c to start an election
I20260709 13:13:01.575881  1436 raft_consensus.cc:1081] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Signalling peer 54e079297e3a4863ac2eccd69f7dbd9c to start an election
I20260709 13:13:01.575763  1469 consensus_queue.cc:237] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:13:01.578104   561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53"
dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
 from {username='slave'} at 127.0.0.1:50540
I20260709 13:13:01.578644   561 raft_consensus.cc:493] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:01.579064   561 raft_consensus.cc:3060] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.581965   487 raft_consensus.cc:2468] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
I20260709 13:13:01.586647   561 raft_consensus.cc:515] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:13:01.589254   561 leader_election.cc:290] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:13:01.589437   416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:13:01.589111 32707 catalog_manager.cc:5697] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 1 to 2, leader changed from c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195) to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 2 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.590508   416 raft_consensus.cc:3060] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.593472   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6697ad4db194664b519fcb657a65e53" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:13:01.594213   487 raft_consensus.cc:3055] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.594527   487 raft_consensus.cc:740] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:13:01.595361   487 consensus_queue.cc:260] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:13:01.598287   487 raft_consensus.cc:3060] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.604442   416 raft_consensus.cc:2468] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
I20260709 13:13:01.607865   530 leader_election.cc:304] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:13:01.608678   487 raft_consensus.cc:2468] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
I20260709 13:13:01.608799  1495 raft_consensus.cc:2804] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.609476  1495 raft_consensus.cc:697] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:13:01.611532  1495 consensus_queue.cc:237] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:13:01.630476 32707 catalog_manager.cc:5697] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 1 to 2, leader changed from c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195) to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 2 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.636987  1430 raft_consensus.cc:993] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98: : Instructing follower 54e079297e3a4863ac2eccd69f7dbd9c to start an election
I20260709 13:13:01.637516  1430 raft_consensus.cc:1081] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Signalling peer 54e079297e3a4863ac2eccd69f7dbd9c to start an election
I20260709 13:13:01.639165   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b"
dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
 from {username='slave'} at 127.0.0.1:50540
I20260709 13:13:01.639710   564 raft_consensus.cc:493] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:01.640060   564 raft_consensus.cc:3060] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.646382   564 raft_consensus.cc:515] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:13:01.648279   564 leader_election.cc:290] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Requested vote from peers 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023), c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781)
I20260709 13:13:01.648967   414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b79bd4dca614b218791c5293a51c7a9"
I20260709 13:13:01.649730   414 raft_consensus.cc:3060] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.650640   487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088f3e2e60a40348ddbae342c78941b" candidate_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:13:01.651301   487 raft_consensus.cc:3055] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.651643   487 raft_consensus.cc:740] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:13:01.652387   487 consensus_queue.cc:260] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:13:01.653324   487 raft_consensus.cc:3060] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.655674   414 raft_consensus.cc:2468] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
I20260709 13:13:01.656760   530 leader_election.cc:304] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 7b79bd4dca614b218791c5293a51c7a9; no voters: 
I20260709 13:13:01.657475  1495 raft_consensus.cc:2804] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.658048  1495 raft_consensus.cc:697] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Becoming Leader. State: Replica: 54e079297e3a4863ac2eccd69f7dbd9c, State: Running, Role: LEADER
I20260709 13:13:01.658806   487 raft_consensus.cc:2468] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54e079297e3a4863ac2eccd69f7dbd9c in term 2.
I20260709 13:13:01.659018  1495 consensus_queue.cc:237] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } }
I20260709 13:13:01.672464 32707 catalog_manager.cc:5697] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c reported cstate change: term changed from 1 to 2, leader changed from c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195) to 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196). New cstate: current_term: 2 leader_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.682528  1436 raft_consensus.cc:993] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98: : Instructing follower 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:01.683027  1430 raft_consensus.cc:1081] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Signalling peer 70c1750ca53a445883b66469ea339141 to start an election
I20260709 13:13:01.684607  1283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e"
dest_uuid: "70c1750ca53a445883b66469ea339141"
 from {username='slave'} at 127.0.0.1:45098
I20260709 13:13:01.685156  1283 raft_consensus.cc:493] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:01.685513  1283 raft_consensus.cc:3060] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.690716  1283 raft_consensus.cc:515] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:13:01.692574  1283 leader_election.cc:290] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Requested vote from peers c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781), 54e079297e3a4863ac2eccd69f7dbd9c (127.24.204.196:42975)
I20260709 13:13:01.693449   488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c547e4ecc9ae4f03a72252a7d8049f98"
I20260709 13:13:01.693663   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8c93d4a8ad4ec0b108017f2f61138e" candidate_uuid: "70c1750ca53a445883b66469ea339141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "54e079297e3a4863ac2eccd69f7dbd9c"
I20260709 13:13:01.694161   488 raft_consensus.cc:3055] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.694320   564 raft_consensus.cc:3060] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.694511   488 raft_consensus.cc:740] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c547e4ecc9ae4f03a72252a7d8049f98, State: Running, Role: LEADER
I20260709 13:13:01.695458   488 consensus_queue.cc:260] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:13:01.696836   488 raft_consensus.cc:3060] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.702653   564 raft_consensus.cc:2468] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:01.703649   488 raft_consensus.cc:2468] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c1750ca53a445883b66469ea339141 in term 2.
I20260709 13:13:01.703833  1170 leader_election.cc:304] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e079297e3a4863ac2eccd69f7dbd9c, 70c1750ca53a445883b66469ea339141; no voters: 
I20260709 13:13:01.704779  1454 raft_consensus.cc:2804] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.705405  1454 raft_consensus.cc:697] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Becoming Leader. State: Replica: 70c1750ca53a445883b66469ea339141, State: Running, Role: LEADER
I20260709 13:13:01.706292  1454 consensus_queue.cc:237] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } }
I20260709 13:13:01.716866 32707 catalog_manager.cc:5697] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 reported cstate change: term changed from 1 to 2, leader changed from c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195) to 70c1750ca53a445883b66469ea339141 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "70c1750ca53a445883b66469ea339141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c1750ca53a445883b66469ea339141" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 40765 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.776527   564 raft_consensus.cc:1275] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:01.778033  1486 consensus_queue.cc:1048] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:01.791451   488 raft_consensus.cc:1275] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:01.792910  1486 consensus_queue.cc:1048] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.076481   414 raft_consensus.cc:1275] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.077757  1495 consensus_queue.cc:1048] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.088763   488 raft_consensus.cc:1275] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.091117  1495 consensus_queue.cc:1048] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.158677   414 raft_consensus.cc:1275] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.160810  1495 consensus_queue.cc:1048] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.162256   414 raft_consensus.cc:1275] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.164057  1511 consensus_queue.cc:1048] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b79bd4dca614b218791c5293a51c7a9" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.183670   489 raft_consensus.cc:1275] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.186620  1512 consensus_queue.cc:1048] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.216542   487 raft_consensus.cc:1275] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 54e079297e3a4863ac2eccd69f7dbd9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.218314  1512 consensus_queue.cc:1048] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.227193   561 raft_consensus.cc:1275] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.230955   488 raft_consensus.cc:1275] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Refusing update from remote peer 70c1750ca53a445883b66469ea339141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.231323  1486 consensus_queue.cc:1048] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e079297e3a4863ac2eccd69f7dbd9c" member_type: VOTER last_known_addr { host: "127.24.204.196" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.232841  1485 consensus_queue.cc:1048] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c547e4ecc9ae4f03a72252a7d8049f98" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.346969 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:02.381644 25395 tablet_server.cc:179] TabletServer@127.24.204.193:40765 shutting down...
W20260709 13:13:02.401523   381 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 293 similar messages]
W20260709 13:13:02.405028   381 consensus_peers.cc:597] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.418955 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:02.420653 25395 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:02.421727   381 consensus_peers.cc:597] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.421723 25395 raft_consensus.cc:2243] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.422614 25395 raft_consensus.cc:2272] T 9d0cb63fe6b54741b53e72257d8eea82 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.425645 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.426483 25395 raft_consensus.cc:2243] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.427033 25395 raft_consensus.cc:2272] T ac98fcdb54dc49569e1bed91b70763d6 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.430838 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.431670 25395 raft_consensus.cc:2243] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.432160 25395 raft_consensus.cc:2272] T 601d16b32f7947f899a17d9b9c4b1152 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.435309 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.462001 25395 raft_consensus.cc:2243] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.462617 25395 raft_consensus.cc:2272] T 31cf36e914b5401f9584db0b92dd2591 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.465921 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.466889 25395 raft_consensus.cc:2243] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.467401 25395 raft_consensus.cc:2272] T 82a993590f1841ea8bb26eaab3ffbca0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.470698   456 consensus_peers.cc:597] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.476747 25395 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:02.476938   456 consensus_peers.cc:597] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.477950 25395 raft_consensus.cc:2243] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.478986 25395 raft_consensus.cc:2272] T 94e4b48b4e2f471e99335ac86c36167f P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.483280 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.484102 25395 raft_consensus.cc:2243] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.484743 25395 raft_consensus.cc:2272] T 3bb8ccdeec5247b58ff52a64999af132 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.487110   381 consensus_peers.cc:597] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.488394 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.489334 25395 raft_consensus.cc:2243] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.489854 25395 raft_consensus.cc:2272] T 81d8c817825941bdb7e7435a4be4be3e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.492944 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.493839 25395 raft_consensus.cc:2243] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.494356 25395 raft_consensus.cc:2272] T c447d7bc00cf4281a661063406c070ee P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.497473 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.498260 25395 raft_consensus.cc:2243] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:02.498677   530 consensus_peers.cc:597] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.498796 25395 raft_consensus.cc:2272] T c77cacfdc1e943a6ae75838391278350 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.501214 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.501931 25395 raft_consensus.cc:2243] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.502414 25395 raft_consensus.cc:2272] T e86d3a0eaf524c18ab308eb7803263f0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.505440 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.506129 25395 raft_consensus.cc:2243] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.506716 25395 raft_consensus.cc:2272] T 55d997035dbd4e7d88a1f947b2f915bb P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.509461 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.510356 25395 raft_consensus.cc:2243] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.510964 25395 raft_consensus.cc:2272] T 7092bc27912f4ee0b10a1f261f38eac8 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.513618   530 consensus_peers.cc:597] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.514088 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.514976 25395 raft_consensus.cc:2243] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.516039 25395 raft_consensus.cc:2272] T 208e3c5b595545858696a33f8e73deab P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.518939 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.519724 25395 raft_consensus.cc:2243] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.520296 25395 raft_consensus.cc:2272] T 55312d46dd4747c0bacb0d980ca208b1 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.520962   381 consensus_peers.cc:597] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.522895 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.523685 25395 raft_consensus.cc:2243] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.524211 25395 raft_consensus.cc:2272] T 8b7fe5c08e134e6297971768dca0caa0 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.527135 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.528008 25395 raft_consensus.cc:2243] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.528483 25395 raft_consensus.cc:2272] T fdba3586e7ba42179a320766690f44bc P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.531373 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.532231 25395 raft_consensus.cc:2243] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.532795 25395 raft_consensus.cc:2272] T c071a99756034ba58ef554450a637513 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.533893   530 consensus_peers.cc:597] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.535877 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.536737 25395 raft_consensus.cc:2243] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.537258 25395 raft_consensus.cc:2272] T f4a5bbb7df494a0ba42cdb90d573ce1e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.540951 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.541932 25395 raft_consensus.cc:2243] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.542380 25395 raft_consensus.cc:2272] T 9dc4b123ed2a46788fa7fbb6effdff5e P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.544422 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.545007 25395 raft_consensus.cc:2243] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.545497 25395 raft_consensus.cc:2272] T 82e165c0d45844da9b680b461c2b5493 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.547436 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.547972 25395 raft_consensus.cc:2243] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.548879 25395 raft_consensus.cc:2272] T 61d4a00d69b74c98ab81dd2996356c83 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.551880 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.552687 25395 raft_consensus.cc:2243] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.553181 25395 raft_consensus.cc:2272] T 8879df9852da4e428d5432830c645ea9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.555490   381 consensus_peers.cc:597] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.555917 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.556644 25395 raft_consensus.cc:2243] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.557323 25395 raft_consensus.cc:2272] T 5142c450ae11440bac6ebd5b5ab35bba P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.559542 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.560336 25395 raft_consensus.cc:2243] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.561261 25395 raft_consensus.cc:2272] T da508793a0e245b98ec5b5cb69dc3b78 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.563609 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.564188 25395 raft_consensus.cc:2243] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.564908 25395 raft_consensus.cc:2272] T 11cc376e2d944e4cab791e761af1be67 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.566958 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.567513 25395 raft_consensus.cc:2243] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.567916 25395 raft_consensus.cc:2272] T 218260d1606649edb1f8c91d1392ed7f P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.569947 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.570511 25395 raft_consensus.cc:2243] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.571272 25395 raft_consensus.cc:2272] T 76a48b926a8e43f98d19342830ebc360 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.574069 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.574654 25395 raft_consensus.cc:2243] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.575073 25395 raft_consensus.cc:2272] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.576980 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.577497 25395 raft_consensus.cc:2243] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.577996 25395 raft_consensus.cc:2272] T afc6d1809c204b7c8dbca7216cfc3121 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.580318 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.580961 25395 raft_consensus.cc:2243] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.581436 25395 raft_consensus.cc:2272] T e7b5dfaf74c940a19f58b2d439e6b768 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.583601 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.584153 25395 raft_consensus.cc:2243] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.584575 25395 raft_consensus.cc:2272] T 7c4f70da72b449609b0b4f28f6589ab3 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.587204 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.587973 25395 raft_consensus.cc:2243] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.588827 25395 raft_consensus.cc:2272] T 644496fb7ce44dc3a989c54110d04525 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.591488 25395 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:02.591558   381 consensus_peers.cc:597] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.592303 25395 raft_consensus.cc:2243] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.593020 25395 raft_consensus.cc:2272] T b30b99a7946e406280df3352194e0545 P 70c1750ca53a445883b66469ea339141 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.596653 25395 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:02.597241   530 consensus_peers.cc:597] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.597409 25395 raft_consensus.cc:2243] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.598543 25395 raft_consensus.cc:2272] T 48a1b61fefe4409aafc26d1c3ad71f75 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.600939   456 consensus_peers.cc:597] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.601497 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.602442 25395 raft_consensus.cc:2243] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.603307 25395 raft_consensus.cc:2272] T 88c308c7d16f484992afc75ec0343d26 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.603462   381 consensus_peers.cc:597] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.605685 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.606494 25395 raft_consensus.cc:2243] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.607056 25395 raft_consensus.cc:2272] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.609895 25395 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:02.610050   530 consensus_peers.cc:597] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.610633 25395 raft_consensus.cc:2243] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.611548 25395 raft_consensus.cc:2272] T c2b68afdb4a44c419ac582ebc689ecf0 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.613873 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.614391 25395 raft_consensus.cc:2243] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.615183 25395 raft_consensus.cc:2272] T db8c93d4a8ad4ec0b108017f2f61138e P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.617955 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.618557 25395 raft_consensus.cc:2243] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.619284 25395 raft_consensus.cc:2272] T 194e4343a7d94f87a19e28be0166a557 P 70c1750ca53a445883b66469ea339141 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.621277 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.622066 25395 raft_consensus.cc:2243] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.622579 25395 raft_consensus.cc:2272] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.625211 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.625929 25395 raft_consensus.cc:2243] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.626492 25395 raft_consensus.cc:2272] T 10ce075819b848f9849ae714b57964f7 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.629055 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.629694 25395 raft_consensus.cc:2243] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.630123 25395 raft_consensus.cc:2272] T effea88d8d284e51a4c8383f5da9fd83 P 70c1750ca53a445883b66469ea339141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.632313 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.632797 25395 raft_consensus.cc:2243] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.633209 25395 raft_consensus.cc:2272] T ee683cad470a4e5389da6f91a92664a4 P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.635365 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:02.635825 25395 raft_consensus.cc:2243] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.636747 25395 raft_consensus.cc:2272] T d4ea2fc89ca344de86b1026038aa08bb P 70c1750ca53a445883b66469ea339141 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.646817   456 consensus_peers.cc:597] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.660948   530 consensus_peers.cc:597] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.677584   456 consensus_peers.cc:597] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.682386   456 consensus_peers.cc:597] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.717383 25395 tablet_server.cc:196] TabletServer@127.24.204.193:40765 shutdown complete.
W20260709 13:13:02.768424   456 consensus_peers.cc:597] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.775010   381 consensus_peers.cc:597] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.775731   381 consensus_peers.cc:597] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.799908   530 consensus_peers.cc:597] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.814093   456 consensus_peers.cc:597] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.818595   456 consensus_peers.cc:597] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.821378 25395 tablet_server.cc:179] TabletServer@127.24.204.194:0 shutting down...
W20260709 13:13:02.823503   530 consensus_peers.cc:597] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.832881   530 consensus_peers.cc:597] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.839972   381 consensus_peers.cc:597] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.846891   530 consensus_peers.cc:597] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.860216 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:02.861280 25395 tablet_replica.cc:333] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.862274 25395 raft_consensus.cc:2243] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.862874 25395 raft_consensus.cc:2272] T b6697ad4db194664b519fcb657a65e53 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.865645 25395 tablet_replica.cc:333] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.866441 25395 raft_consensus.cc:2243] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.867033 25395 raft_consensus.cc:2272] T 55d997035dbd4e7d88a1f947b2f915bb P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.870045 25395 tablet_replica.cc:333] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.870852 25395 raft_consensus.cc:2243] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.871392 25395 raft_consensus.cc:2272] T b1743042f2d04b94808274ce1c08af42 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.871904   530 consensus_peers.cc:597] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.873919 25395 tablet_replica.cc:333] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.874658 25395 raft_consensus.cc:2243] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.875461 25395 raft_consensus.cc:2272] T 1d62ccb3929543488daa15130eed287a P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.877532 25395 tablet_replica.cc:333] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.878211 25395 raft_consensus.cc:2243] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.878590 25395 raft_consensus.cc:2272] T d4ea2fc89ca344de86b1026038aa08bb P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.880560 25395 tablet_replica.cc:333] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.881091 25395 raft_consensus.cc:2243] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.881893 25395 raft_consensus.cc:2272] T 218260d1606649edb1f8c91d1392ed7f P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.884075 25395 tablet_replica.cc:333] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.884743 25395 raft_consensus.cc:2243] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.885217 25395 raft_consensus.cc:2272] T 11cc376e2d944e4cab791e761af1be67 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.887645 25395 tablet_replica.cc:333] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.888484 25395 raft_consensus.cc:2243] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:02.888505   456 consensus_peers.cc:597] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.888995 25395 raft_consensus.cc:2272] T da508793a0e245b98ec5b5cb69dc3b78 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.891187 25395 tablet_replica.cc:333] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.891739 25395 raft_consensus.cc:2243] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.892170 25395 raft_consensus.cc:2272] T 5a1d975e40654d90b138939a2c9bc659 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.895183 25395 tablet_replica.cc:333] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.895758 25395 raft_consensus.cc:2243] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.896477 25395 raft_consensus.cc:2272] T e86d3a0eaf524c18ab308eb7803263f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.898370 25395 tablet_replica.cc:333] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.898895 25395 raft_consensus.cc:2243] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.899396 25395 raft_consensus.cc:2272] T fdba3586e7ba42179a320766690f44bc P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.901237 25395 tablet_replica.cc:333] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.901824 25395 raft_consensus.cc:2243] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.902256 25395 raft_consensus.cc:2272] T 208e3c5b595545858696a33f8e73deab P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.904134 25395 tablet_replica.cc:333] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.904629 25395 raft_consensus.cc:2243] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.905517 25395 raft_consensus.cc:2272] T f4a5bbb7df494a0ba42cdb90d573ce1e P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.907464 25395 tablet_replica.cc:333] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.908098 25395 raft_consensus.cc:2243] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.909078 25395 raft_consensus.cc:2272] T 9dc4b123ed2a46788fa7fbb6effdff5e P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.911752 25395 tablet_replica.cc:333] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.912352 25395 raft_consensus.cc:2243] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.912925 25395 raft_consensus.cc:2272] T 82e165c0d45844da9b680b461c2b5493 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.914546   456 consensus_peers.cc:597] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.915303 25395 tablet_replica.cc:333] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.915915 25395 raft_consensus.cc:2243] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.916280 25395 raft_consensus.cc:2272] T 29bdd222276f45d0b94756421060da52 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.918781 25395 tablet_replica.cc:333] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.919564 25395 raft_consensus.cc:2243] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.919986 25395 raft_consensus.cc:2272] T 88c308c7d16f484992afc75ec0343d26 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.922235 25395 tablet_replica.cc:333] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.922940 25395 raft_consensus.cc:2243] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.923357 25395 raft_consensus.cc:2272] T 48a1b61fefe4409aafc26d1c3ad71f75 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:02.923588   456 consensus_peers.cc:597] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 70c1750ca53a445883b66469ea339141 (127.24.204.193:40765): Couldn't send request to peer 70c1750ca53a445883b66469ea339141. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:40765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.925547 25395 tablet_replica.cc:333] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.926275 25395 raft_consensus.cc:2243] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.926702 25395 raft_consensus.cc:2272] T 644496fb7ce44dc3a989c54110d04525 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.928944 25395 tablet_replica.cc:333] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.929749 25395 raft_consensus.cc:2243] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.930809 25395 raft_consensus.cc:2272] T b30b99a7946e406280df3352194e0545 P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.933547 25395 tablet_replica.cc:333] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.934388 25395 raft_consensus.cc:2243] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.934943 25395 raft_consensus.cc:2272] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.937549 25395 tablet_replica.cc:333] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.938297 25395 raft_consensus.cc:2243] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.938856 25395 raft_consensus.cc:2272] T 10ce075819b848f9849ae714b57964f7 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.940941 25395 tablet_replica.cc:333] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.941735 25395 raft_consensus.cc:2243] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.942289 25395 raft_consensus.cc:2272] T 40791a3fd5f24fcc97260df7cb88f115 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.944995 25395 tablet_replica.cc:333] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.945825 25395 raft_consensus.cc:2243] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.946427 25395 raft_consensus.cc:2272] T 2088f3e2e60a40348ddbae342c78941b P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.948972 25395 tablet_replica.cc:333] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.949478 25395 raft_consensus.cc:2243] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.949954 25395 raft_consensus.cc:2272] T 94e4b48b4e2f471e99335ac86c36167f P 7b79bd4dca614b218791c5293a51c7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.951949 25395 tablet_replica.cc:333] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.952709 25395 raft_consensus.cc:2243] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.953629 25395 raft_consensus.cc:2272] T ac98fcdb54dc49569e1bed91b70763d6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.956338 25395 tablet_replica.cc:333] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.956959 25395 raft_consensus.cc:2243] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.958014 25395 raft_consensus.cc:2272] T 31cf36e914b5401f9584db0b92dd2591 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.960053 25395 tablet_replica.cc:333] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.960608 25395 raft_consensus.cc:2243] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.961055 25395 raft_consensus.cc:2272] T e9d528fd921345acbfc657dc909148f0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.963099 25395 tablet_replica.cc:333] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.963745 25395 raft_consensus.cc:2243] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.964756 25395 raft_consensus.cc:2272] T ee683cad470a4e5389da6f91a92664a4 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.967381 25395 tablet_replica.cc:333] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.968055 25395 raft_consensus.cc:2243] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.969087 25395 raft_consensus.cc:2272] T effea88d8d284e51a4c8383f5da9fd83 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.971380 25395 tablet_replica.cc:333] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.971949 25395 raft_consensus.cc:2243] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.972488 25395 raft_consensus.cc:2272] T afc6d1809c204b7c8dbca7216cfc3121 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.974759 25395 tablet_replica.cc:333] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.975354 25395 raft_consensus.cc:2243] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.975886 25395 raft_consensus.cc:2272] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.978322 25395 tablet_replica.cc:333] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.978811 25395 raft_consensus.cc:2243] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.979725 25395 raft_consensus.cc:2272] T e7b5dfaf74c940a19f58b2d439e6b768 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.982738 25395 tablet_replica.cc:333] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.983489 25395 raft_consensus.cc:2243] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.984028 25395 raft_consensus.cc:2272] T 61d4a00d69b74c98ab81dd2996356c83 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.986750 25395 tablet_replica.cc:333] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.987465 25395 raft_consensus.cc:2243] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.987948 25395 raft_consensus.cc:2272] T 4dfa1d8bf64d4c509074630610c02e52 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.990465 25395 tablet_replica.cc:333] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.991158 25395 raft_consensus.cc:2243] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:02.992175 25395 raft_consensus.cc:2272] T fb22622dd6074222841290f4d737acf2 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.995150 25395 tablet_replica.cc:333] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.995836 25395 raft_consensus.cc:2243] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.996336 25395 raft_consensus.cc:2272] T c8b138e8469b435e9f167c96d962a892 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.998559 25395 tablet_replica.cc:333] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:02.999197 25395 raft_consensus.cc:2243] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.000423 25395 raft_consensus.cc:2272] T bf5a50bacfa64214acf10104084bb1be P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.002997 25395 tablet_replica.cc:333] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:03.003536 25395 raft_consensus.cc:2243] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.004317 25395 raft_consensus.cc:2272] T c77cacfdc1e943a6ae75838391278350 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.006516 25395 tablet_replica.cc:333] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:03.007025 25395 raft_consensus.cc:2243] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.007457 25395 raft_consensus.cc:2272] T 82a993590f1841ea8bb26eaab3ffbca0 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.009717 25395 tablet_replica.cc:333] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:03.010270 25395 raft_consensus.cc:2243] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.010735 25395 raft_consensus.cc:2272] T 7e4fea653b2e44fd87939ab040d317f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.012918 25395 tablet_replica.cc:333] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:03.013697 25395 raft_consensus.cc:2243] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.014514 25395 raft_consensus.cc:2272] T 9d0cb63fe6b54741b53e72257d8eea82 P 7b79bd4dca614b218791c5293a51c7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.016422 25395 tablet_replica.cc:333] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:03.017015 25395 raft_consensus.cc:2243] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.017429 25395 raft_consensus.cc:2272] T 194e4343a7d94f87a19e28be0166a557 P 7b79bd4dca614b218791c5293a51c7a9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.019850 25395 tablet_replica.cc:333] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9: stopping tablet replica
I20260709 13:13:03.020470 25395 raft_consensus.cc:2243] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.020988 25395 raft_consensus.cc:2272] T e4d7d71169d347a982bc81fce6e293f6 P 7b79bd4dca614b218791c5293a51c7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:03.063421   456 consensus_peers.cc:597] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.067332   456 consensus_peers.cc:597] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.067936   456 consensus_peers.cc:597] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.104269 25395 tablet_server.cc:196] TabletServer@127.24.204.194:0 shutdown complete.
W20260709 13:13:03.120710   530 consensus_peers.cc:597] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.131664   530 consensus_peers.cc:597] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.144768   530 consensus_peers.cc:597] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.154538   530 consensus_peers.cc:597] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.162566   456 consensus_peers.cc:597] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.170163   530 consensus_peers.cc:597] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.198176   530 consensus_peers.cc:597] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.200011 25395 tablet_server.cc:179] TabletServer@127.24.204.195:0 shutting down...
W20260709 13:13:03.219919   528 consensus_peers.cc:597] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.233531   530 consensus_peers.cc:597] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.234184   530 consensus_peers.cc:597] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.235572   456 consensus_peers.cc:597] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.240550   528 consensus_peers.cc:597] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.249048   456 consensus_peers.cc:597] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.270355 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:03.271203 25395 tablet_replica.cc:333] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.272091 25395 raft_consensus.cc:2243] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.273135 25395 raft_consensus.cc:2272] T c071a99756034ba58ef554450a637513 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.275560 25395 tablet_replica.cc:333] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.276140 25395 raft_consensus.cc:2243] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.276564 25395 raft_consensus.cc:2272] T b6697ad4db194664b519fcb657a65e53 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.278419 25395 tablet_replica.cc:333] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.279088 25395 raft_consensus.cc:2243] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.279907 25395 raft_consensus.cc:2272] T b1743042f2d04b94808274ce1c08af42 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.281746 25395 tablet_replica.cc:333] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.282209 25395 raft_consensus.cc:2243] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.282563 25395 raft_consensus.cc:2272] T db8c93d4a8ad4ec0b108017f2f61138e P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.284324 25395 tablet_replica.cc:333] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.284891 25395 raft_consensus.cc:2243] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.285246 25395 raft_consensus.cc:2272] T c2b68afdb4a44c419ac582ebc689ecf0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.287248 25395 tablet_replica.cc:333] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.287745 25395 raft_consensus.cc:2243] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.288105 25395 raft_consensus.cc:2272] T 1d62ccb3929543488daa15130eed287a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.289973 25395 tablet_replica.cc:333] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.290616 25395 raft_consensus.cc:2243] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.291040 25395 raft_consensus.cc:2272] T 9dc4b123ed2a46788fa7fbb6effdff5e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.293285 25395 tablet_replica.cc:333] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.294015 25395 raft_consensus.cc:2243] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.294502 25395 raft_consensus.cc:2272] T d4ea2fc89ca344de86b1026038aa08bb P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.297030 25395 tablet_replica.cc:333] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.297803 25395 raft_consensus.cc:2243] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.298688 25395 raft_consensus.cc:2272] T 81d8c817825941bdb7e7435a4be4be3e P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.300525 25395 tablet_replica.cc:333] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.301055 25395 raft_consensus.cc:2243] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.301450 25395 raft_consensus.cc:2272] T 5a1d975e40654d90b138939a2c9bc659 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.303452 25395 tablet_replica.cc:333] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.304008 25395 raft_consensus.cc:2243] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.304482 25395 raft_consensus.cc:2272] T 2088f3e2e60a40348ddbae342c78941b P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.306341 25395 tablet_replica.cc:333] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.306865 25395 raft_consensus.cc:2243] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.307590 25395 raft_consensus.cc:2272] T 9bcd9ae6a2eb4b90be3ad7a183c00b8a P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.309651 25395 tablet_replica.cc:333] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.310320 25395 raft_consensus.cc:2243] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.311247 25395 raft_consensus.cc:2272] T 10ce075819b848f9849ae714b57964f7 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.313875 25395 tablet_replica.cc:333] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.314481 25395 raft_consensus.cc:2243] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.315286 25395 raft_consensus.cc:2272] T 40791a3fd5f24fcc97260df7cb88f115 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.317155 25395 tablet_replica.cc:333] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.317760 25395 raft_consensus.cc:2243] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.318171 25395 raft_consensus.cc:2272] T 48a1b61fefe4409aafc26d1c3ad71f75 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.319886 25395 tablet_replica.cc:333] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.320401 25395 raft_consensus.cc:2243] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.321137 25395 raft_consensus.cc:2272] T 7c4f70da72b449609b0b4f28f6589ab3 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.322940 25395 tablet_replica.cc:333] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.323465 25395 raft_consensus.cc:2243] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.323848 25395 raft_consensus.cc:2272] T 644496fb7ce44dc3a989c54110d04525 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.325536 25395 tablet_replica.cc:333] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.326125 25395 raft_consensus.cc:2243] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.326551 25395 raft_consensus.cc:2272] T b30b99a7946e406280df3352194e0545 P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.328285 25395 tablet_replica.cc:333] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.328902 25395 raft_consensus.cc:2243] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.329366 25395 raft_consensus.cc:2272] T 8b7fe5c08e134e6297971768dca0caa0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.331528 25395 tablet_replica.cc:333] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.332051 25395 raft_consensus.cc:2243] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.332819 25395 raft_consensus.cc:2272] T fdba3586e7ba42179a320766690f44bc P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:03.332958   528 consensus_peers.cc:597] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.334736 25395 tablet_replica.cc:333] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.335361 25395 raft_consensus.cc:2243] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.335793 25395 raft_consensus.cc:2272] T 55312d46dd4747c0bacb0d980ca208b1 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.337661 25395 tablet_replica.cc:333] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.338379 25395 raft_consensus.cc:2243] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.339265 25395 raft_consensus.cc:2272] T c447d7bc00cf4281a661063406c070ee P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.341617 25395 tablet_replica.cc:333] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.342410 25395 raft_consensus.cc:2243] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:03.342804   530 consensus_peers.cc:597] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer 7b79bd4dca614b218791c5293a51c7a9 (127.24.204.194:35023): Couldn't send request to peer 7b79bd4dca614b218791c5293a51c7a9. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:35023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.343232 25395 raft_consensus.cc:2272] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.345292 25395 tablet_replica.cc:333] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.345904 25395 raft_consensus.cc:2243] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.346308 25395 raft_consensus.cc:2272] T 76a48b926a8e43f98d19342830ebc360 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.348359 25395 tablet_replica.cc:333] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.349146 25395 raft_consensus.cc:2243] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.349670 25395 raft_consensus.cc:2272] T 29bdd222276f45d0b94756421060da52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.352000 25395 tablet_replica.cc:333] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.352640 25395 raft_consensus.cc:2243] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.353080 25395 raft_consensus.cc:2272] T effea88d8d284e51a4c8383f5da9fd83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.355170 25395 tablet_replica.cc:333] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.355707 25395 raft_consensus.cc:2243] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.356139 25395 raft_consensus.cc:2272] T 601d16b32f7947f899a17d9b9c4b1152 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.358296 25395 tablet_replica.cc:333] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.358850 25395 raft_consensus.cc:2243] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.359747 25395 raft_consensus.cc:2272] T e9d528fd921345acbfc657dc909148f0 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.361816 25395 tablet_replica.cc:333] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.362358 25395 raft_consensus.cc:2243] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.362776 25395 raft_consensus.cc:2272] T 31cf36e914b5401f9584db0b92dd2591 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.364753 25395 tablet_replica.cc:333] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.365406 25395 raft_consensus.cc:2243] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.366370 25395 raft_consensus.cc:2272] T 3bb8ccdeec5247b58ff52a64999af132 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.368917 25395 tablet_replica.cc:333] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.369664 25395 raft_consensus.cc:2243] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.370138 25395 raft_consensus.cc:2272] T 94e4b48b4e2f471e99335ac86c36167f P c547e4ecc9ae4f03a72252a7d8049f98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.372519 25395 tablet_replica.cc:333] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.373275 25395 raft_consensus.cc:2243] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.373839 25395 raft_consensus.cc:2272] T e4d7d71169d347a982bc81fce6e293f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.375917 25395 tablet_replica.cc:333] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.376451 25395 raft_consensus.cc:2243] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.376868 25395 raft_consensus.cc:2272] T 218260d1606649edb1f8c91d1392ed7f P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.378806 25395 tablet_replica.cc:333] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.379356 25395 raft_consensus.cc:2243] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.379760 25395 raft_consensus.cc:2272] T 5142c450ae11440bac6ebd5b5ab35bba P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.381657 25395 tablet_replica.cc:333] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.382189 25395 raft_consensus.cc:2243] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.382582 25395 raft_consensus.cc:2272] T da508793a0e245b98ec5b5cb69dc3b78 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.384290 25395 tablet_replica.cc:333] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.384811 25395 raft_consensus.cc:2243] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.385250 25395 raft_consensus.cc:2272] T 7e4fea653b2e44fd87939ab040d317f6 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.387071 25395 tablet_replica.cc:333] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.387540 25395 raft_consensus.cc:2243] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.387933 25395 raft_consensus.cc:2272] T 194e4343a7d94f87a19e28be0166a557 P c547e4ecc9ae4f03a72252a7d8049f98 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.389691 25395 tablet_replica.cc:333] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.390161 25395 raft_consensus.cc:2243] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.390677 25395 raft_consensus.cc:2272] T 7092bc27912f4ee0b10a1f261f38eac8 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.392572 25395 tablet_replica.cc:333] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.393006 25395 raft_consensus.cc:2243] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.393369 25395 raft_consensus.cc:2272] T 61d4a00d69b74c98ab81dd2996356c83 P c547e4ecc9ae4f03a72252a7d8049f98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.395200 25395 tablet_replica.cc:333] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.395720 25395 raft_consensus.cc:2243] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.396536 25395 raft_consensus.cc:2272] T 4dfa1d8bf64d4c509074630610c02e52 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.398447 25395 tablet_replica.cc:333] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.398962 25395 raft_consensus.cc:2243] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.399708 25395 raft_consensus.cc:2272] T 8879df9852da4e428d5432830c645ea9 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.401880 25395 tablet_replica.cc:333] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.402395 25395 raft_consensus.cc:2243] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.402767 25395 raft_consensus.cc:2272] T fb22622dd6074222841290f4d737acf2 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.404564 25395 tablet_replica.cc:333] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.404970 25395 raft_consensus.cc:2243] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.405673 25395 raft_consensus.cc:2272] T c8b138e8469b435e9f167c96d962a892 P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.407426 25395 tablet_replica.cc:333] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98: stopping tablet replica
I20260709 13:13:03.407832 25395 raft_consensus.cc:2243] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.408208 25395 raft_consensus.cc:2272] T bf5a50bacfa64214acf10104084bb1be P c547e4ecc9ae4f03a72252a7d8049f98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:03.413214   528 consensus_peers.cc:597] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.496236 25395 tablet_server.cc:196] TabletServer@127.24.204.195:0 shutdown complete.
W20260709 13:13:03.502291   528 consensus_peers.cc:597] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.195:39781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.535764   528 consensus_peers.cc:597] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.195:39781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.571020 25395 tablet_server.cc:179] TabletServer@127.24.204.196:0 shutting down...
W20260709 13:13:03.571164   528 consensus_peers.cc:597] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.195:39781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:03.610515   528 consensus_peers.cc:597] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.195:39781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.625469 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:03.626389 25395 tablet_replica.cc:333] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.627368 25395 raft_consensus.cc:2243] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.627995 25395 raft_consensus.cc:2272] T c071a99756034ba58ef554450a637513 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.630759 25395 tablet_replica.cc:333] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.631361 25395 raft_consensus.cc:2243] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.632339 25395 raft_consensus.cc:2272] T b6697ad4db194664b519fcb657a65e53 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.634300 25395 tablet_replica.cc:333] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.634846 25395 raft_consensus.cc:2243] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.635242 25395 raft_consensus.cc:2272] T b1743042f2d04b94808274ce1c08af42 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.637100 25395 tablet_replica.cc:333] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.637697 25395 raft_consensus.cc:2243] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.638091 25395 raft_consensus.cc:2272] T db8c93d4a8ad4ec0b108017f2f61138e P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.639765 25395 tablet_replica.cc:333] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.640332 25395 raft_consensus.cc:2243] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.641090 25395 raft_consensus.cc:2272] T 55d997035dbd4e7d88a1f947b2f915bb P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.643047 25395 tablet_replica.cc:333] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.643635 25395 raft_consensus.cc:2243] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.644018 25395 raft_consensus.cc:2272] T 1d62ccb3929543488daa15130eed287a P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.645886 25395 tablet_replica.cc:333] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.646420 25395 raft_consensus.cc:2243] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.646840 25395 raft_consensus.cc:2272] T c2b68afdb4a44c419ac582ebc689ecf0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.648587 25395 tablet_replica.cc:333] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.649096 25395 raft_consensus.cc:2243] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.649444 25395 raft_consensus.cc:2272] T 3bb8ccdeec5247b58ff52a64999af132 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.651292 25395 tablet_replica.cc:333] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.651777 25395 raft_consensus.cc:2243] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.652122 25395 raft_consensus.cc:2272] T ee683cad470a4e5389da6f91a92664a4 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.654109 25395 tablet_replica.cc:333] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.654567 25395 raft_consensus.cc:2243] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.655224 25395 raft_consensus.cc:2272] T 5a1d975e40654d90b138939a2c9bc659 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.656833 25395 tablet_replica.cc:333] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.657315 25395 raft_consensus.cc:2243] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.657776 25395 raft_consensus.cc:2272] T 81d8c817825941bdb7e7435a4be4be3e P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.659592 25395 tablet_replica.cc:333] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.660066 25395 raft_consensus.cc:2243] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.660403 25395 raft_consensus.cc:2272] T e86d3a0eaf524c18ab308eb7803263f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.662221 25395 tablet_replica.cc:333] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.662726 25395 raft_consensus.cc:2243] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.663086 25395 raft_consensus.cc:2272] T 9d0cb63fe6b54741b53e72257d8eea82 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.665271 25395 tablet_replica.cc:333] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.666026 25395 raft_consensus.cc:2243] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.666996 25395 raft_consensus.cc:2272] T 8b7fe5c08e134e6297971768dca0caa0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.669895 25395 tablet_replica.cc:333] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.670516 25395 raft_consensus.cc:2243] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.671042 25395 raft_consensus.cc:2272] T 208e3c5b595545858696a33f8e73deab P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.672914 25395 tablet_replica.cc:333] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.673431 25395 raft_consensus.cc:2243] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.674212 25395 raft_consensus.cc:2272] T 55312d46dd4747c0bacb0d980ca208b1 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.676327 25395 tablet_replica.cc:333] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.677088 25395 raft_consensus.cc:2243] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.677651 25395 raft_consensus.cc:2272] T 40791a3fd5f24fcc97260df7cb88f115 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.679759 25395 tablet_replica.cc:333] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.680253 25395 raft_consensus.cc:2243] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.680915 25395 raft_consensus.cc:2272] T 2088f3e2e60a40348ddbae342c78941b P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.682685 25395 tablet_replica.cc:333] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.683167 25395 raft_consensus.cc:2243] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.683951 25395 raft_consensus.cc:2272] T afc6d1809c204b7c8dbca7216cfc3121 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.685917 25395 tablet_replica.cc:333] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.686443 25395 raft_consensus.cc:2243] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.686858 25395 raft_consensus.cc:2272] T 35552e87ca5c49fe9e0b3b38ddbe0d0a P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.688923 25395 tablet_replica.cc:333] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.689540 25395 raft_consensus.cc:2243] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.690092 25395 raft_consensus.cc:2272] T 76a48b926a8e43f98d19342830ebc360 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.692632 25395 tablet_replica.cc:333] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.693392 25395 raft_consensus.cc:2243] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.694329 25395 raft_consensus.cc:2272] T 29bdd222276f45d0b94756421060da52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.696223 25395 tablet_replica.cc:333] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.696714 25395 raft_consensus.cc:2243] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.697054 25395 raft_consensus.cc:2272] T c447d7bc00cf4281a661063406c070ee P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.698881 25395 tablet_replica.cc:333] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.699355 25395 raft_consensus.cc:2243] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.699695 25395 raft_consensus.cc:2272] T e7b5dfaf74c940a19f58b2d439e6b768 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.701476 25395 tablet_replica.cc:333] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.702097 25395 raft_consensus.cc:2243] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.702781 25395 raft_consensus.cc:2272] T 72cfaa775c3b4fb2a7756d6042ab17b9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.704840 25395 tablet_replica.cc:333] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.705420 25395 raft_consensus.cc:2243] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.705988 25395 raft_consensus.cc:2272] T f4a5bbb7df494a0ba42cdb90d573ce1e P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.708580 25395 tablet_replica.cc:333] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.709338 25395 raft_consensus.cc:2243] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.710132 25395 raft_consensus.cc:2272] T 82e165c0d45844da9b680b461c2b5493 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.712311 25395 tablet_replica.cc:333] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.712850 25395 raft_consensus.cc:2243] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.713276 25395 raft_consensus.cc:2272] T 11cc376e2d944e4cab791e761af1be67 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.714964 25395 tablet_replica.cc:333] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.715461 25395 raft_consensus.cc:2243] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.715969 25395 raft_consensus.cc:2272] T 5142c450ae11440bac6ebd5b5ab35bba P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.717892 25395 tablet_replica.cc:333] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.718422 25395 raft_consensus.cc:2243] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.719187 25395 raft_consensus.cc:2272] T e4d7d71169d347a982bc81fce6e293f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.721098 25395 tablet_replica.cc:333] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.721657 25395 raft_consensus.cc:2243] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.722079 25395 raft_consensus.cc:2272] T 4dfa1d8bf64d4c509074630610c02e52 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.723975 25395 tablet_replica.cc:333] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.724481 25395 raft_consensus.cc:2243] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.724979 25395 raft_consensus.cc:2272] T fb22622dd6074222841290f4d737acf2 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.727367 25395 tablet_replica.cc:333] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.728263 25395 raft_consensus.cc:2243] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.729063 25395 raft_consensus.cc:2272] T 8879df9852da4e428d5432830c645ea9 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:03.729876   528 consensus_peers.cc:597] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c -> Peer c547e4ecc9ae4f03a72252a7d8049f98 (127.24.204.195:39781): Couldn't send request to peer c547e4ecc9ae4f03a72252a7d8049f98. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.195:39781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.731721 25395 tablet_replica.cc:333] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.732357 25395 raft_consensus.cc:2243] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.732791 25395 raft_consensus.cc:2272] T c8b138e8469b435e9f167c96d962a892 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.734896 25395 tablet_replica.cc:333] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.735414 25395 raft_consensus.cc:2243] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.735819 25395 raft_consensus.cc:2272] T bf5a50bacfa64214acf10104084bb1be P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.737952 25395 tablet_replica.cc:333] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.738484 25395 raft_consensus.cc:2243] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.739264 25395 raft_consensus.cc:2272] T 7092bc27912f4ee0b10a1f261f38eac8 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.741386 25395 tablet_replica.cc:333] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.741986 25395 raft_consensus.cc:2243] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.742384 25395 raft_consensus.cc:2272] T c77cacfdc1e943a6ae75838391278350 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.744359 25395 tablet_replica.cc:333] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.744905 25395 raft_consensus.cc:2243] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.745780 25395 raft_consensus.cc:2272] T 82a993590f1841ea8bb26eaab3ffbca0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.747784 25395 tablet_replica.cc:333] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.748324 25395 raft_consensus.cc:2243] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.749136 25395 raft_consensus.cc:2272] T 7e4fea653b2e44fd87939ab040d317f6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.751147 25395 tablet_replica.cc:333] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.751729 25395 raft_consensus.cc:2243] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.752228 25395 raft_consensus.cc:2272] T 88c308c7d16f484992afc75ec0343d26 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.754154 25395 tablet_replica.cc:333] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.754685 25395 raft_consensus.cc:2243] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.755125 25395 raft_consensus.cc:2272] T 7c4f70da72b449609b0b4f28f6589ab3 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.757172 25395 tablet_replica.cc:333] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.757982 25395 raft_consensus.cc:2243] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.758841 25395 raft_consensus.cc:2272] T 601d16b32f7947f899a17d9b9c4b1152 P 54e079297e3a4863ac2eccd69f7dbd9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.760854 25395 tablet_replica.cc:333] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.761672 25395 raft_consensus.cc:2243] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.762135 25395 raft_consensus.cc:2272] T ac98fcdb54dc49569e1bed91b70763d6 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.764112 25395 tablet_replica.cc:333] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c: stopping tablet replica
I20260709 13:13:03.764603 25395 raft_consensus.cc:2243] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.765228 25395 raft_consensus.cc:2272] T e9d528fd921345acbfc657dc909148f0 P 54e079297e3a4863ac2eccd69f7dbd9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.833181 25395 tablet_server.cc:196] TabletServer@127.24.204.196:0 shutdown complete.
I20260709 13:13:03.897156 25395 master.cc:562] Master@127.24.204.254:46115 shutting down...
I20260709 13:13:03.926909 25395 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:03.927497 25395 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.927843 25395 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1311245efbe54ea3ad91eedfd95a93ad: stopping tablet replica
I20260709 13:13:03.975126 25395 master.cc:584] Master@127.24.204.254:46115 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34104 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:13:04.066128 25395 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.204.254:37997
I20260709 13:13:04.067298 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:04.074487  1537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:04.074548  1538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:04.075445  1540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:04.079337 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:04.080652 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:04.080888 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:04.081140 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602784081122 us; error 0 us; skew 500 ppm
I20260709 13:13:04.081851 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:04.084728 25395 webserver.cc:533] Webserver started at http://127.24.204.254:43443/ using document root <none> and password file <none>
I20260709 13:13:04.085258 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:04.085458 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:04.085784 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:04.086917 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/master-0-root/instance:
uuid: "5cf5da72888c4c53ac30c54faf06c475"
format_stamp: "Formatted at 2026-07-09 13:13:04 on dist-test-slave-qv7r"
I20260709 13:13:04.091750 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:04.095342  1545 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:04.096290 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:04.096544 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/master-0-root
uuid: "5cf5da72888c4c53ac30c54faf06c475"
format_stamp: "Formatted at 2026-07-09 13:13:04 on dist-test-slave-qv7r"
I20260709 13:13:04.096833 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:04.152047 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:04.153249 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:04.196085 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.254:37997
I20260709 13:13:04.196312  1596 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.254:37997 every 8 connection(s)
I20260709 13:13:04.200567  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.211758  1597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475: Bootstrap starting.
I20260709 13:13:04.216593  1597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.220896  1597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475: No bootstrap required, opened a new log
I20260709 13:13:04.223219  1597 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cf5da72888c4c53ac30c54faf06c475" member_type: VOTER }
I20260709 13:13:04.223619  1597 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.223798  1597 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cf5da72888c4c53ac30c54faf06c475, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.224402  1597 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cf5da72888c4c53ac30c54faf06c475" member_type: VOTER }
I20260709 13:13:04.224817  1597 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:04.225004  1597 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:04.225211  1597 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.229823  1597 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cf5da72888c4c53ac30c54faf06c475" member_type: VOTER }
I20260709 13:13:04.230304  1597 leader_election.cc:304] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cf5da72888c4c53ac30c54faf06c475; no voters: 
I20260709 13:13:04.231458  1597 leader_election.cc:290] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:04.231909  1600 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:04.233518  1600 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 1 LEADER]: Becoming Leader. State: Replica: 5cf5da72888c4c53ac30c54faf06c475, State: Running, Role: LEADER
I20260709 13:13:04.234287  1600 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cf5da72888c4c53ac30c54faf06c475" member_type: VOTER }
I20260709 13:13:04.235072  1597 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:04.239208  1601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cf5da72888c4c53ac30c54faf06c475" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cf5da72888c4c53ac30c54faf06c475" member_type: VOTER } }
I20260709 13:13:04.240012  1601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:04.241955  1602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cf5da72888c4c53ac30c54faf06c475. Latest consensus state: current_term: 1 leader_uuid: "5cf5da72888c4c53ac30c54faf06c475" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cf5da72888c4c53ac30c54faf06c475" member_type: VOTER } }
I20260709 13:13:04.242834  1602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:04.246258  1609 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:04.251780  1609 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:04.253074 25395 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:04.261314  1609 catalog_manager.cc:1383] Generated new cluster ID: 82352a19828b4afca2305a321f03ffa8
I20260709 13:13:04.261703  1609 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:04.286029  1609 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:04.287434  1609 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:04.300151  1609 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475: Generated new TSK 0
I20260709 13:13:04.300742  1609 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:04.320356 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:04.326725  1618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:04.327982  1619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:04.331126  1621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:04.333312 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:04.335686 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:04.335914 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:04.336136 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602784336110 us; error 0 us; skew 500 ppm
I20260709 13:13:04.336722 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:04.339110 25395 webserver.cc:533] Webserver started at http://127.24.204.193:46335/ using document root <none> and password file <none>
I20260709 13:13:04.339582 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:04.339775 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:04.340044 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:04.341125 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-0-root/instance:
uuid: "ae4ed633fe964b4895533e16055d45a3"
format_stamp: "Formatted at 2026-07-09 13:13:04 on dist-test-slave-qv7r"
I20260709 13:13:04.345969 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 13:13:04.349785  1626 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:04.350817 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:13:04.351162 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-0-root
uuid: "ae4ed633fe964b4895533e16055d45a3"
format_stamp: "Formatted at 2026-07-09 13:13:04 on dist-test-slave-qv7r"
I20260709 13:13:04.351418 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:04.363379 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:04.364567 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:04.366010 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:04.368310 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:04.368575 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:04.368813 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:04.369024 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:04.412046 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.193:45999
I20260709 13:13:04.412189  1688 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.193:45999 every 8 connection(s)
I20260709 13:13:04.417251 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:04.424656  1693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:04.427017  1694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:04.428337  1696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:04.428445 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:04.430274 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:04.430509 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:04.430783 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602784430763 us; error 0 us; skew 500 ppm
I20260709 13:13:04.431602 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:04.434739 25395 webserver.cc:533] Webserver started at http://127.24.204.194:45789/ using document root <none> and password file <none>
I20260709 13:13:04.435106  1689 heartbeater.cc:344] Connected to a master server at 127.24.204.254:37997
I20260709 13:13:04.435375 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:04.435576  1689 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:04.435678 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:04.436125 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:04.436702  1689 heartbeater.cc:507] Master 127.24.204.254:37997 requested a full tablet report, sending...
I20260709 13:13:04.437748 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-1-root/instance:
uuid: "d9a1d5065bea4270877bb24f205b8b9c"
format_stamp: "Formatted at 2026-07-09 13:13:04 on dist-test-slave-qv7r"
I20260709 13:13:04.439527  1562 ts_manager.cc:194] Registered new tserver with Master: ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999)
I20260709 13:13:04.442132  1562 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32944
I20260709 13:13:04.443739 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:04.447620  1701 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:04.448503 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:04.448837 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-1-root
uuid: "d9a1d5065bea4270877bb24f205b8b9c"
format_stamp: "Formatted at 2026-07-09 13:13:04 on dist-test-slave-qv7r"
I20260709 13:13:04.449142 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:04.466077 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:04.467651 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:04.469213 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:04.471905 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:04.472090 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:04.472380 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:04.472579 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:04.515493 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.194:41255
I20260709 13:13:04.515592  1763 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.194:41255 every 8 connection(s)
I20260709 13:13:04.520469 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:04.527822  1767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:04.528616  1768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:04.533454  1764 heartbeater.cc:344] Connected to a master server at 127.24.204.254:37997
I20260709 13:13:04.534297  1764 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:04.536000  1764 heartbeater.cc:507] Master 127.24.204.254:37997 requested a full tablet report, sending...
I20260709 13:13:04.539728  1562 ts_manager.cc:194] Registered new tserver with Master: d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:04.542255  1562 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32948
I20260709 13:13:04.544922 25395 server_base.cc:1061] running on GCE node
W20260709 13:13:04.544888  1770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:04.546283 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:04.546482 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:04.546692 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602784546668 us; error 0 us; skew 500 ppm
I20260709 13:13:04.547212 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:04.550094 25395 webserver.cc:533] Webserver started at http://127.24.204.195:40551/ using document root <none> and password file <none>
I20260709 13:13:04.550649 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:04.550830 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:04.551210 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:04.552578 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-2-root/instance:
uuid: "c8be9e72dc574a25b0f47af26d38e963"
format_stamp: "Formatted at 2026-07-09 13:13:04 on dist-test-slave-qv7r"
I20260709 13:13:04.557677 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 13:13:04.561299  1775 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:04.562337 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:04.562706 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-2-root
uuid: "c8be9e72dc574a25b0f47af26d38e963"
format_stamp: "Formatted at 2026-07-09 13:13:04 on dist-test-slave-qv7r"
I20260709 13:13:04.563052 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:04.623874 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:04.625252 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:04.626688 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:04.629221 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:04.629483 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:04.629822 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:04.630023 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:04.674440 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.195:39117
I20260709 13:13:04.674543  1837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.195:39117 every 8 connection(s)
I20260709 13:13:04.690529  1838 heartbeater.cc:344] Connected to a master server at 127.24.204.254:37997
I20260709 13:13:04.690994  1838 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:04.691707  1838 heartbeater.cc:507] Master 127.24.204.254:37997 requested a full tablet report, sending...
I20260709 13:13:04.693985  1562 ts_manager.cc:194] Registered new tserver with Master: c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:04.694094 25395 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016267009s
I20260709 13:13:04.695403  1562 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32962
I20260709 13:13:04.721701  1562 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32964:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:04.724988  1562 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:04.807133  1803 tablet_service.cc:1511] Processing CreateTablet for tablet cde60f39a8f34d449385ee0d1308eef0 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:04.808743  1803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde60f39a8f34d449385ee0d1308eef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.812014  1654 tablet_service.cc:1511] Processing CreateTablet for tablet cde60f39a8f34d449385ee0d1308eef0 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:04.812327  1653 tablet_service.cc:1511] Processing CreateTablet for tablet 081e891dd1fd4d53aab4dbaad1968a16 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:04.813746  1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde60f39a8f34d449385ee0d1308eef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.814404  1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081e891dd1fd4d53aab4dbaad1968a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.818989  1652 tablet_service.cc:1511] Processing CreateTablet for tablet 871b44fd2fc2416e98fb3716c3f1a185 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:04.820503  1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871b44fd2fc2416e98fb3716c3f1a185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.825305  1651 tablet_service.cc:1511] Processing CreateTablet for tablet eb7698498e0447aa80cf38eb36feb228 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:04.826920  1651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7698498e0447aa80cf38eb36feb228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.828186  1802 tablet_service.cc:1511] Processing CreateTablet for tablet 081e891dd1fd4d53aab4dbaad1968a16 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:04.829990  1802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081e891dd1fd4d53aab4dbaad1968a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.831882  1650 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb5210c336143b5a4828367cd7ba44f (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:04.833518  1650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb5210c336143b5a4828367cd7ba44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.836014  1801 tablet_service.cc:1511] Processing CreateTablet for tablet 871b44fd2fc2416e98fb3716c3f1a185 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:04.837679  1801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871b44fd2fc2416e98fb3716c3f1a185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.841789  1649 tablet_service.cc:1511] Processing CreateTablet for tablet b5fc0da4f04e4fe7b9f3d80290894500 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:04.843889  1649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5fc0da4f04e4fe7b9f3d80290894500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.847007  1648 tablet_service.cc:1511] Processing CreateTablet for tablet 945831181cee465ab4e48bf8a4d3e128 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:04.849072  1648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945831181cee465ab4e48bf8a4d3e128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.851245  1800 tablet_service.cc:1511] Processing CreateTablet for tablet eb7698498e0447aa80cf38eb36feb228 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:04.853281  1800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7698498e0447aa80cf38eb36feb228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.855746  1647 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4444d2895c432f9ab8d1257f52d102 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:04.856221  1799 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb5210c336143b5a4828367cd7ba44f (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:04.857235  1647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4444d2895c432f9ab8d1257f52d102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.858291  1799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb5210c336143b5a4828367cd7ba44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.860662  1729 tablet_service.cc:1511] Processing CreateTablet for tablet cde60f39a8f34d449385ee0d1308eef0 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:04.862403  1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde60f39a8f34d449385ee0d1308eef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.863361  1798 tablet_service.cc:1511] Processing CreateTablet for tablet b5fc0da4f04e4fe7b9f3d80290894500 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:04.865469  1798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5fc0da4f04e4fe7b9f3d80290894500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.867359  1728 tablet_service.cc:1511] Processing CreateTablet for tablet 081e891dd1fd4d53aab4dbaad1968a16 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:04.869132  1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081e891dd1fd4d53aab4dbaad1968a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.873242  1727 tablet_service.cc:1511] Processing CreateTablet for tablet 871b44fd2fc2416e98fb3716c3f1a185 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:04.875311  1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871b44fd2fc2416e98fb3716c3f1a185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.881805  1646 tablet_service.cc:1511] Processing CreateTablet for tablet ce9c7463d4e64b06b544c409e60c363c (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:04.883795  1646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9c7463d4e64b06b544c409e60c363c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.892262  1797 tablet_service.cc:1511] Processing CreateTablet for tablet 945831181cee465ab4e48bf8a4d3e128 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:04.894001  1797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945831181cee465ab4e48bf8a4d3e128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.903393  1726 tablet_service.cc:1511] Processing CreateTablet for tablet eb7698498e0447aa80cf38eb36feb228 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:04.905004  1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7698498e0447aa80cf38eb36feb228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.911396  1725 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb5210c336143b5a4828367cd7ba44f (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:04.912957  1725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb5210c336143b5a4828367cd7ba44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.914777  1724 tablet_service.cc:1511] Processing CreateTablet for tablet b5fc0da4f04e4fe7b9f3d80290894500 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:04.916154  1724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5fc0da4f04e4fe7b9f3d80290894500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.918826  1645 tablet_service.cc:1511] Processing CreateTablet for tablet 177ae968f9d9445d95210be795edd6b6 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:04.920217  1645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 177ae968f9d9445d95210be795edd6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.921317  1796 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4444d2895c432f9ab8d1257f52d102 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:04.922741  1796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4444d2895c432f9ab8d1257f52d102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.922885  1723 tablet_service.cc:1511] Processing CreateTablet for tablet 945831181cee465ab4e48bf8a4d3e128 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:04.924244  1723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945831181cee465ab4e48bf8a4d3e128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.927590  1795 tablet_service.cc:1511] Processing CreateTablet for tablet ce9c7463d4e64b06b544c409e60c363c (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:04.929033  1795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9c7463d4e64b06b544c409e60c363c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.935341  1794 tablet_service.cc:1511] Processing CreateTablet for tablet 177ae968f9d9445d95210be795edd6b6 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:04.963691  1794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 177ae968f9d9445d95210be795edd6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.974858  1722 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4444d2895c432f9ab8d1257f52d102 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:04.976295  1722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4444d2895c432f9ab8d1257f52d102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.986222  1853 tablet_bootstrap.cc:492] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:04.988220  1854 tablet_bootstrap.cc:492] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c: Bootstrap starting.
I20260709 13:13:04.995923  1854 tablet_bootstrap.cc:654] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.048364  1726 tablet_service.cc:1511] Processing CreateTablet for tablet ce9c7463d4e64b06b544c409e60c363c (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:05.051065  1721 tablet_service.cc:1511] Processing CreateTablet for tablet 177ae968f9d9445d95210be795edd6b6 (DEFAULT_TABLE table=test-workload [id=79c6c74c7fa548bcae93d698a091b2ab]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:05.052356  1853 tablet_bootstrap.cc:654] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.054559  1855 tablet_bootstrap.cc:492] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963: Bootstrap starting.
I20260709 13:13:05.062209  1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9c7463d4e64b06b544c409e60c363c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:05.063089  1721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 177ae968f9d9445d95210be795edd6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:05.086824  1855 tablet_bootstrap.cc:654] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.091396  1854 tablet_bootstrap.cc:492] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c: No bootstrap required, opened a new log
I20260709 13:13:05.092177  1854 ts_tablet_manager.cc:1403] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c: Time spent bootstrapping tablet: real 0.104s	user 0.026s	sys 0.043s
I20260709 13:13:05.101608  1853 tablet_bootstrap.cc:492] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: No bootstrap required, opened a new log
I20260709 13:13:05.102259  1853 ts_tablet_manager.cc:1403] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.116s	user 0.025s	sys 0.017s
I20260709 13:13:05.097082  1854 raft_consensus.cc:359] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.102969  1854 raft_consensus.cc:385] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.103318  1854 raft_consensus.cc:740] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.104367  1854 consensus_queue.cc:260] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.107190  1853 raft_consensus.cc:359] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.108006  1853 raft_consensus.cc:385] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.108318  1853 raft_consensus.cc:740] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.109097  1853 consensus_queue.cc:260] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.134816  1689 heartbeater.cc:499] Master 127.24.204.254:37997 was elected leader, sending a full tablet report...
I20260709 13:13:05.135188  1853 ts_tablet_manager.cc:1434] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.014s
I20260709 13:13:05.136138  1854 ts_tablet_manager.cc:1434] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c: Time spent starting tablet: real 0.043s	user 0.014s	sys 0.020s
I20260709 13:13:05.136332  1853 tablet_bootstrap.cc:492] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:05.137477  1854 tablet_bootstrap.cc:492] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c: Bootstrap starting.
I20260709 13:13:05.137995  1764 heartbeater.cc:499] Master 127.24.204.254:37997 was elected leader, sending a full tablet report...
I20260709 13:13:05.143151  1853 tablet_bootstrap.cc:654] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.145390  1854 tablet_bootstrap.cc:654] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.160092  1854 tablet_bootstrap.cc:492] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c: No bootstrap required, opened a new log
I20260709 13:13:05.160863  1854 ts_tablet_manager.cc:1403] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 13:13:05.165535  1854 raft_consensus.cc:359] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.166687  1854 raft_consensus.cc:385] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:05.166811  1690 tablet.cc:2406] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:05.167083  1854 raft_consensus.cc:740] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.168398  1854 consensus_queue.cc:260] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.171748  1854 ts_tablet_manager.cc:1434] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:13:05.173250  1854 tablet_bootstrap.cc:492] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c: Bootstrap starting.
I20260709 13:13:05.181114  1855 tablet_bootstrap.cc:492] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963: No bootstrap required, opened a new log
I20260709 13:13:05.182077  1854 tablet_bootstrap.cc:654] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.183084  1855 ts_tablet_manager.cc:1403] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963: Time spent bootstrapping tablet: real 0.129s	user 0.043s	sys 0.018s
I20260709 13:13:05.189438  1855 raft_consensus.cc:359] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.192014  1855 raft_consensus.cc:385] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.192402  1855 raft_consensus.cc:740] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.193580  1853 tablet_bootstrap.cc:492] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: No bootstrap required, opened a new log
I20260709 13:13:05.193264  1855 consensus_queue.cc:260] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.194167  1853 ts_tablet_manager.cc:1403] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.058s	user 0.029s	sys 0.027s
I20260709 13:13:05.198205  1853 raft_consensus.cc:359] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.199265  1853 raft_consensus.cc:385] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.199647  1853 raft_consensus.cc:740] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.201815  1838 heartbeater.cc:499] Master 127.24.204.254:37997 was elected leader, sending a full tablet report...
I20260709 13:13:05.202382  1855 ts_tablet_manager.cc:1434] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 13:13:05.203554  1855 tablet_bootstrap.cc:492] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963: Bootstrap starting.
I20260709 13:13:05.207190  1859 raft_consensus.cc:493] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.207767  1859 raft_consensus.cc:515] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.200790  1853 consensus_queue.cc:260] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.210575  1855 tablet_bootstrap.cc:654] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.213239  1859 leader_election.cc:290] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.215580  1853 ts_tablet_manager.cc:1434] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:13:05.219854  1853 tablet_bootstrap.cc:492] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:05.230019  1853 tablet_bootstrap.cc:654] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:05.247504  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:05.248591  1854 tablet_bootstrap.cc:492] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c: No bootstrap required, opened a new log
I20260709 13:13:05.249390  1854 ts_tablet_manager.cc:1403] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c: Time spent bootstrapping tablet: real 0.076s	user 0.032s	sys 0.025s
I20260709 13:13:05.250273  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7698498e0447aa80cf38eb36feb228" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
W20260709 13:13:05.252554  1702 leader_election.cc:343] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.259186  1854 raft_consensus.cc:359] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:05.260398  1854 raft_consensus.cc:385] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.260782  1854 raft_consensus.cc:740] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.269124  1813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7698498e0447aa80cf38eb36feb228" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:05.269761  1853 tablet_bootstrap.cc:492] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: No bootstrap required, opened a new log
I20260709 13:13:05.269435  1854 consensus_queue.cc:260] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:05.270319  1853 ts_tablet_manager.cc:1403] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.014s
I20260709 13:13:05.271528  1854 ts_tablet_manager.cc:1434] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:13:05.273699  1854 tablet_bootstrap.cc:492] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c: Bootstrap starting.
I20260709 13:13:05.274276  1859 raft_consensus.cc:493] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.274839  1853 raft_consensus.cc:359] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:05.274807  1859 raft_consensus.cc:515] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:05.275864  1853 raft_consensus.cc:385] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.276171  1853 raft_consensus.cc:740] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.277184  1853 consensus_queue.cc:260] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:05.277882  1859 leader_election.cc:290] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117), ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999)
I20260709 13:13:05.280102  1853 ts_tablet_manager.cc:1434] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:05.280165  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde60f39a8f34d449385ee0d1308eef0" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:05.281478  1854 tablet_bootstrap.cc:654] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.281493  1853 tablet_bootstrap.cc:492] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
W20260709 13:13:05.282212  1705 leader_election.cc:343] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.282676  1705 leader_election.cc:304] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9a1d5065bea4270877bb24f205b8b9c; no voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:05.290657  1853 tablet_bootstrap.cc:654] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.295064  1855 tablet_bootstrap.cc:492] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963: No bootstrap required, opened a new log
I20260709 13:13:05.287684  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde60f39a8f34d449385ee0d1308eef0" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:05.295717  1855 ts_tablet_manager.cc:1403] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.037s
I20260709 13:13:05.296092  1664 raft_consensus.cc:2468] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 0.
I20260709 13:13:05.297827  1702 leader_election.cc:304] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:05.299554  1855 raft_consensus.cc:359] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.300420  1855 raft_consensus.cc:385] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.300746  1855 raft_consensus.cc:740] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.301846  1855 consensus_queue.cc:260] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.303377  1854 tablet_bootstrap.cc:492] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c: No bootstrap required, opened a new log
I20260709 13:13:05.303691  1853 tablet_bootstrap.cc:492] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: No bootstrap required, opened a new log
I20260709 13:13:05.303905  1854 ts_tablet_manager.cc:1403] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.011s
I20260709 13:13:05.304200  1853 ts_tablet_manager.cc:1403] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.005s
W20260709 13:13:05.300755  1705 leader_election.cc:343] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.306823  1859 raft_consensus.cc:2749] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:05.307530  1859 raft_consensus.cc:2804] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:05.307950  1859 raft_consensus.cc:493] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.308277  1859 raft_consensus.cc:3060] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.307194  1854 raft_consensus.cc:359] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.309042  1854 raft_consensus.cc:385] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.309360  1854 raft_consensus.cc:740] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.310920  1855 ts_tablet_manager.cc:1434] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.006s
I20260709 13:13:05.312326  1854 consensus_queue.cc:260] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.314724  1854 ts_tablet_manager.cc:1434] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:13:05.315713  1854 tablet_bootstrap.cc:492] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c: Bootstrap starting.
I20260709 13:13:05.316525  1853 raft_consensus.cc:359] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.318343  1853 raft_consensus.cc:385] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.320513  1853 raft_consensus.cc:740] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.322590  1853 consensus_queue.cc:260] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.317052  1859 raft_consensus.cc:515] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:05.324884  1854 tablet_bootstrap.cc:654] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.326222  1859 leader_election.cc:290] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 election: Requested vote from peers c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117), ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999)
I20260709 13:13:05.321527  1871 raft_consensus.cc:493] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.327081  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde60f39a8f34d449385ee0d1308eef0" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:05.327457  1855 tablet_bootstrap.cc:492] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963: Bootstrap starting.
I20260709 13:13:05.327025  1871 raft_consensus.cc:515] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
W20260709 13:13:05.328696  1705 leader_election.cc:343] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.329845  1871 leader_election.cc:290] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.330858  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde60f39a8f34d449385ee0d1308eef0" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:05.331526  1664 raft_consensus.cc:3060] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.333285  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fc0da4f04e4fe7b9f3d80290894500" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:05.333954  1812 raft_consensus.cc:2468] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 0.
I20260709 13:13:05.334997  1705 leader_election.cc:304] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:05.335839  1871 raft_consensus.cc:2804] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:05.336239  1871 raft_consensus.cc:493] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.336582  1871 raft_consensus.cc:3060] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.338377  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fc0da4f04e4fe7b9f3d80290894500" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:05.341821  1855 tablet_bootstrap.cc:654] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:05.342626  1702 leader_election.cc:343] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.343469  1860 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.344120  1860 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.359185  1853 ts_tablet_manager.cc:1434] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.004s
I20260709 13:13:05.360227  1871 raft_consensus.cc:515] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.362895  1860 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.364667  1871 leader_election.cc:290] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.365597  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fc0da4f04e4fe7b9f3d80290894500" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:05.366444  1812 raft_consensus.cc:3060] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.375250  1664 raft_consensus.cc:2468] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 1.
I20260709 13:13:05.376933  1812 raft_consensus.cc:2468] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 1.
I20260709 13:13:05.377605  1702 leader_election.cc:304] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:05.377986  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fc0da4f04e4fe7b9f3d80290894500" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:05.378232  1705 leader_election.cc:304] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:05.378832  1871 raft_consensus.cc:2804] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:05.379257  1872 raft_consensus.cc:2804] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:05.380131  1853 tablet_bootstrap.cc:492] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:05.380450  1872 raft_consensus.cc:697] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:05.382524  1872 consensus_queue.cc:237] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.384404  1854 tablet_bootstrap.cc:492] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c: No bootstrap required, opened a new log
I20260709 13:13:05.385020  1854 ts_tablet_manager.cc:1403] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.029s
I20260709 13:13:05.388813  1854 raft_consensus.cc:359] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.389775  1854 raft_consensus.cc:385] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:05.389249  1702 leader_election.cc:343] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.390156  1854 raft_consensus.cc:740] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.391284  1854 consensus_queue.cc:260] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.394070  1854 ts_tablet_manager.cc:1434] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:13:05.394145  1871 raft_consensus.cc:697] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:05.395280  1854 tablet_bootstrap.cc:492] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c: Bootstrap starting.
I20260709 13:13:05.395325  1871 consensus_queue.cc:237] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:05.396106  1853 tablet_bootstrap.cc:654] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.407440  1860 raft_consensus.cc:493] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.408000  1860 raft_consensus.cc:515] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.410020  1860 leader_election.cc:290] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.414225  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:05.414690  1813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:05.415705  1855 tablet_bootstrap.cc:492] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963: No bootstrap required, opened a new log
I20260709 13:13:05.416328  1855 ts_tablet_manager.cc:1403] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963: Time spent bootstrapping tablet: real 0.089s	user 0.026s	sys 0.022s
I20260709 13:13:05.416389  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:05.416941  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:05.417191  1739 raft_consensus.cc:2468] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae4ed633fe964b4895533e16055d45a3 in term 0.
I20260709 13:13:05.417898  1854 tablet_bootstrap.cc:654] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:05.416383  1630 leader_election.cc:343] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:05.419337  1630 leader_election.cc:343] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.420045  1630 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:05.420884  1860 raft_consensus.cc:2804] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:05.421248  1860 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.421681  1860 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.421602  1855 raft_consensus.cc:359] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.422489  1855 raft_consensus.cc:385] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.422787  1855 raft_consensus.cc:740] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.423761  1855 consensus_queue.cc:260] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.426136  1854 tablet_bootstrap.cc:492] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c: No bootstrap required, opened a new log
I20260709 13:13:05.426949  1854 ts_tablet_manager.cc:1403] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.005s
I20260709 13:13:05.431156  1854 raft_consensus.cc:359] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.432217  1854 raft_consensus.cc:385] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.432678  1854 raft_consensus.cc:740] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.434001  1855 ts_tablet_manager.cc:1434] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
W20260709 13:13:05.434098  1630 leader_election.cc:343] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.433849  1854 consensus_queue.cc:260] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.434692  1630 leader_election.cc:304] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3; no voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:05.438055  1855 tablet_bootstrap.cc:492] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963: Bootstrap starting.
I20260709 13:13:05.436774  1854 ts_tablet_manager.cc:1434] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:05.439939  1854 tablet_bootstrap.cc:492] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c: Bootstrap starting.
I20260709 13:13:05.440989  1853 tablet_bootstrap.cc:492] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: No bootstrap required, opened a new log
I20260709 13:13:05.441542  1853 ts_tablet_manager.cc:1403] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.001s
I20260709 13:13:05.442008  1560 catalog_manager.cc:5697] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 0 to 1, leader changed from <none> to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 1 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.444024  1560 catalog_manager.cc:5697] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 0 to 1, leader changed from <none> to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 1 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:05.444824  1853 raft_consensus.cc:359] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.445861  1853 raft_consensus.cc:385] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.446363  1853 raft_consensus.cc:740] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.447436  1853 consensus_queue.cc:260] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.433027  1860 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.449692  1854 tablet_bootstrap.cc:654] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.448681  1883 raft_consensus.cc:2749] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:05.450227  1855 tablet_bootstrap.cc:654] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.451056  1860 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 election: Requested vote from peers d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.458076  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:05.459020  1738 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.461961  1813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:05.462296  1855 tablet_bootstrap.cc:492] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963: No bootstrap required, opened a new log
I20260709 13:13:05.462800  1855 ts_tablet_manager.cc:1403] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
W20260709 13:13:05.463572  1630 leader_election.cc:343] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.468962  1855 raft_consensus.cc:359] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.469810  1855 raft_consensus.cc:385] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.470108  1855 raft_consensus.cc:740] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.470989  1855 consensus_queue.cc:260] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.473166  1738 raft_consensus.cc:2468] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae4ed633fe964b4895533e16055d45a3 in term 1.
I20260709 13:13:05.474535  1630 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:05.475193  1854 tablet_bootstrap.cc:492] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c: No bootstrap required, opened a new log
I20260709 13:13:05.475515  1860 raft_consensus.cc:2804] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:05.475770  1854 ts_tablet_manager.cc:1403] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.011s
I20260709 13:13:05.476045  1860 raft_consensus.cc:697] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 1 LEADER]: Becoming Leader. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Running, Role: LEADER
I20260709 13:13:05.476927  1860 consensus_queue.cc:237] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.478905  1854 raft_consensus.cc:359] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.479717  1854 raft_consensus.cc:385] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.480020  1854 raft_consensus.cc:740] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.480822  1854 consensus_queue.cc:260] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.482358  1855 ts_tablet_manager.cc:1434] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:13:05.483819  1854 ts_tablet_manager.cc:1434] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:13:05.485049  1854 tablet_bootstrap.cc:492] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c: Bootstrap starting.
I20260709 13:13:05.486387  1853 ts_tablet_manager.cc:1434] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.045s	user 0.013s	sys 0.019s
I20260709 13:13:05.487839  1855 tablet_bootstrap.cc:492] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963: Bootstrap starting.
I20260709 13:13:05.492988  1854 tablet_bootstrap.cc:654] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.487864  1853 tablet_bootstrap.cc:492] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:05.503665  1853 tablet_bootstrap.cc:654] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.505352  1854 tablet_bootstrap.cc:492] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c: No bootstrap required, opened a new log
I20260709 13:13:05.505925  1854 ts_tablet_manager.cc:1403] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.007s
I20260709 13:13:05.506232  1855 tablet_bootstrap.cc:654] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.505738  1561 catalog_manager.cc:5697] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae4ed633fe964b4895533e16055d45a3 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "ae4ed633fe964b4895533e16055d45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.508642  1854 raft_consensus.cc:359] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.509343  1854 raft_consensus.cc:385] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.509622  1854 raft_consensus.cc:740] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.510540  1854 consensus_queue.cc:260] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.512085  1854 ts_tablet_manager.cc:1434] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:05.513069  1854 tablet_bootstrap.cc:492] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c: Bootstrap starting.
I20260709 13:13:05.514969  1853 tablet_bootstrap.cc:492] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: No bootstrap required, opened a new log
I20260709 13:13:05.515554  1853 ts_tablet_manager.cc:1403] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.002s
I20260709 13:13:05.518886  1853 raft_consensus.cc:359] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.519660  1853 raft_consensus.cc:385] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.520002  1853 raft_consensus.cc:740] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.520643  1871 raft_consensus.cc:493] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.520788  1855 tablet_bootstrap.cc:492] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963: No bootstrap required, opened a new log
I20260709 13:13:05.523313  1854 tablet_bootstrap.cc:654] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.523823  1855 ts_tablet_manager.cc:1403] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.001s
I20260709 13:13:05.520787  1853 consensus_queue.cc:260] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.521209  1871 raft_consensus.cc:515] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.527470  1853 ts_tablet_manager.cc:1434] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:05.528218  1871 leader_election.cc:290] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.528955  1853 tablet_bootstrap.cc:492] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:05.530383  1813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:05.532039  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
W20260709 13:13:05.533969  1705 leader_election.cc:343] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.534682  1855 raft_consensus.cc:359] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
W20260709 13:13:05.535187  1702 leader_election.cc:343] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.535497  1855 raft_consensus.cc:385] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.535831  1855 raft_consensus.cc:740] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.536605  1855 consensus_queue.cc:260] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:05.539032  1860 raft_consensus.cc:493] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.539712  1860 raft_consensus.cc:515] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.542560  1860 leader_election.cc:290] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.542999  1855 ts_tablet_manager.cc:1434] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:13:05.544090  1855 tablet_bootstrap.cc:492] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963: Bootstrap starting.
I20260709 13:13:05.544394  1853 tablet_bootstrap.cc:654] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.545837  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb5210c336143b5a4828367cd7ba44f" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:05.546756  1738 raft_consensus.cc:2468] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae4ed633fe964b4895533e16055d45a3 in term 0.
I20260709 13:13:05.548399  1630 leader_election.cc:304] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:05.549449  1860 raft_consensus.cc:2804] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:05.549836  1860 raft_consensus.cc:493] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.550189  1860 raft_consensus.cc:3060] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.554003  1883 raft_consensus.cc:493] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.554711  1883 raft_consensus.cc:515] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.558190  1855 tablet_bootstrap.cc:654] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.558496  1853 tablet_bootstrap.cc:492] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: No bootstrap required, opened a new log
I20260709 13:13:05.559303  1853 ts_tablet_manager.cc:1403] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.006s
I20260709 13:13:05.562481  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:05.562844  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:05.563519  1738 raft_consensus.cc:2468] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae4ed633fe964b4895533e16055d45a3 in term 0.
I20260709 13:13:05.562492  1813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb5210c336143b5a4828367cd7ba44f" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
W20260709 13:13:05.564477  1630 leader_election.cc:343] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.565287  1630 leader_election.cc:304] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: c8be9e72dc574a25b0f47af26d38e963
W20260709 13:13:05.566234  1630 leader_election.cc:343] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.563781  1853 raft_consensus.cc:359] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.566407  1885 raft_consensus.cc:2804] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:05.566918  1885 raft_consensus.cc:493] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.567375  1885 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.557360  1883 leader_election.cc:290] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.568572  1702 leader_election.cc:304] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9a1d5065bea4270877bb24f205b8b9c; no voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:05.571676  1871 raft_consensus.cc:2749] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:05.573822  1853 raft_consensus.cc:385] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.574345  1853 raft_consensus.cc:740] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.575610  1853 consensus_queue.cc:260] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.576411  1860 raft_consensus.cc:515] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.579393  1853 ts_tablet_manager.cc:1434] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:13:05.580693  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb5210c336143b5a4828367cd7ba44f" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:05.583752  1813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb5210c336143b5a4828367cd7ba44f" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:05.584839  1885 raft_consensus.cc:515] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.587603  1738 raft_consensus.cc:3060] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.590756  1853 tablet_bootstrap.cc:492] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
W20260709 13:13:05.589491  1630 leader_election.cc:343] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.588825  1855 tablet_bootstrap.cc:492] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963: No bootstrap required, opened a new log
I20260709 13:13:05.593217  1885 leader_election.cc:290] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 election: Requested vote from peers d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.602607  1864 raft_consensus.cc:493] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.603194  1864 raft_consensus.cc:515] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:05.606362  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:05.607060  1739 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.585088  1860 leader_election.cc:290] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 election: Requested vote from peers d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.611650  1738 raft_consensus.cc:2468] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae4ed633fe964b4895533e16055d45a3 in term 1.
I20260709 13:13:05.614737  1864 leader_election.cc:290] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:05.600618  1855 ts_tablet_manager.cc:1403] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.007s
I20260709 13:13:05.624559  1864 raft_consensus.cc:493] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.625639  1630 leader_election.cc:304] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:05.625473  1864 raft_consensus.cc:515] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.627233  1860 raft_consensus.cc:2804] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:05.627863  1860 raft_consensus.cc:697] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 1 LEADER]: Becoming Leader. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Running, Role: LEADER
I20260709 13:13:05.629205  1864 leader_election.cc:290] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:05.628964  1860 consensus_queue.cc:237] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.634359  1855 raft_consensus.cc:359] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.636257  1855 raft_consensus.cc:385] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.636587  1855 raft_consensus.cc:740] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.637339  1855 consensus_queue.cc:260] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.623847  1853 tablet_bootstrap.cc:654] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.639964  1739 raft_consensus.cc:2468] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae4ed633fe964b4895533e16055d45a3 in term 1.
I20260709 13:13:05.641283  1630 leader_election.cc:304] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:05.642174  1885 raft_consensus.cc:2804] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:05.642995  1885 raft_consensus.cc:697] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 1 LEADER]: Becoming Leader. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Running, Role: LEADER
I20260709 13:13:05.643932  1885 consensus_queue.cc:237] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.649248  1854 tablet_bootstrap.cc:492] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c: No bootstrap required, opened a new log
I20260709 13:13:05.650070  1854 ts_tablet_manager.cc:1403] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c: Time spent bootstrapping tablet: real 0.137s	user 0.037s	sys 0.079s
I20260709 13:13:05.649765  1813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "ae4ed633fe964b4895533e16055d45a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:05.650826  1813 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.654917  1855 ts_tablet_manager.cc:1434] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:13:05.656824  1855 tablet_bootstrap.cc:492] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963: Bootstrap starting.
I20260709 13:13:05.656068  1559 catalog_manager.cc:5697] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae4ed633fe964b4895533e16055d45a3 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "ae4ed633fe964b4895533e16055d45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.653074  1854 raft_consensus.cc:359] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.663729  1855 tablet_bootstrap.cc:654] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.659755  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:05.688081  1854 raft_consensus.cc:385] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.658643  1813 raft_consensus.cc:2468] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae4ed633fe964b4895533e16055d45a3 in term 1.
I20260709 13:13:05.688827  1854 raft_consensus.cc:740] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.688977  1663 raft_consensus.cc:2468] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 0.
I20260709 13:13:05.689824  1854 consensus_queue.cc:260] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.690891  1776 leader_election.cc:304] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:05.692032  1900 raft_consensus.cc:2804] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:05.692350  1854 ts_tablet_manager.cc:1434] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.016s
I20260709 13:13:05.692507  1900 raft_consensus.cc:493] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.693174  1900 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.693861  1854 tablet_bootstrap.cc:492] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c: Bootstrap starting.
I20260709 13:13:05.700661  1855 tablet_bootstrap.cc:492] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963: No bootstrap required, opened a new log
I20260709 13:13:05.701275  1855 ts_tablet_manager.cc:1403] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.020s
I20260709 13:13:05.701431  1854 tablet_bootstrap.cc:654] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.702715  1900 raft_consensus.cc:515] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.704648  1855 raft_consensus.cc:359] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.705869  1855 raft_consensus.cc:385] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.706275  1855 raft_consensus.cc:740] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.706163  1560 catalog_manager.cc:5697] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae4ed633fe964b4895533e16055d45a3 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "ae4ed633fe964b4895533e16055d45a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.707618  1855 consensus_queue.cc:260] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.708849  1900 leader_election.cc:290] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:05.712854  1854 tablet_bootstrap.cc:492] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c: No bootstrap required, opened a new log
I20260709 13:13:05.713604  1854 ts_tablet_manager.cc:1403] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 13:13:05.715838  1855 ts_tablet_manager.cc:1434] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 13:13:05.706192  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:05.663534  1864 raft_consensus.cc:493] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.716989  1855 tablet_bootstrap.cc:492] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963: Bootstrap starting.
I20260709 13:13:05.716461  1854 raft_consensus.cc:359] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.717393  1854 raft_consensus.cc:385] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.717164  1864 raft_consensus.cc:515] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.717747  1854 raft_consensus.cc:740] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.718464  1854 consensus_queue.cc:260] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.720516  1854 ts_tablet_manager.cc:1434] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:05.716524  1663 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.724162  1855 tablet_bootstrap.cc:654] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.659166  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde60f39a8f34d449385ee0d1308eef0" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:05.730091  1664 raft_consensus.cc:2393] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8be9e72dc574a25b0f47af26d38e963 in current term 1: Already voted for candidate d9a1d5065bea4270877bb24f205b8b9c in this term.
I20260709 13:13:05.732491  1663 raft_consensus.cc:2468] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 1.
I20260709 13:13:05.733956  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde60f39a8f34d449385ee0d1308eef0" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:05.734186  1776 leader_election.cc:304] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:05.734532  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:05.735157  1738 raft_consensus.cc:2468] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 0.
I20260709 13:13:05.735378  1906 raft_consensus.cc:2804] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:05.736020  1906 raft_consensus.cc:697] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:05.736756  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:05.737089  1779 leader_election.cc:304] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963; no voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:05.737367  1738 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.736944  1906 consensus_queue.cc:237] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.738045  1900 raft_consensus.cc:3060] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.744899  1738 raft_consensus.cc:2468] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 1.
I20260709 13:13:05.745434  1900 raft_consensus.cc:2749] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:05.746340  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7698498e0447aa80cf38eb36feb228" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:05.747272  1663 raft_consensus.cc:2468] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 0.
I20260709 13:13:05.750957  1853 tablet_bootstrap.cc:492] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: No bootstrap required, opened a new log
I20260709 13:13:05.751802  1776 leader_election.cc:304] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:05.753043  1900 raft_consensus.cc:2804] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:05.751812  1853 ts_tablet_manager.cc:1403] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.021s
I20260709 13:13:05.753460  1900 raft_consensus.cc:493] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.753988  1900 raft_consensus.cc:3060] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.756259  1855 tablet_bootstrap.cc:492] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963: No bootstrap required, opened a new log
I20260709 13:13:05.756177  1871 raft_consensus.cc:493] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.756925  1855 ts_tablet_manager.cc:1403] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.012s
I20260709 13:13:05.756844  1871 raft_consensus.cc:515] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.758188  1864 leader_election.cc:290] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:05.759079  1871 leader_election.cc:290] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.759794  1855 raft_consensus.cc:359] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.760515  1855 raft_consensus.cc:385] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.760830  1855 raft_consensus.cc:740] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.760861  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:05.761691  1855 consensus_queue.cc:260] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.762928  1900 raft_consensus.cc:515] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.761703  1663 raft_consensus.cc:2468] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 0.
I20260709 13:13:05.763891  1855 ts_tablet_manager.cc:1434] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:05.764952  1855 tablet_bootstrap.cc:492] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963: Bootstrap starting.
I20260709 13:13:05.765115  1702 leader_election.cc:304] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:05.764680  1560 catalog_manager.cc:5697] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:05.767350  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7698498e0447aa80cf38eb36feb228" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:05.766426  1871 raft_consensus.cc:2804] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:05.768723  1853 raft_consensus.cc:359] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.765377  1900 leader_election.cc:290] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:05.769349  1853 raft_consensus.cc:385] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.768031  1871 raft_consensus.cc:493] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.769826  1853 raft_consensus.cc:740] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.769960  1871 raft_consensus.cc:3060] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.768016  1663 raft_consensus.cc:3060] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.770983  1853 consensus_queue.cc:260] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.771065  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7698498e0447aa80cf38eb36feb228" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:05.773741  1813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:05.773833  1738 raft_consensus.cc:2468] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 0.
I20260709 13:13:05.780987  1871 raft_consensus.cc:515] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
W20260709 13:13:05.781682  1705 leader_election.cc:343] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.783085  1855 tablet_bootstrap.cc:654] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.783614  1871 leader_election.cc:290] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:05.784930  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:05.785670  1664 raft_consensus.cc:3060] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.785722  1813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
W20260709 13:13:05.787370  1705 leader_election.cc:343] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:05.788100  1853 ts_tablet_manager.cc:1434] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:13:05.789270  1853 tablet_bootstrap.cc:492] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:05.792332  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7698498e0447aa80cf38eb36feb228" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:05.792995  1738 raft_consensus.cc:3060] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.795044  1663 raft_consensus.cc:2468] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 1.
I20260709 13:13:05.795372  1664 raft_consensus.cc:2468] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 1.
I20260709 13:13:05.795665  1853 tablet_bootstrap.cc:654] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.797109  1776 leader_election.cc:304] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:05.798183  1864 raft_consensus.cc:2804] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:05.798847  1864 raft_consensus.cc:697] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:05.800050  1864 consensus_queue.cc:237] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.802840  1702 leader_election.cc:304] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:05.806102  1871 raft_consensus.cc:2804] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:05.808314  1855 tablet_bootstrap.cc:492] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963: No bootstrap required, opened a new log
I20260709 13:13:05.809207  1855 ts_tablet_manager.cc:1403] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.002s
I20260709 13:13:05.811311  1871 raft_consensus.cc:697] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:05.812762  1871 consensus_queue.cc:237] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.813313  1855 raft_consensus.cc:359] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.814570  1855 raft_consensus.cc:385] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.815119  1855 raft_consensus.cc:740] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.816123  1855 consensus_queue.cc:260] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.818670  1855 ts_tablet_manager.cc:1434] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:05.819772  1855 tablet_bootstrap.cc:492] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963: Bootstrap starting.
I20260709 13:13:05.819995  1738 raft_consensus.cc:2468] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 1.
I20260709 13:13:05.827241  1855 tablet_bootstrap.cc:654] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.833039  1853 tablet_bootstrap.cc:492] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: No bootstrap required, opened a new log
I20260709 13:13:05.833588  1853 ts_tablet_manager.cc:1403] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.045s	user 0.028s	sys 0.008s
I20260709 13:13:05.833283  1559 catalog_manager.cc:5697] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:05.837179  1853 raft_consensus.cc:359] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.837071  1560 catalog_manager.cc:5697] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 0 to 1, leader changed from <none> to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 1 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.837998  1853 raft_consensus.cc:385] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.838419  1853 raft_consensus.cc:740] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.838635  1855 tablet_bootstrap.cc:492] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963: No bootstrap required, opened a new log
I20260709 13:13:05.839329  1855 ts_tablet_manager.cc:1403] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 13:13:05.839214  1853 consensus_queue.cc:260] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.841651  1853 ts_tablet_manager.cc:1434] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:05.842722  1855 raft_consensus.cc:359] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.843662  1855 raft_consensus.cc:385] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.843881  1853 tablet_bootstrap.cc:492] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:05.843971  1855 raft_consensus.cc:740] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.844703  1663 raft_consensus.cc:3060] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.845158  1855 consensus_queue.cc:260] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.847592  1855 ts_tablet_manager.cc:1434] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:05.851259  1853 tablet_bootstrap.cc:654] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:05.851307  1864 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.852012  1864 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.854543  1864 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:05.857034  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:05.861238  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:05.862505  1738 raft_consensus.cc:2393] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8be9e72dc574a25b0f47af26d38e963 in current term 1: Already voted for candidate ae4ed633fe964b4895533e16055d45a3 in this term.
I20260709 13:13:05.865895  1779 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963; no voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:05.867589  1871 consensus_queue.cc:1048] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:05.867853  1864 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.870898  1853 tablet_bootstrap.cc:492] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: No bootstrap required, opened a new log
I20260709 13:13:05.871500  1853 ts_tablet_manager.cc:1403] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.011s
I20260709 13:13:05.874738  1853 raft_consensus.cc:359] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.875453  1853 raft_consensus.cc:385] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:05.875744  1853 raft_consensus.cc:740] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:05.876622  1864 raft_consensus.cc:2749] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:05.876597  1853 consensus_queue.cc:260] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.878582  1853 ts_tablet_manager.cc:1434] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:05.886605  1872 consensus_queue.cc:1048] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:05.886888  1864 raft_consensus.cc:493] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.887341  1859 consensus_queue.cc:1048] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:05.887485  1864 raft_consensus.cc:515] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.890249  1864 leader_election.cc:290] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:05.891109  1664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:05.891976  1664 raft_consensus.cc:2393] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8be9e72dc574a25b0f47af26d38e963 in current term 1: Already voted for candidate d9a1d5065bea4270877bb24f205b8b9c in this term.
I20260709 13:13:05.891819  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:05.894245  1779 leader_election.cc:304] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963; no voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:05.897236  1860 consensus_queue.cc:1048] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:05.900041  1864 raft_consensus.cc:3060] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.905485  1872 consensus_queue.cc:1048] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:05.917121  1864 raft_consensus.cc:2749] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:05.929437  1885 consensus_queue.cc:1048] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:05.935762  1864 raft_consensus.cc:493] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.936451  1864 raft_consensus.cc:515] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:05.959681  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb5210c336143b5a4828367cd7ba44f" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:05.962324  1864 leader_election.cc:290] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:05.964623  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb5210c336143b5a4828367cd7ba44f" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:05.965950  1739 raft_consensus.cc:2393] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8be9e72dc574a25b0f47af26d38e963 in current term 1: Already voted for candidate ae4ed633fe964b4895533e16055d45a3 in this term.
I20260709 13:13:05.968048  1779 leader_election.cc:304] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963; no voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:05.970506  1864 raft_consensus.cc:3060] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.978282  1864 raft_consensus.cc:2749] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:06.039270  1885 consensus_queue.cc:1048] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:06.051429  1883 consensus_queue.cc:1048] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:06.062176  1864 raft_consensus.cc:493] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.062726  1864 raft_consensus.cc:515] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:06.064972  1864 leader_election.cc:290] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:06.065932  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:06.066193  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:06.066640  1663 raft_consensus.cc:2468] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 0.
I20260709 13:13:06.066874  1738 raft_consensus.cc:2468] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 0.
I20260709 13:13:06.067891  1776 leader_election.cc:304] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:06.068637  1864 raft_consensus.cc:2804] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:06.068995  1864 raft_consensus.cc:493] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.069382  1864 raft_consensus.cc:3060] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:06.074335  1864 raft_consensus.cc:515] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:06.075910  1864 leader_election.cc:290] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:06.076982  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:06.076889  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:06.077646  1738 raft_consensus.cc:3060] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:06.077772  1663 raft_consensus.cc:3060] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:06.082835  1738 raft_consensus.cc:2468] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 1.
I20260709 13:13:06.082850  1663 raft_consensus.cc:2468] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 1.
I20260709 13:13:06.083977  1779 leader_election.cc:304] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:06.084690  1864 raft_consensus.cc:2804] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:06.085165  1864 raft_consensus.cc:697] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:06.085845  1864 consensus_queue.cc:237] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:06.093360  1559 catalog_manager.cc:5697] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.103956  1864 raft_consensus.cc:493] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.104660  1864 raft_consensus.cc:515] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:06.106540  1864 leader_election.cc:290] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:06.107532  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3" is_pre_election: true
I20260709 13:13:06.107666  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:06.108619  1663 raft_consensus.cc:2468] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 0.
I20260709 13:13:06.108664  1738 raft_consensus.cc:2468] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 0.
I20260709 13:13:06.110150  1776 leader_election.cc:304] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:06.110932  1864 raft_consensus.cc:2804] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:06.111245  1864 raft_consensus.cc:493] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.111498  1864 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:06.116815  1864 raft_consensus.cc:515] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:06.118569  1864 leader_election.cc:290] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:06.119426  1663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:06.119608  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:06.120057  1663 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:06.120155  1738 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:06.124974  1738 raft_consensus.cc:2468] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 1.
I20260709 13:13:06.125336  1663 raft_consensus.cc:2468] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 1.
I20260709 13:13:06.126061  1779 leader_election.cc:304] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:06.126925  1864 raft_consensus.cc:2804] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:06.127454  1864 raft_consensus.cc:697] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:06.128204  1864 consensus_queue.cc:237] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:06.136451  1559 catalog_manager.cc:5697] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.173331  1885 consensus_queue.cc:1048] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:06.179716  1864 consensus_queue.cc:1048] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:06.185933  1860 consensus_queue.cc:1048] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:06.211410  1900 consensus_queue.cc:1048] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:06.225239  1859 consensus_queue.cc:1048] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:06.230018  1906 consensus_queue.cc:1048] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:06.242710  1864 consensus_queue.cc:1048] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:06.257737  1872 consensus_queue.cc:1048] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:06.280958 25395 ts_manager.cc:295] Set tserver state for ae4ed633fe964b4895533e16055d45a3 to MAINTENANCE_MODE
I20260709 13:13:06.281777 25395 tablet_server.cc:179] TabletServer@127.24.204.193:0 shutting down...
W20260709 13:13:06.300261  1702 consensus_peers.cc:597] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.318285 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:06.319433 25395 tablet_replica.cc:333] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: stopping tablet replica
I20260709 13:13:06.320084 25395 raft_consensus.cc:2243] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.320523 25395 raft_consensus.cc:2272] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.322428 25395 tablet_replica.cc:333] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: stopping tablet replica
I20260709 13:13:06.322992 25395 raft_consensus.cc:2243] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.323427 25395 raft_consensus.cc:2272] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.325958 25395 tablet_replica.cc:333] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: stopping tablet replica
I20260709 13:13:06.326539 25395 raft_consensus.cc:2243] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.326987 25395 raft_consensus.cc:2272] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.329258 25395 tablet_replica.cc:333] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: stopping tablet replica
I20260709 13:13:06.329881 25395 raft_consensus.cc:2243] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.330695 25395 raft_consensus.cc:2272] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.332862 25395 tablet_replica.cc:333] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: stopping tablet replica
I20260709 13:13:06.333453 25395 raft_consensus.cc:2243] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.333987 25395 raft_consensus.cc:2272] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.336356 25395 tablet_replica.cc:333] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: stopping tablet replica
I20260709 13:13:06.337087 25395 raft_consensus.cc:2243] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.337949 25395 raft_consensus.cc:2272] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.340284 25395 tablet_replica.cc:333] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: stopping tablet replica
I20260709 13:13:06.340840 25395 raft_consensus.cc:2243] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.341708 25395 raft_consensus.cc:2272] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.343901 25395 tablet_replica.cc:333] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: stopping tablet replica
W20260709 13:13:06.344210  1702 consensus_peers.cc:597] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.344460 25395 raft_consensus.cc:2243] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.344980 25395 raft_consensus.cc:2272] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.347039 25395 tablet_replica.cc:333] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: stopping tablet replica
I20260709 13:13:06.347575 25395 raft_consensus.cc:2243] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.348021 25395 raft_consensus.cc:2272] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.350572 25395 tablet_replica.cc:333] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: stopping tablet replica
I20260709 13:13:06.351064 25395 raft_consensus.cc:2243] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.351481 25395 raft_consensus.cc:2272] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.383026 25395 tablet_server.cc:196] TabletServer@127.24.204.193:0 shutdown complete.
I20260709 13:13:06.503316  1864 consensus_queue.cc:1048] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:06.521762  1776 consensus_peers.cc:597] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.594432  1900 consensus_queue.cc:1048] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:06.611089  1776 consensus_peers.cc:597] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:06.676357  1776 consensus_peers.cc:597] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:06.774596  1776 consensus_peers.cc:597] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:06.810468  1702 consensus_peers.cc:597] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:07.277621  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:07.422483  1702 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111) [suppressed 109 similar messages]
I20260709 13:13:07.434291  1906 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae4ed633fe964b4895533e16055d45a3)
I20260709 13:13:07.434499  1946 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae4ed633fe964b4895533e16055d45a3)
I20260709 13:13:07.435021  1906 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.435166  1946 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.437018  1906 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:07.438015  1946 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:07.438302  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:07.438980  1739 raft_consensus.cc:2468] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 1.
I20260709 13:13:07.440254  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:07.440192  1779 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:07.440992  1812 raft_consensus.cc:2468] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 1.
I20260709 13:13:07.441653  1906 raft_consensus.cc:2804] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.442031  1906 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae4ed633fe964b4895533e16055d45a3)
I20260709 13:13:07.442392  1906 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.442425  1705 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
W20260709 13:13:07.442967  1776 leader_election.cc:336] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
W20260709 13:13:07.443279  1702 leader_election.cc:336] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:07.443575  1946 raft_consensus.cc:2804] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.444051  1946 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae4ed633fe964b4895533e16055d45a3)
I20260709 13:13:07.444475  1946 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.448333  1906 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.450066  1946 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.450842  1906 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:07.452047  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:07.452692  1946 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:07.452926  1739 raft_consensus.cc:2393] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c8be9e72dc574a25b0f47af26d38e963 in current term 2: Already voted for candidate d9a1d5065bea4270877bb24f205b8b9c in this term.
I20260709 13:13:07.455425  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
W20260709 13:13:07.456305  1776 leader_election.cc:336] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:07.456537  1812 raft_consensus.cc:2393] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d9a1d5065bea4270877bb24f205b8b9c in current term 2: Already voted for candidate c8be9e72dc574a25b0f47af26d38e963 in this term.
I20260709 13:13:07.456947  1776 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963; no voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:07.457789  1906 raft_consensus.cc:2749] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:07.457849  1702 leader_election.cc:336] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:07.459082  1705 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9a1d5065bea4270877bb24f205b8b9c; no voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:07.459920  1946 raft_consensus.cc:2749] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:07.549914  1946 raft_consensus.cc:493] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae4ed633fe964b4895533e16055d45a3)
I20260709 13:13:07.550513  1946 raft_consensus.cc:515] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.552255  1946 leader_election.cc:290] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:07.553361  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb5210c336143b5a4828367cd7ba44f" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:07.555799  1906 raft_consensus.cc:493] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae4ed633fe964b4895533e16055d45a3)
W20260709 13:13:07.556509  1702 leader_election.cc:336] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:07.556293  1906 raft_consensus.cc:515] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.557024  1702 leader_election.cc:304] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9a1d5065bea4270877bb24f205b8b9c; no voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:07.557696  1946 raft_consensus.cc:2749] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:07.558501  1906 leader_election.cc:290] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:07.559669  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb5210c336143b5a4828367cd7ba44f" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:07.560256  1739 raft_consensus.cc:2468] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 1.
I20260709 13:13:07.561163  1779 leader_election.cc:304] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:07.561988  1906 raft_consensus.cc:2804] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.562366  1906 raft_consensus.cc:493] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae4ed633fe964b4895533e16055d45a3)
I20260709 13:13:07.562731  1906 raft_consensus.cc:3060] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:07.562886  1776 leader_election.cc:336] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:07.568145  1906 raft_consensus.cc:515] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.570094  1906 leader_election.cc:290] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:07.571261  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb5210c336143b5a4828367cd7ba44f" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:07.572036  1739 raft_consensus.cc:3060] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:07.574050  1776 leader_election.cc:336] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:07.577509  1739 raft_consensus.cc:2468] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 2.
I20260709 13:13:07.578578  1779 leader_election.cc:304] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: ae4ed633fe964b4895533e16055d45a3
I20260709 13:13:07.579304  1906 raft_consensus.cc:2804] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.579761  1906 raft_consensus.cc:697] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 2 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:07.580456  1906 consensus_queue.cc:237] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.587941  1560 catalog_manager.cc:5697] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 1 to 2, leader changed from ae4ed633fe964b4895533e16055d45a3 (127.24.204.193) to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:07.687945  1946 raft_consensus.cc:493] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae4ed633fe964b4895533e16055d45a3)
I20260709 13:13:07.688548  1946 raft_consensus.cc:515] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.689512  1906 raft_consensus.cc:493] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae4ed633fe964b4895533e16055d45a3)
I20260709 13:13:07.690160  1906 raft_consensus.cc:515] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.690901  1946 leader_election.cc:290] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:07.692337  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963" is_pre_election: true
I20260709 13:13:07.693087  1812 raft_consensus.cc:2468] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 1.
I20260709 13:13:07.694433  1705 leader_election.cc:304] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:07.695446  1946 raft_consensus.cc:2804] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.695897  1946 raft_consensus.cc:493] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae4ed633fe964b4895533e16055d45a3)
W20260709 13:13:07.696000  1702 leader_election.cc:336] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:07.696915  1946 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.696072  1906 leader_election.cc:290] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:07.697135  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
W20260709 13:13:07.699088  1776 leader_election.cc:336] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:07.703125  1946 raft_consensus.cc:515] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.704253  1739 raft_consensus.cc:2393] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8be9e72dc574a25b0f47af26d38e963 in current term 2: Already voted for candidate d9a1d5065bea4270877bb24f205b8b9c in this term.
I20260709 13:13:07.705466  1946 leader_election.cc:290] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:07.706692  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:07.707397  1812 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.707649  1779 leader_election.cc:304] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963; no voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c
W20260709 13:13:07.709436  1702 leader_election.cc:336] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:07.713325  1812 raft_consensus.cc:2468] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 2.
I20260709 13:13:07.714591  1906 raft_consensus.cc:2749] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:07.715320  1705 leader_election.cc:304] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: ae4ed633fe964b4895533e16055d45a3
I20260709 13:13:07.716310  1946 raft_consensus.cc:2804] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.716822  1946 raft_consensus.cc:697] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:07.717748  1946 consensus_queue.cc:237] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:07.725983  1560 catalog_manager.cc:5697] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 1 to 2, leader changed from ae4ed633fe964b4895533e16055d45a3 (127.24.204.193) to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 2 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.068570  1739 raft_consensus.cc:1275] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.070622  1906 consensus_queue.cc:1048] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:08.089596  1776 consensus_peers.cc:597] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:08.105996  1812 raft_consensus.cc:1275] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.107613  1946 consensus_queue.cc:1048] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:08.126358  1702 consensus_peers.cc:597] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.278820  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:08.615830  1702 consensus_peers.cc:597] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:08.643074  1702 consensus_peers.cc:597] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:08.791102  1776 consensus_peers.cc:597] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:09.064973  1943 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.065836  1943 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:09.068064  1943 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:09.069382  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c" is_pre_election: true
I20260709 13:13:09.070410  1739 raft_consensus.cc:2468] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 2.
I20260709 13:13:09.071843  1779 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
W20260709 13:13:09.072399  1776 leader_election.cc:336] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:09.072717  1943 raft_consensus.cc:2804] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.073189  1943 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.073518  1943 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.083873  1943 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:09.085811  1943 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:09.086939  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:09.087601  1739 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:09.090732  1776 leader_election.cc:336] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111)
I20260709 13:13:09.096100  1739 raft_consensus.cc:2468] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 3.
I20260709 13:13:09.097770  1779 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: ae4ed633fe964b4895533e16055d45a3
I20260709 13:13:09.098658  1943 raft_consensus.cc:2804] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:09.099728  1943 raft_consensus.cc:697] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:09.100759  1943 consensus_queue.cc:237] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:09.108388  1560 catalog_manager.cc:5697] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 1 to 3, leader changed from ae4ed633fe964b4895533e16055d45a3 (127.24.204.193) to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:09.130615  1776 consensus_peers.cc:597] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:09.131254  1776 consensus_peers.cc:597] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:09.220866  1702 consensus_peers.cc:597] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:09.279982  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:09.430256  1776 consensus_peers.cc:597] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:09.561638  1739 raft_consensus.cc:1275] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:09.563081  1959 consensus_queue.cc:1048] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:09.579245  1776 consensus_peers.cc:597] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:10.281145  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:10.378571  1702 consensus_peers.cc:597] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:10.535476  1776 consensus_peers.cc:597] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:11.184118  1702 consensus_peers.cc:597] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:11.282204  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:11.282691  1702 consensus_peers.cc:597] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:11.406584 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:11.414855  1971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:11.415129  1972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:11.417488  1974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:11.418529 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:11.420210 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:11.420409 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:11.420557 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602791420545 us; error 0 us; skew 500 ppm
I20260709 13:13:11.421114 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:11.424340 25395 webserver.cc:533] Webserver started at http://127.24.204.193:46335/ using document root <none> and password file <none>
I20260709 13:13:11.425002 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:11.425181 25395 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:13:11.429818 25395 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:13:11.434621  1979 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:11.435643 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:13:11.435977 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-0-root
uuid: "ae4ed633fe964b4895533e16055d45a3"
format_stamp: "Formatted at 2026-07-09 13:13:04 on dist-test-slave-qv7r"
I20260709 13:13:11.436522 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602508284650-25395-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:13:11.448248  1776 consensus_peers.cc:597] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:11.476235 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:11.477766 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:11.479447 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:11.483485  1986 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:13:11.532347 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:13:11.532815 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.050s	user 0.003s	sys 0.000s
I20260709 13:13:11.533170 25395 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:13:11.539203  1986 tablet_bootstrap.cc:492] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:11.554170  1986 tablet_bootstrap.cc:492] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.554908  1986 tablet_bootstrap.cc:492] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: Bootstrap complete.
I20260709 13:13:11.555464  1986 ts_tablet_manager.cc:1403] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:13:11.557765  1986 raft_consensus.cc:359] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.558326  1986 raft_consensus.cc:740] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.559128  1986 consensus_queue.cc:260] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.561806  1986 ts_tablet_manager.cc:1434] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:11.562495  1986 tablet_bootstrap.cc:492] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:11.576539  1986 tablet_bootstrap.cc:492] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.577620  1986 tablet_bootstrap.cc:492] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: Bootstrap complete.
I20260709 13:13:11.578329  1986 ts_tablet_manager.cc:1403] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:13:11.580430  1986 raft_consensus.cc:359] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.581019  1986 raft_consensus.cc:740] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.581693  1986 consensus_queue.cc:260] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.583148 25395 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:13:11.583361  1986 ts_tablet_manager.cc:1434] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:11.583494 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.050s	user 0.046s	sys 0.003s
I20260709 13:13:11.584290  1986 tablet_bootstrap.cc:492] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:11.603116  1986 tablet_bootstrap.cc:492] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.603991  1986 tablet_bootstrap.cc:492] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: Bootstrap complete.
I20260709 13:13:11.604766  1986 ts_tablet_manager.cc:1403] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:13:11.607597  1986 raft_consensus.cc:359] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.608376  1986 raft_consensus.cc:740] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.609287  1986 consensus_queue.cc:260] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.611162  1986 ts_tablet_manager.cc:1434] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:11.611887  1986 tablet_bootstrap.cc:492] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:11.626883  1986 tablet_bootstrap.cc:492] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.627736  1986 tablet_bootstrap.cc:492] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: Bootstrap complete.
I20260709 13:13:11.628475  1986 ts_tablet_manager.cc:1403] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:13:11.630765  1986 raft_consensus.cc:359] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.631306  1986 raft_consensus.cc:740] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.631985  1986 consensus_queue.cc:260] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.634189  1986 ts_tablet_manager.cc:1434] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:13:11.634985  1986 tablet_bootstrap.cc:492] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:11.651238  1986 tablet_bootstrap.cc:492] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.652737  1986 tablet_bootstrap.cc:492] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: Bootstrap complete.
I20260709 13:13:11.653384 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.193:45999
I20260709 13:13:11.653519  2048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.193:45999 every 8 connection(s)
I20260709 13:13:11.653678  1986 ts_tablet_manager.cc:1403] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:13:11.657015  1986 raft_consensus.cc:359] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.657881  1986 raft_consensus.cc:740] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.658893  1986 consensus_queue.cc:260] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.661914  1986 ts_tablet_manager.cc:1434] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:11.662951  1986 tablet_bootstrap.cc:492] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:11.670853 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:11.699268  1776 consensus_peers.cc:597] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:11.703763  2049 heartbeater.cc:344] Connected to a master server at 127.24.204.254:37997
I20260709 13:13:11.704519  2049 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:11.705971  2049 heartbeater.cc:507] Master 127.24.204.254:37997 requested a full tablet report, sending...
I20260709 13:13:11.727030  1560 ts_manager.cc:194] Re-registered known tserver with Master: ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999)
I20260709 13:13:11.727237  1812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
mode: GRACEFUL
new_leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:11.728106  1812 raft_consensus.cc:606] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Received request to transfer leadership to TS d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:11.728497  1986 tablet_bootstrap.cc:492] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.729542  1986 tablet_bootstrap.cc:492] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: Bootstrap complete.
I20260709 13:13:11.730552  1986 ts_tablet_manager.cc:1403] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.068s	user 0.031s	sys 0.016s
I20260709 13:13:11.731700  1812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
mode: GRACEFUL
new_leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:11.732364  1812 raft_consensus.cc:606] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Received request to transfer leadership to TS d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:11.736178  1986 raft_consensus.cc:359] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.737004  1986 raft_consensus.cc:740] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.737818  1986 consensus_queue.cc:260] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.739970  1986 ts_tablet_manager.cc:1434] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:11.740864  1986 tablet_bootstrap.cc:492] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:11.740798  1560 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59288
I20260709 13:13:11.745229  2049 heartbeater.cc:499] Master 127.24.204.254:37997 was elected leader, sending a full tablet report...
I20260709 13:13:11.746985  1739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
mode: GRACEFUL
new_leader_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:47114
I20260709 13:13:11.747596  1739 raft_consensus.cc:606] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Received request to transfer leadership to TS c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:11.749025 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:11.749619 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:11.750279 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:11.758354  1986 tablet_bootstrap.cc:492] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.759315  1986 tablet_bootstrap.cc:492] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: Bootstrap complete.
I20260709 13:13:11.759862  1986 ts_tablet_manager.cc:1403] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:13:11.761790  1986 raft_consensus.cc:359] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.762405  1986 raft_consensus.cc:740] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.763037  1986 consensus_queue.cc:260] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.764590  1986 ts_tablet_manager.cc:1434] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:11.765308  1986 tablet_bootstrap.cc:492] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:11.778628  1986 tablet_bootstrap.cc:492] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.779450  1986 tablet_bootstrap.cc:492] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: Bootstrap complete.
I20260709 13:13:11.780055  1986 ts_tablet_manager.cc:1403] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:13:11.782013  1986 raft_consensus.cc:359] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.782541  1986 raft_consensus.cc:740] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.783200  1986 consensus_queue.cc:260] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.784965  1986 ts_tablet_manager.cc:1434] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:11.785992  1986 tablet_bootstrap.cc:492] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:11.798861  1986 tablet_bootstrap.cc:492] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.799510  1986 tablet_bootstrap.cc:492] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: Bootstrap complete.
I20260709 13:13:11.800015  1986 ts_tablet_manager.cc:1403] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:13:11.801823  1986 raft_consensus.cc:359] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.802299  1986 raft_consensus.cc:740] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.802953  1986 consensus_queue.cc:260] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.804633  1986 ts_tablet_manager.cc:1434] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:11.805572  1986 tablet_bootstrap.cc:492] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: Bootstrap starting.
I20260709 13:13:11.818796  1986 tablet_bootstrap.cc:492] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.819607  1986 tablet_bootstrap.cc:492] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: Bootstrap complete.
I20260709 13:13:11.820114  1986 ts_tablet_manager.cc:1403] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: Time spent bootstrapping tablet: real 0.015s	user 0.001s	sys 0.011s
I20260709 13:13:11.822028  1986 raft_consensus.cc:359] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:11.822500  1986 raft_consensus.cc:740] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ed633fe964b4895533e16055d45a3, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.823069  1986 consensus_queue.cc:260] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } } peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } }
I20260709 13:13:11.824561  1986 ts_tablet_manager.cc:1434] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:11.843094  1967 raft_consensus.cc:993] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963: : Instructing follower d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:11.843827  2064 raft_consensus.cc:1081] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Signalling peer d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:11.846012  1739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:13:11.846525  1739 raft_consensus.cc:493] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.846773  1739 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.852355  1739 raft_consensus.cc:515] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.854203  1739 leader_election.cc:290] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:11.855261  2022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:11.855437  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:11.855895  2022 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.856115  1812 raft_consensus.cc:3055] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.856494  1812 raft_consensus.cc:740] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:11.857340  1812 consensus_queue.cc:260] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.858474  1812 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.861790  2022 raft_consensus.cc:2468] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 2.
I20260709 13:13:11.863060  1702 leader_election.cc:304] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:11.864107  1958 raft_consensus.cc:2804] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.865231  1812 raft_consensus.cc:2468] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 2.
I20260709 13:13:11.865628  1958 raft_consensus.cc:697] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:11.867009  1958 consensus_queue.cc:237] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:11.875226  1559 catalog_manager.cc:5697] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 1 to 2, leader changed from c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195) to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 2 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.961647  2023 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.975380  2023 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.046670  2065 raft_consensus.cc:993] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c: : Instructing follower c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:12.047180  1958 raft_consensus.cc:1081] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Signalling peer c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:12.049279  1812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:41760
I20260709 13:13:12.049831  1812 raft_consensus.cc:493] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.050192  1812 raft_consensus.cc:3060] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.051774  2023 raft_consensus.cc:3060] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.055986  1812 raft_consensus.cc:515] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.058916  2022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:12.058916  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c7463d4e64b06b544c409e60c363c" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:12.059758  2022 raft_consensus.cc:3060] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.059770  1739 raft_consensus.cc:3055] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.060297  1739 raft_consensus.cc:740] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:12.059800  1812 leader_election.cc:290] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:12.061448  1739 consensus_queue.cc:260] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.062904  1739 raft_consensus.cc:3060] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.068368  2022 raft_consensus.cc:2468] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 2.
I20260709 13:13:12.069790  1776 leader_election.cc:304] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:12.070916  2064 raft_consensus.cc:2804] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.071460  1739 raft_consensus.cc:2468] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 2.
I20260709 13:13:12.071661  2064 raft_consensus.cc:697] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 2 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:12.073004  2064 consensus_queue.cc:237] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.081051  1559 catalog_manager.cc:5697] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 1 to 2, leader changed from d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194) to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.177915  2075 raft_consensus.cc:993] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963: : Instructing follower d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:12.178516  1967 raft_consensus.cc:1081] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Signalling peer d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:12.180294  1739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:13:12.180835  1739 raft_consensus.cc:493] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.181185  1739 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.186614  1739 raft_consensus.cc:515] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.188555  1739 leader_election.cc:290] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:12.189275  2023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:12.189953  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:12.190182  2023 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.191015  1812 raft_consensus.cc:3055] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.191460  1812 raft_consensus.cc:740] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:12.192328  1812 consensus_queue.cc:260] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.193821  1812 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.201362  2023 raft_consensus.cc:2468] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 2.
I20260709 13:13:12.202750  1702 leader_election.cc:304] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:12.203118  1812 raft_consensus.cc:2468] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 2.
I20260709 13:13:12.203665  2076 raft_consensus.cc:2804] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.204205  2076 raft_consensus.cc:697] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:12.205209  2076 consensus_queue.cc:237] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.212767  1559 catalog_manager.cc:5697] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 1 to 2, leader changed from c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195) to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 2 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:12.283289  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:12.345371  1812 raft_consensus.cc:1275] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.346910  2076 consensus_queue.cc:1048] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.359056  2023 raft_consensus.cc:1275] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.360545  1958 consensus_queue.cc:1048] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.488636  1739 raft_consensus.cc:1275] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.490294  2075 consensus_queue.cc:1048] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.500366  2023 raft_consensus.cc:1275] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.501943  1967 consensus_queue.cc:1048] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.675028  2023 raft_consensus.cc:1275] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.676380  2076 consensus_queue.cc:1048] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.684427  1812 raft_consensus.cc:1275] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.685923  2065 consensus_queue.cc:1048] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.759397 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:12.768342  1738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
mode: GRACEFUL
new_leader_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:47114
I20260709 13:13:12.768926  1738 raft_consensus.cc:606] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Received request to transfer leadership to TS c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:12.771889  1812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
mode: GRACEFUL
new_leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:12.772497  1812 raft_consensus.cc:606] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Received request to transfer leadership to TS d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:12.775355  1738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
mode: GRACEFUL
new_leader_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:47114
I20260709 13:13:12.776038  1738 raft_consensus.cc:606] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Received request to transfer leadership to TS c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:12.777637 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:12.778270 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:12.778331  1958 raft_consensus.cc:993] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c: : Instructing follower c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:12.778985  2065 raft_consensus.cc:1081] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Signalling peer c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:12.779120 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:12.781234  1812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:41760
I20260709 13:13:12.782004  1812 raft_consensus.cc:493] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.782413  1812 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.788498  1812 raft_consensus.cc:515] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.790464  1812 leader_election.cc:290] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:12.791339  2023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:12.791536  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:12.792173  2023 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.792375  1738 raft_consensus.cc:3055] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.793085  1738 raft_consensus.cc:740] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:12.794248  1738 consensus_queue.cc:260] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.795728  1738 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.800185  2023 raft_consensus.cc:2468] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 3.
I20260709 13:13:12.801463  1776 leader_election.cc:304] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:12.802569  2064 raft_consensus.cc:2804] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:12.803336  2064 raft_consensus.cc:697] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:12.804451  1738 raft_consensus.cc:2468] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 3.
I20260709 13:13:12.804342  2064 consensus_queue.cc:237] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.811697  1560 catalog_manager.cc:5697] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 2 to 3, leader changed from d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194) to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.851826  1958 raft_consensus.cc:993] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c: : Instructing follower c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:12.852304  2065 raft_consensus.cc:1081] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Signalling peer c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:12.853839  1812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:41760
I20260709 13:13:12.854295  1812 raft_consensus.cc:493] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.854537  1812 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.859078  1812 raft_consensus.cc:515] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.860415  1812 leader_election.cc:290] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:12.861342  2023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:12.861508  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:12.862195  2023 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.862390  1738 raft_consensus.cc:3055] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.862921  1738 raft_consensus.cc:740] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:12.863762  1738 consensus_queue.cc:260] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.864905  1738 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.868175  2023 raft_consensus.cc:2468] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 3.
I20260709 13:13:12.869447  1776 leader_election.cc:304] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:12.870275  2064 raft_consensus.cc:2804] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:12.870769  2064 raft_consensus.cc:697] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:12.871392  1738 raft_consensus.cc:2468] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 3.
I20260709 13:13:12.871548  2064 consensus_queue.cc:237] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:12.878003  1560 catalog_manager.cc:5697] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 2 to 3, leader changed from d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194) to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.190636  2064 raft_consensus.cc:993] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963: : Instructing follower d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:13.191183  2075 raft_consensus.cc:1081] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Signalling peer d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:13.193038  1738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:13:13.193737  1738 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.194116  1738 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.199609  1738 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:13.201448  1738 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 4 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:13.202582  2023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:13.202803  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:13.203358  2023 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.203373  1812 raft_consensus.cc:3055] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:13.204051  1812 raft_consensus.cc:740] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:13.204921  1812 consensus_queue.cc:260] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:13.206265  1812 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.212383  2023 raft_consensus.cc:2468] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 4.
I20260709 13:13:13.213943  1812 raft_consensus.cc:2468] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 4.
I20260709 13:13:13.213876  1702 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:13.214869  2065 raft_consensus.cc:2804] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:13.215379  2065 raft_consensus.cc:697] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:13.216264  2065 consensus_queue.cc:237] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:13.223618  1560 catalog_manager.cc:5697] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 3 to 4, leader changed from c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195) to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 4 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.264729  1738 raft_consensus.cc:1275] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.266194  2075 consensus_queue.cc:1048] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.275928  2023 raft_consensus.cc:1275] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.277392  2064 consensus_queue.cc:1048] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:13.284468  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:13.306972  1739 raft_consensus.cc:1275] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.308786  2064 consensus_queue.cc:1048] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.318003  2023 raft_consensus.cc:1275] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.319746  2064 consensus_queue.cc:1048] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.597378  2022 raft_consensus.cc:1275] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:13.598841  2065 consensus_queue.cc:1048] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.607401  1812 raft_consensus.cc:1275] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:13.609228  1958 consensus_queue.cc:1048] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.787745 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:13.795122  1812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
mode: GRACEFUL
new_leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:13.795768  1812 raft_consensus.cc:606] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Received request to transfer leadership to TS d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:13.798537  1739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5fc0da4f04e4fe7b9f3d80290894500"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
mode: GRACEFUL
new_leader_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:47114
I20260709 13:13:13.799155  1739 raft_consensus.cc:606] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Received request to transfer leadership to TS c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:13.801744  1812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb7698498e0447aa80cf38eb36feb228"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
mode: GRACEFUL
new_leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:13.802243  1812 raft_consensus.cc:606] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Received request to transfer leadership to TS d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:13.803310 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:13.803797 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:13.804368 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:13.865716  2064 raft_consensus.cc:993] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963: : Instructing follower d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:13.866214  1967 raft_consensus.cc:1081] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Signalling peer d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:13.868073  1739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:13:13.868566  1739 raft_consensus.cc:493] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.868868  1739 raft_consensus.cc:3060] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.874874  1739 raft_consensus.cc:515] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:13.876811  1739 leader_election.cc:290] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:13.877523  2022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:13.878011  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:13.878332  2022 raft_consensus.cc:3060] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.878613  1812 raft_consensus.cc:3055] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.878913  1812 raft_consensus.cc:740] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:13.879772  1812 consensus_queue.cc:260] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:13.880992  1812 raft_consensus.cc:3060] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.885336  2022 raft_consensus.cc:2468] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 2.
I20260709 13:13:13.886684  1702 leader_election.cc:304] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:13.887588  1812 raft_consensus.cc:2468] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 2.
I20260709 13:13:13.887624  1958 raft_consensus.cc:2804] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:13.888392  1958 raft_consensus.cc:697] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:13.889334  1958 consensus_queue.cc:237] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:13.896914  1560 catalog_manager.cc:5697] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 1 to 2, leader changed from c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195) to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 2 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.957118  2076 raft_consensus.cc:993] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c: : Instructing follower c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:13.957602  2076 raft_consensus.cc:1081] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Signalling peer c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:13.959120  1812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5fc0da4f04e4fe7b9f3d80290894500"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:41760
I20260709 13:13:13.959693  1812 raft_consensus.cc:493] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.959998  1812 raft_consensus.cc:3060] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.964558  1812 raft_consensus.cc:515] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:13.965934  1812 leader_election.cc:290] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:13.966779  2022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fc0da4f04e4fe7b9f3d80290894500" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:13.967057  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5fc0da4f04e4fe7b9f3d80290894500" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:13.967489  2022 raft_consensus.cc:3060] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.967569  1739 raft_consensus.cc:3055] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.967959  1739 raft_consensus.cc:740] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:13.968775  1739 consensus_queue.cc:260] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:13.970081  1739 raft_consensus.cc:3060] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.974459  2022 raft_consensus.cc:2468] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 2.
I20260709 13:13:13.975649  1776 leader_election.cc:304] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:13.976338  1967 raft_consensus.cc:2804] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:13.976612  1739 raft_consensus.cc:2468] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 2.
I20260709 13:13:13.976835  1967 raft_consensus.cc:697] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 2 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:13.977820  1967 consensus_queue.cc:237] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:13.984441  1560 catalog_manager.cc:5697] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 1 to 2, leader changed from d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194) to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:14.285620  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:14.304181  2064 raft_consensus.cc:993] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963: : Instructing follower d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:14.304883  1967 raft_consensus.cc:1081] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Signalling peer d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:14.306463  1739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb7698498e0447aa80cf38eb36feb228"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:13:14.307011  1739 raft_consensus.cc:493] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.307356  1739 raft_consensus.cc:3060] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.312032  1739 raft_consensus.cc:515] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:14.313558  1739 leader_election.cc:290] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:14.314558  2022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7698498e0447aa80cf38eb36feb228" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:14.314615  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7698498e0447aa80cf38eb36feb228" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:14.315429  2022 raft_consensus.cc:3060] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.315459  1812 raft_consensus.cc:3055] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.315961  1812 raft_consensus.cc:740] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:14.316792  1812 consensus_queue.cc:260] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:14.318127  1812 raft_consensus.cc:3060] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.322687  2022 raft_consensus.cc:2468] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 2.
I20260709 13:13:14.323920  1702 leader_election.cc:304] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:14.324677  2076 raft_consensus.cc:2804] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.324589  1812 raft_consensus.cc:2468] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 2.
I20260709 13:13:14.325346  2076 raft_consensus.cc:697] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:14.326282  2076 consensus_queue.cc:237] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:14.333994  1560 catalog_manager.cc:5697] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 1 to 2, leader changed from c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195) to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 2 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.339048  2022 raft_consensus.cc:1275] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.340718  2076 consensus_queue.cc:1048] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.351709  1812 raft_consensus.cc:1275] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.354652  2076 consensus_queue.cc:1048] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.384896  1739 raft_consensus.cc:1275] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.386222  1967 consensus_queue.cc:1048] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.395979  2022 raft_consensus.cc:1275] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.397631  1967 consensus_queue.cc:1048] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.810518 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:14.818115  1812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
mode: GRACEFUL
new_leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:14.818727  1812 raft_consensus.cc:606] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Received request to transfer leadership to TS d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:14.821825  1739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
mode: GRACEFUL
new_leader_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:47114
I20260709 13:13:14.822449  1739 raft_consensus.cc:606] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Received request to transfer leadership to TS c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:14.823550  2022 raft_consensus.cc:1275] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.825122  2076 consensus_queue.cc:1048] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.825479  1739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
mode: GRACEFUL
new_leader_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:47114
I20260709 13:13:14.826109  1739 raft_consensus.cc:606] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Received request to transfer leadership to TS c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:14.827268 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:14.827945 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:14.828717 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:14.835146  1812 raft_consensus.cc:1275] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.837064  2104 consensus_queue.cc:1048] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.137513  2076 raft_consensus.cc:993] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c: : Instructing follower c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:15.138171  2104 raft_consensus.cc:1081] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Signalling peer c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:15.139853  1812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:41760
I20260709 13:13:15.140386  1812 raft_consensus.cc:493] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.140730  1812 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.145756  1812 raft_consensus.cc:515] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.147457  1812 leader_election.cc:290] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 5 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:15.148340  2022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:15.148734  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871b44fd2fc2416e98fb3716c3f1a185" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:15.149047  2022 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.149327  1739 raft_consensus.cc:3055] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:15.149758  1739 raft_consensus.cc:740] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:15.150418  1739 consensus_queue.cc:260] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.151400  1739 raft_consensus.cc:3060] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:15.155213  2022 raft_consensus.cc:2468] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 5.
I20260709 13:13:15.156500  1776 leader_election.cc:304] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:15.156878  1739 raft_consensus.cc:2468] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 5.
I20260709 13:13:15.157322  2118 raft_consensus.cc:2804] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:15.157873  2118 raft_consensus.cc:697] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 5 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:15.158944  2118 consensus_queue.cc:237] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.166227  1560 catalog_manager.cc:5697] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 4 to 5, leader changed from d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194) to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 5 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.206822  2117 raft_consensus.cc:993] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963: : Instructing follower d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:15.207273  2118 raft_consensus.cc:1081] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Signalling peer d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:15.208801  1739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:13:15.209306  1739 raft_consensus.cc:493] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.209771  1739 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.214996  1739 raft_consensus.cc:515] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.216593  1739 leader_election.cc:290] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 4 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:15.217334  2022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:15.217916  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081e891dd1fd4d53aab4dbaad1968a16" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:15.217991  2022 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.218559  1812 raft_consensus.cc:3055] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:15.218849  1812 raft_consensus.cc:740] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:15.219610  1812 consensus_queue.cc:260] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.220777  1812 raft_consensus.cc:3060] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.225077  2022 raft_consensus.cc:2468] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 4.
I20260709 13:13:15.226315  1702 leader_election.cc:304] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:15.227128  2104 raft_consensus.cc:2804] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:15.227502  1812 raft_consensus.cc:2468] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 4.
I20260709 13:13:15.227551  2104 raft_consensus.cc:697] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:15.228607  2104 consensus_queue.cc:237] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.235752  1560 catalog_manager.cc:5697] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 3 to 4, leader changed from c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195) to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 4 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:15.286855  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:15.334172  2076 raft_consensus.cc:993] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c: : Instructing follower c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:15.334755  2104 raft_consensus.cc:1081] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Signalling peer c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:15.336504  1812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:41760
I20260709 13:13:15.336974  1812 raft_consensus.cc:493] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.337278  1812 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.342854  1812 raft_consensus.cc:515] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.344331  1812 leader_election.cc:290] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:15.345484  2022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:15.345495  1739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:15.346422  2022 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.346758  1739 raft_consensus.cc:3055] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:15.347118  1739 raft_consensus.cc:740] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:15.347733  1739 consensus_queue.cc:260] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.348694  1739 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.352487  2022 raft_consensus.cc:2468] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 3.
I20260709 13:13:15.353894  1776 leader_election.cc:304] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:15.354070  1739 raft_consensus.cc:2468] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 3.
I20260709 13:13:15.354674  2118 raft_consensus.cc:2804] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:15.355146  2118 raft_consensus.cc:697] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:15.355818  2118 consensus_queue.cc:237] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.362646  1560 catalog_manager.cc:5697] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 2 to 3, leader changed from d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194) to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.659660  2022 raft_consensus.cc:1275] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 5 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:15.661120  2118 consensus_queue.cc:1048] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:15.671921  1739 raft_consensus.cc:1275] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 5 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:15.673926  2118 consensus_queue.cc:1048] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:15.747361  2022 raft_consensus.cc:1275] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:15.748880  2125 consensus_queue.cc:1048] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:15.758548  1812 raft_consensus.cc:1275] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:15.759855  2133 consensus_queue.cc:1048] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:15.846508 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:15.855221  1812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
mode: GRACEFUL
new_leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:15.855785  1812 raft_consensus.cc:606] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Received request to transfer leadership to TS d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:15.858816  1739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
mode: GRACEFUL
new_leader_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:47114
I20260709 13:13:15.859397  1739 raft_consensus.cc:606] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Received request to transfer leadership to TS c8be9e72dc574a25b0f47af26d38e963
I20260709 13:13:15.862308  1812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
mode: GRACEFUL
new_leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:13:15.862851  1812 raft_consensus.cc:606] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Received request to transfer leadership to TS d9a1d5065bea4270877bb24f205b8b9c
I20260709 13:13:15.864298 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:15.864878 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:15.865684 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:15.894917  1739 raft_consensus.cc:1275] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:15.896301  2118 consensus_queue.cc:1048] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:15.900195  2022 raft_consensus.cc:1275] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:15.901419  2118 consensus_queue.cc:1048] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:15.903605  2117 raft_consensus.cc:993] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963: : Instructing follower d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:15.906637  2118 raft_consensus.cc:1081] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Signalling peer d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:15.908303  1739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:13:15.908743  1739 raft_consensus.cc:493] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.909041  1739 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.914959  1739 raft_consensus.cc:515] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.917668  1739 leader_election.cc:290] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 4 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:15.917706  1812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:15.918435  1812 raft_consensus.cc:3055] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:15.918794  1812 raft_consensus.cc:740] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:15.919096  2023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "177ae968f9d9445d95210be795edd6b6" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:15.919592  1812 consensus_queue.cc:260] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.920773  1812 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:15.928485  1812 raft_consensus.cc:2468] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 4.
I20260709 13:13:15.929811  1705 leader_election.cc:304] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8be9e72dc574a25b0f47af26d38e963, d9a1d5065bea4270877bb24f205b8b9c; no voters: ae4ed633fe964b4895533e16055d45a3
I20260709 13:13:15.930792  2104 raft_consensus.cc:2804] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:15.931300  2104 raft_consensus.cc:697] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:15.932193  2104 consensus_queue.cc:237] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:15.939996  1561 catalog_manager.cc:5697] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 3 to 4, leader changed from c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195) to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 4 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:16.288045  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:16.332300  1812 raft_consensus.cc:1275] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:16.333768  2104 consensus_queue.cc:1048] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:16.341817  2022 raft_consensus.cc:3060] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.348810  2117 raft_consensus.cc:993] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963: : Instructing follower d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:16.349411  2118 raft_consensus.cc:1081] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Signalling peer d9a1d5065bea4270877bb24f205b8b9c to start an election
I20260709 13:13:16.351263  1738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128"
dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:13:16.351907  1738 raft_consensus.cc:493] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.352308  1738 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.353111  2022 raft_consensus.cc:1275] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:16.355007  2133 consensus_queue.cc:1048] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:16.360841  2133 raft_consensus.cc:993] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c: : Instructing follower c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:16.360625  1738 raft_consensus.cc:515] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:16.361424  2133 raft_consensus.cc:1081] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Signalling peer c8be9e72dc574a25b0f47af26d38e963 to start an election
I20260709 13:13:16.363555  1812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102"
dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
 from {username='slave'} at 127.0.0.1:41760
I20260709 13:13:16.364118  1738 leader_election.cc:290] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 4 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195:39117)
I20260709 13:13:16.364791  1812 raft_consensus.cc:493] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.365324  1811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c8be9e72dc574a25b0f47af26d38e963"
I20260709 13:13:16.365648  1812 raft_consensus.cc:3060] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:16.364984  2022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945831181cee465ab4e48bf8a4d3e128" candidate_uuid: "d9a1d5065bea4270877bb24f205b8b9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:16.366025  1811 raft_consensus.cc:3055] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:16.366627  1811 raft_consensus.cc:740] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:16.366679  2022 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.367517  1811 consensus_queue.cc:260] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:16.372692  1811 raft_consensus.cc:3060] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:16.373768  1812 raft_consensus.cc:515] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:16.374579  2022 raft_consensus.cc:2468] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 4.
I20260709 13:13:16.376129  1702 leader_election.cc:304] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, d9a1d5065bea4270877bb24f205b8b9c; no voters: 
I20260709 13:13:16.377013  2104 raft_consensus.cc:2804] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:16.377032  2022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae4ed633fe964b4895533e16055d45a3"
I20260709 13:13:16.377540  2104 raft_consensus.cc:697] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Becoming Leader. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:16.377764  2022 raft_consensus.cc:3060] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:16.378279  2104 consensus_queue.cc:237] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:16.382462  1812 leader_election.cc:290] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: Requested vote from peers ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999), d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255)
I20260709 13:13:16.384112  1811 raft_consensus.cc:2468] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a1d5065bea4270877bb24f205b8b9c in term 4.
I20260709 13:13:16.384307  2022 raft_consensus.cc:2468] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 3.
I20260709 13:13:16.384578  1738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4444d2895c432f9ab8d1257f52d102" candidate_uuid: "c8be9e72dc574a25b0f47af26d38e963" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9a1d5065bea4270877bb24f205b8b9c"
I20260709 13:13:16.385170  1738 raft_consensus.cc:3055] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:16.385452  1738 raft_consensus.cc:740] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9a1d5065bea4270877bb24f205b8b9c, State: Running, Role: LEADER
I20260709 13:13:16.385672  1776 leader_election.cc:304] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4ed633fe964b4895533e16055d45a3, c8be9e72dc574a25b0f47af26d38e963; no voters: 
I20260709 13:13:16.386204  1738 consensus_queue.cc:260] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:16.386447  2118 raft_consensus.cc:2804] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:16.387099  2118 raft_consensus.cc:697] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Becoming Leader. State: Replica: c8be9e72dc574a25b0f47af26d38e963, State: Running, Role: LEADER
I20260709 13:13:16.386647  1560 catalog_manager.cc:5697] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c reported cstate change: term changed from 3 to 4, leader changed from c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195) to d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194). New cstate: current_term: 4 leader_uuid: "d9a1d5065bea4270877bb24f205b8b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.387413  1738 raft_consensus.cc:3060] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:16.387898  2118 consensus_queue.cc:237] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } }
I20260709 13:13:16.393822  1738 raft_consensus.cc:2468] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8be9e72dc574a25b0f47af26d38e963 in term 3.
I20260709 13:13:16.399609  1560 catalog_manager.cc:5697] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 reported cstate change: term changed from 2 to 3, leader changed from d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194) to c8be9e72dc574a25b0f47af26d38e963 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "c8be9e72dc574a25b0f47af26d38e963" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.820690  2022 raft_consensus.cc:1275] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:16.822144  2118 consensus_queue.cc:1048] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ed633fe964b4895533e16055d45a3" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:16.831785  1738 raft_consensus.cc:1275] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Refusing update from remote peer c8be9e72dc574a25b0f47af26d38e963: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:16.833503  2118 consensus_queue.cc:1048] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a1d5065bea4270877bb24f205b8b9c" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:16.873219 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:16.899683  1811 raft_consensus.cc:1275] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Refusing update from remote peer d9a1d5065bea4270877bb24f205b8b9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:16.901155  2104 consensus_queue.cc:1048] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be9e72dc574a25b0f47af26d38e963" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:16.906591 25395 tablet_server.cc:179] TabletServer@127.24.204.193:45999 shutting down...
W20260709 13:13:16.917025  1702 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 90 similar messages]
W20260709 13:13:16.929541  1702 consensus_peers.cc:597] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:16.947747 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:16.948714 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:16.949396 25395 raft_consensus.cc:2243] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.950106 25395 raft_consensus.cc:2272] T cde60f39a8f34d449385ee0d1308eef0 P ae4ed633fe964b4895533e16055d45a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.952154 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:16.952759 25395 raft_consensus.cc:2243] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.953218 25395 raft_consensus.cc:2272] T 7b4444d2895c432f9ab8d1257f52d102 P ae4ed633fe964b4895533e16055d45a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.956023 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:16.956651 25395 raft_consensus.cc:2243] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.957118 25395 raft_consensus.cc:2272] T 945831181cee465ab4e48bf8a4d3e128 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.959457 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:16.960035 25395 raft_consensus.cc:2243] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.960495 25395 raft_consensus.cc:2272] T 871b44fd2fc2416e98fb3716c3f1a185 P ae4ed633fe964b4895533e16055d45a3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.962992 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:16.964337 25395 raft_consensus.cc:2243] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.964924 25395 raft_consensus.cc:2272] T b5fc0da4f04e4fe7b9f3d80290894500 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.967788 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:16.968604 25395 raft_consensus.cc:2243] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.969190 25395 raft_consensus.cc:2272] T 081e891dd1fd4d53aab4dbaad1968a16 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.971701 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:16.972247 25395 raft_consensus.cc:2243] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.972709 25395 raft_consensus.cc:2272] T 177ae968f9d9445d95210be795edd6b6 P ae4ed633fe964b4895533e16055d45a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.975435 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:16.976042 25395 raft_consensus.cc:2243] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.976512 25395 raft_consensus.cc:2272] T ce9c7463d4e64b06b544c409e60c363c P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.978528 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:16.979069 25395 raft_consensus.cc:2243] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.979529 25395 raft_consensus.cc:2272] T eb7698498e0447aa80cf38eb36feb228 P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.981484 25395 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:16.982106 25395 raft_consensus.cc:2243] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.982491 25395 raft_consensus.cc:2272] T 0fb5210c336143b5a4828367cd7ba44f P ae4ed633fe964b4895533e16055d45a3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:16.990352  1776 consensus_peers.cc:597] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.015410 25395 tablet_server.cc:196] TabletServer@127.24.204.193:45999 shutdown complete.
I20260709 13:13:17.035656 25395 tablet_server.cc:179] TabletServer@127.24.204.194:0 shutting down...
W20260709 13:13:17.061887  1779 consensus_peers.cc:597] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 -> Peer d9a1d5065bea4270877bb24f205b8b9c (127.24.204.194:41255): Couldn't send request to peer d9a1d5065bea4270877bb24f205b8b9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.069543 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:17.070679 25395 tablet_replica.cc:333] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c: stopping tablet replica
I20260709 13:13:17.071348 25395 raft_consensus.cc:2243] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.072243 25395 raft_consensus.cc:2272] T 945831181cee465ab4e48bf8a4d3e128 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.075086 25395 tablet_replica.cc:333] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c: stopping tablet replica
I20260709 13:13:17.075726 25395 raft_consensus.cc:2243] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.076167 25395 raft_consensus.cc:2272] T 7b4444d2895c432f9ab8d1257f52d102 P d9a1d5065bea4270877bb24f205b8b9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.079003 25395 tablet_replica.cc:333] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c: stopping tablet replica
I20260709 13:13:17.079559 25395 raft_consensus.cc:2243] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.080322 25395 raft_consensus.cc:2272] T 177ae968f9d9445d95210be795edd6b6 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.083331 25395 tablet_replica.cc:333] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c: stopping tablet replica
I20260709 13:13:17.084197 25395 raft_consensus.cc:2243] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.084764 25395 raft_consensus.cc:2272] T ce9c7463d4e64b06b544c409e60c363c P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.087550 25395 tablet_replica.cc:333] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c: stopping tablet replica
I20260709 13:13:17.088183 25395 raft_consensus.cc:2243] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:13:17.088501  1776 consensus_peers.cc:597] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.089118 25395 raft_consensus.cc:2272] T 081e891dd1fd4d53aab4dbaad1968a16 P d9a1d5065bea4270877bb24f205b8b9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.091316 25395 tablet_replica.cc:333] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c: stopping tablet replica
I20260709 13:13:17.092033 25395 raft_consensus.cc:2243] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.092449 25395 raft_consensus.cc:2272] T b5fc0da4f04e4fe7b9f3d80290894500 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.094589 25395 tablet_replica.cc:333] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c: stopping tablet replica
I20260709 13:13:17.095106 25395 raft_consensus.cc:2243] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.095475 25395 raft_consensus.cc:2272] T 871b44fd2fc2416e98fb3716c3f1a185 P d9a1d5065bea4270877bb24f205b8b9c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.097483 25395 tablet_replica.cc:333] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c: stopping tablet replica
I20260709 13:13:17.098248 25395 raft_consensus.cc:2243] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.099252 25395 raft_consensus.cc:2272] T cde60f39a8f34d449385ee0d1308eef0 P d9a1d5065bea4270877bb24f205b8b9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.101434 25395 tablet_replica.cc:333] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c: stopping tablet replica
I20260709 13:13:17.102020 25395 raft_consensus.cc:2243] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.102447 25395 raft_consensus.cc:2272] T 0fb5210c336143b5a4828367cd7ba44f P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.104544 25395 tablet_replica.cc:333] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c: stopping tablet replica
I20260709 13:13:17.105006 25395 raft_consensus.cc:2243] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.105803 25395 raft_consensus.cc:2272] T eb7698498e0447aa80cf38eb36feb228 P d9a1d5065bea4270877bb24f205b8b9c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.113181  1776 consensus_peers.cc:597] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.130817 25395 tablet_server.cc:196] TabletServer@127.24.204.194:0 shutdown complete.
I20260709 13:13:17.157529 25395 tablet_server.cc:179] TabletServer@127.24.204.195:0 shutting down...
W20260709 13:13:17.176343  1776 consensus_peers.cc:597] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 -> Peer ae4ed633fe964b4895533e16055d45a3 (127.24.204.193:45999): Couldn't send request to peer ae4ed633fe964b4895533e16055d45a3. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:45999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.189494 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:17.190542 25395 tablet_replica.cc:333] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963: stopping tablet replica
I20260709 13:13:17.191382 25395 raft_consensus.cc:2243] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.192274 25395 raft_consensus.cc:2272] T 7b4444d2895c432f9ab8d1257f52d102 P c8be9e72dc574a25b0f47af26d38e963 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.195251 25395 tablet_replica.cc:333] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963: stopping tablet replica
I20260709 13:13:17.196147 25395 raft_consensus.cc:2243] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.197141 25395 raft_consensus.cc:2272] T ce9c7463d4e64b06b544c409e60c363c P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.199880 25395 tablet_replica.cc:333] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963: stopping tablet replica
I20260709 13:13:17.200497 25395 raft_consensus.cc:2243] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.200978 25395 raft_consensus.cc:2272] T 177ae968f9d9445d95210be795edd6b6 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.203701 25395 tablet_replica.cc:333] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963: stopping tablet replica
I20260709 13:13:17.204340 25395 raft_consensus.cc:2243] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.204876 25395 raft_consensus.cc:2272] T cde60f39a8f34d449385ee0d1308eef0 P c8be9e72dc574a25b0f47af26d38e963 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.207194 25395 tablet_replica.cc:333] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963: stopping tablet replica
I20260709 13:13:17.207835 25395 raft_consensus.cc:2243] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.208312 25395 raft_consensus.cc:2272] T 081e891dd1fd4d53aab4dbaad1968a16 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.210865 25395 tablet_replica.cc:333] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963: stopping tablet replica
I20260709 13:13:17.211475 25395 raft_consensus.cc:2243] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.212334 25395 raft_consensus.cc:2272] T b5fc0da4f04e4fe7b9f3d80290894500 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.214789 25395 tablet_replica.cc:333] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963: stopping tablet replica
I20260709 13:13:17.215404 25395 raft_consensus.cc:2243] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.216293 25395 raft_consensus.cc:2272] T 871b44fd2fc2416e98fb3716c3f1a185 P c8be9e72dc574a25b0f47af26d38e963 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.218588 25395 tablet_replica.cc:333] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963: stopping tablet replica
I20260709 13:13:17.219215 25395 raft_consensus.cc:2243] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.219695 25395 raft_consensus.cc:2272] T 945831181cee465ab4e48bf8a4d3e128 P c8be9e72dc574a25b0f47af26d38e963 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.222651 25395 tablet_replica.cc:333] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963: stopping tablet replica
I20260709 13:13:17.223188 25395 raft_consensus.cc:2243] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.224032 25395 raft_consensus.cc:2272] T 0fb5210c336143b5a4828367cd7ba44f P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.226490 25395 tablet_replica.cc:333] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963: stopping tablet replica
I20260709 13:13:17.227223 25395 raft_consensus.cc:2243] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.227684 25395 raft_consensus.cc:2272] T eb7698498e0447aa80cf38eb36feb228 P c8be9e72dc574a25b0f47af26d38e963 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.263455 25395 tablet_server.cc:196] TabletServer@127.24.204.195:0 shutdown complete.
W20260709 13:13:17.289420  1610 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:17.290462 25395 master.cc:562] Master@127.24.204.254:37997 shutting down...
I20260709 13:13:17.314960 25395 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.315514 25395 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.315814 25395 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5cf5da72888c4c53ac30c54faf06c475: stopping tablet replica
I20260709 13:13:17.339128 25395 master.cc:584] Master@127.24.204.254:37997 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13318 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:13:17.384513 25395 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.204.254:39635
I20260709 13:13:17.386019 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:17.392066  2153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:17.392184  2154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:17.393635  2156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:17.395167 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:17.396315 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:17.396626 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:17.396876 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602797396852 us; error 0 us; skew 500 ppm
I20260709 13:13:17.397464 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:17.400189 25395 webserver.cc:533] Webserver started at http://127.24.204.254:38665/ using document root <none> and password file <none>
I20260709 13:13:17.400771 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:17.401018 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:17.401326 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:17.402607 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/master-0-root/instance:
uuid: "217bc0f9fb354609bb122e3415a9d078"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-qv7r"
I20260709 13:13:17.407814 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:17.411499  2161 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.412426 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:17.412799 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/master-0-root
uuid: "217bc0f9fb354609bb122e3415a9d078"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-qv7r"
I20260709 13:13:17.413048 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:17.426080 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:17.427264 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:17.467960 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.254:39635
I20260709 13:13:17.468066  2212 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.254:39635 every 8 connection(s)
I20260709 13:13:17.472110  2213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.483577  2213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078: Bootstrap starting.
I20260709 13:13:17.488361  2213 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.492882  2213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078: No bootstrap required, opened a new log
I20260709 13:13:17.495187  2213 raft_consensus.cc:359] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217bc0f9fb354609bb122e3415a9d078" member_type: VOTER }
I20260709 13:13:17.495553  2213 raft_consensus.cc:385] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.495824  2213 raft_consensus.cc:740] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 217bc0f9fb354609bb122e3415a9d078, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.496520  2213 consensus_queue.cc:260] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217bc0f9fb354609bb122e3415a9d078" member_type: VOTER }
I20260709 13:13:17.496975  2213 raft_consensus.cc:399] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:17.497220  2213 raft_consensus.cc:493] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:17.497502  2213 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.502437  2213 raft_consensus.cc:515] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217bc0f9fb354609bb122e3415a9d078" member_type: VOTER }
I20260709 13:13:17.502981  2213 leader_election.cc:304] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 217bc0f9fb354609bb122e3415a9d078; no voters: 
I20260709 13:13:17.504105  2213 leader_election.cc:290] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:17.504467  2216 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.506006  2216 raft_consensus.cc:697] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 1 LEADER]: Becoming Leader. State: Replica: 217bc0f9fb354609bb122e3415a9d078, State: Running, Role: LEADER
I20260709 13:13:17.506676  2216 consensus_queue.cc:237] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217bc0f9fb354609bb122e3415a9d078" member_type: VOTER }
I20260709 13:13:17.506978  2213 sys_catalog.cc:565] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:17.510712  2217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "217bc0f9fb354609bb122e3415a9d078" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217bc0f9fb354609bb122e3415a9d078" member_type: VOTER } }
I20260709 13:13:17.511420  2217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:17.518108  2218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 217bc0f9fb354609bb122e3415a9d078. Latest consensus state: current_term: 1 leader_uuid: "217bc0f9fb354609bb122e3415a9d078" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217bc0f9fb354609bb122e3415a9d078" member_type: VOTER } }
I20260709 13:13:17.519009  2218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:17.520710  2224 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:17.525869  2224 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:17.526880 25395 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:17.535073  2224 catalog_manager.cc:1383] Generated new cluster ID: b338842135b44ff3b2fc842145b5ffef
I20260709 13:13:17.535370  2224 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:17.555403  2224 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:17.556720  2224 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:17.576659  2224 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078: Generated new TSK 0
I20260709 13:13:17.577371  2224 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:17.594465 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:17.600656  2234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:17.601936  2235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:17.604849  2237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:17.605020 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:17.606269 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:17.606453 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:17.606648 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602797606633 us; error 0 us; skew 500 ppm
I20260709 13:13:17.607221 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:17.609944 25395 webserver.cc:533] Webserver started at http://127.24.204.193:36477/ using document root <none> and password file <none>
I20260709 13:13:17.610435 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:17.610594 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:17.610854 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:17.611989 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-0-root/instance:
uuid: "b808ef5de06641aaa14ce0a700e57c7e"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-qv7r"
I20260709 13:13:17.616721 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:13:17.620467  2242 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.621573 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:17.621865 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-0-root
uuid: "b808ef5de06641aaa14ce0a700e57c7e"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-qv7r"
I20260709 13:13:17.622131 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:17.635959 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:17.637115 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:17.638623 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:17.640880 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:17.641057 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.641376 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:17.641527 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.684453 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.193:45711
I20260709 13:13:17.684775  2304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.193:45711 every 8 connection(s)
I20260709 13:13:17.689625 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:17.696875  2309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:17.697217  2310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:17.700234 25395 server_base.cc:1061] running on GCE node
W20260709 13:13:17.701865  2313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:17.702445  2305 heartbeater.cc:344] Connected to a master server at 127.24.204.254:39635
I20260709 13:13:17.702984  2305 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:17.703329 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:17.703622 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:17.703817 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602797703799 us; error 0 us; skew 500 ppm
I20260709 13:13:17.703881  2305 heartbeater.cc:507] Master 127.24.204.254:39635 requested a full tablet report, sending...
I20260709 13:13:17.704612 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:17.706670  2178 ts_manager.cc:194] Registered new tserver with Master: b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711)
I20260709 13:13:17.707556 25395 webserver.cc:533] Webserver started at http://127.24.204.194:37173/ using document root <none> and password file <none>
I20260709 13:13:17.708278 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:17.708573 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:17.708876 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:17.709192  2178 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46630
I20260709 13:13:17.710350 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-1-root/instance:
uuid: "c2d56e7dfb5540318c7064665f5564ee"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-qv7r"
I20260709 13:13:17.715068 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:17.719074  2317 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.719993 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:17.720332 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-1-root
uuid: "c2d56e7dfb5540318c7064665f5564ee"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-qv7r"
I20260709 13:13:17.720584 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:17.762282 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:17.763537 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:17.765084 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:17.767800 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:17.768056 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.768339 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:17.768522 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.814859 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.194:36393
I20260709 13:13:17.814997  2379 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.194:36393 every 8 connection(s)
I20260709 13:13:17.819700 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:17.828120  2383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:17.829378  2384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:17.834200 25395 server_base.cc:1061] running on GCE node
W20260709 13:13:17.835275  2386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:17.836409 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:17.836637 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:17.836818 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602797836799 us; error 0 us; skew 500 ppm
I20260709 13:13:17.837361 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:17.840026 25395 webserver.cc:533] Webserver started at http://127.24.204.195:33971/ using document root <none> and password file <none>
I20260709 13:13:17.840638 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:17.840890 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:17.841177 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:17.842155  2380 heartbeater.cc:344] Connected to a master server at 127.24.204.254:39635
I20260709 13:13:17.842684  2380 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:17.842657 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-2-root/instance:
uuid: "5d22bbb83cf74258b84def1ecdcf149c"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-qv7r"
I20260709 13:13:17.843667  2380 heartbeater.cc:507] Master 127.24.204.254:39635 requested a full tablet report, sending...
I20260709 13:13:17.845800  2178 ts_manager.cc:194] Registered new tserver with Master: c2d56e7dfb5540318c7064665f5564ee (127.24.204.194:36393)
I20260709 13:13:17.847642  2178 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46642
I20260709 13:13:17.848641 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:17.852429  2391 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.853438 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:17.853801 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-2-root
uuid: "5d22bbb83cf74258b84def1ecdcf149c"
format_stamp: "Formatted at 2026-07-09 13:13:17 on dist-test-slave-qv7r"
I20260709 13:13:17.854065 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602508284650-25395-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:17.869690 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:17.870821 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:17.872431 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:17.874956 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:17.875144 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.875430 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:17.875597 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:17.918506 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.195:44613
I20260709 13:13:17.918664  2453 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.195:44613 every 8 connection(s)
I20260709 13:13:17.932866  2454 heartbeater.cc:344] Connected to a master server at 127.24.204.254:39635
I20260709 13:13:17.933348  2454 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:17.934113  2454 heartbeater.cc:507] Master 127.24.204.254:39635 requested a full tablet report, sending...
I20260709 13:13:17.936399  2178 ts_manager.cc:194] Registered new tserver with Master: 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:17.936913 25395 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014902814s
I20260709 13:13:17.938077  2178 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46650
I20260709 13:13:17.964450  2178 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46666:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:17.966689  2178 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:18.014261  2345 tablet_service.cc:1511] Processing CreateTablet for tablet 45e118a79a3046e9b840169569571a7f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f6540b7d9cb646adb1ffeea58681926b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:18.015714  2345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e118a79a3046e9b840169569571a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.014273  2344 tablet_service.cc:1511] Processing CreateTablet for tablet 25c0855c5c5d4b90bfa70e695a10c492 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f6540b7d9cb646adb1ffeea58681926b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:18.017632  2344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c0855c5c5d4b90bfa70e695a10c492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.020524  2270 tablet_service.cc:1511] Processing CreateTablet for tablet 45e118a79a3046e9b840169569571a7f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f6540b7d9cb646adb1ffeea58681926b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:18.022454  2270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e118a79a3046e9b840169569571a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.022091  2269 tablet_service.cc:1511] Processing CreateTablet for tablet 25c0855c5c5d4b90bfa70e695a10c492 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f6540b7d9cb646adb1ffeea58681926b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:18.023545  2269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c0855c5c5d4b90bfa70e695a10c492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.041594  2469 tablet_bootstrap.cc:492] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee: Bootstrap starting.
I20260709 13:13:18.041953  2419 tablet_service.cc:1511] Processing CreateTablet for tablet 45e118a79a3046e9b840169569571a7f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f6540b7d9cb646adb1ffeea58681926b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:18.043350  2419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e118a79a3046e9b840169569571a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.048691  2418 tablet_service.cc:1511] Processing CreateTablet for tablet 25c0855c5c5d4b90bfa70e695a10c492 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f6540b7d9cb646adb1ffeea58681926b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:18.050580  2418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c0855c5c5d4b90bfa70e695a10c492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.062283  2470 tablet_bootstrap.cc:492] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e: Bootstrap starting.
I20260709 13:13:18.067569  2472 tablet_bootstrap.cc:492] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c: Bootstrap starting.
I20260709 13:13:18.071266  2470 tablet_bootstrap.cc:654] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.071707  2469 tablet_bootstrap.cc:654] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.075284  2472 tablet_bootstrap.cc:654] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.110387  2469 tablet_bootstrap.cc:492] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee: No bootstrap required, opened a new log
I20260709 13:13:18.112193  2469 ts_tablet_manager.cc:1403] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.011s
I20260709 13:13:18.112453  2470 tablet_bootstrap.cc:492] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e: No bootstrap required, opened a new log
I20260709 13:13:18.113929  2470 ts_tablet_manager.cc:1403] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.007s
I20260709 13:13:18.115869  2472 tablet_bootstrap.cc:492] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c: No bootstrap required, opened a new log
I20260709 13:13:18.117044  2472 ts_tablet_manager.cc:1403] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.000s
I20260709 13:13:18.119838  2469 raft_consensus.cc:359] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.120719  2470 raft_consensus.cc:359] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.121801  2469 raft_consensus.cc:385] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.121950  2470 raft_consensus.cc:385] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.122380  2469 raft_consensus.cc:740] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.122419  2470 raft_consensus.cc:740] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b808ef5de06641aaa14ce0a700e57c7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.122434  2472 raft_consensus.cc:359] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.123730  2472 raft_consensus.cc:385] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.123531  2469 consensus_queue.cc:260] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.124091  2472 raft_consensus.cc:740] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d22bbb83cf74258b84def1ecdcf149c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.123915  2470 consensus_queue.cc:260] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.125247  2472 consensus_queue.cc:260] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.127285  2380 heartbeater.cc:499] Master 127.24.204.254:39635 was elected leader, sending a full tablet report...
I20260709 13:13:18.127713  2469 ts_tablet_manager.cc:1434] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.001s
I20260709 13:13:18.128612  2454 heartbeater.cc:499] Master 127.24.204.254:39635 was elected leader, sending a full tablet report...
I20260709 13:13:18.129925  2469 tablet_bootstrap.cc:492] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee: Bootstrap starting.
I20260709 13:13:18.133433  2472 ts_tablet_manager.cc:1434] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.008s
I20260709 13:13:18.134932  2472 tablet_bootstrap.cc:492] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c: Bootstrap starting.
I20260709 13:13:18.142879  2469 tablet_bootstrap.cc:654] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.143090  2305 heartbeater.cc:499] Master 127.24.204.254:39635 was elected leader, sending a full tablet report...
I20260709 13:13:18.143460  2470 ts_tablet_manager.cc:1434] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e: Time spent starting tablet: real 0.029s	user 0.011s	sys 0.014s
I20260709 13:13:18.145046  2470 tablet_bootstrap.cc:492] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e: Bootstrap starting.
I20260709 13:13:18.149411  2472 tablet_bootstrap.cc:654] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.154388  2469 tablet_bootstrap.cc:492] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee: No bootstrap required, opened a new log
I20260709 13:13:18.154968  2469 ts_tablet_manager.cc:1403] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 13:13:18.154973  2470 tablet_bootstrap.cc:654] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.158646  2469 raft_consensus.cc:359] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.159459  2469 raft_consensus.cc:385] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.159804  2469 raft_consensus.cc:740] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.160693  2469 consensus_queue.cc:260] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.163074  2469 ts_tablet_manager.cc:1434] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:18.165849  2472 tablet_bootstrap.cc:492] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c: No bootstrap required, opened a new log
I20260709 13:13:18.166714  2472 ts_tablet_manager.cc:1403] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.007s
I20260709 13:13:18.170568  2472 raft_consensus.cc:359] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.170984  2470 tablet_bootstrap.cc:492] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e: No bootstrap required, opened a new log
I20260709 13:13:18.171375  2472 raft_consensus.cc:385] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.171639  2470 ts_tablet_manager.cc:1403] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.010s
I20260709 13:13:18.171705  2472 raft_consensus.cc:740] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d22bbb83cf74258b84def1ecdcf149c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.174100  2472 consensus_queue.cc:260] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.175674  2470 raft_consensus.cc:359] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.176499  2470 raft_consensus.cc:385] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.176549  2472 ts_tablet_manager.cc:1434] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:18.176875  2476 raft_consensus.cc:493] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.176879  2470 raft_consensus.cc:740] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b808ef5de06641aaa14ce0a700e57c7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.177711  2476 raft_consensus.cc:515] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.178196  2470 consensus_queue.cc:260] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.180616  2470 ts_tablet_manager.cc:1434] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:18.182821  2476 leader_election.cc:290] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711), 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:18.198599  2280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e118a79a3046e9b840169569571a7f" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e" is_pre_election: true
I20260709 13:13:18.199565  2280 raft_consensus.cc:2468] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 0.
I20260709 13:13:18.200896  2318 leader_election.cc:304] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b808ef5de06641aaa14ce0a700e57c7e, c2d56e7dfb5540318c7064665f5564ee; no voters: 
I20260709 13:13:18.201879  2429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e118a79a3046e9b840169569571a7f" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c" is_pre_election: true
I20260709 13:13:18.202219  2476 raft_consensus.cc:2804] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.202697  2476 raft_consensus.cc:493] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.202710  2429 raft_consensus.cc:2468] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 0.
I20260709 13:13:18.203042  2476 raft_consensus.cc:3060] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.210911  2476 raft_consensus.cc:515] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.212765  2476 leader_election.cc:290] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 election: Requested vote from peers b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711), 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:18.214036  2280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e118a79a3046e9b840169569571a7f" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
I20260709 13:13:18.214313  2429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e118a79a3046e9b840169569571a7f" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c"
I20260709 13:13:18.214781  2280 raft_consensus.cc:3060] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.215037  2429 raft_consensus.cc:3060] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.221926  2280 raft_consensus.cc:2468] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 1.
I20260709 13:13:18.222563  2429 raft_consensus.cc:2468] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 1.
I20260709 13:13:18.223107  2318 leader_election.cc:304] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b808ef5de06641aaa14ce0a700e57c7e, c2d56e7dfb5540318c7064665f5564ee; no voters: 
I20260709 13:13:18.223959  2476 raft_consensus.cc:2804] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.225018  2476 raft_consensus.cc:697] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Becoming Leader. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Running, Role: LEADER
I20260709 13:13:18.226038  2476 consensus_queue.cc:237] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.235242  2174 catalog_manager.cc:5697] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d56e7dfb5540318c7064665f5564ee (127.24.204.194). New cstate: current_term: 1 leader_uuid: "c2d56e7dfb5540318c7064665f5564ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.303205  2476 raft_consensus.cc:493] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.303839  2476 raft_consensus.cc:515] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.305671  2476 leader_election.cc:290] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711), 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:18.306607  2280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c0855c5c5d4b90bfa70e695a10c492" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e" is_pre_election: true
I20260709 13:13:18.306871  2429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c0855c5c5d4b90bfa70e695a10c492" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c" is_pre_election: true
I20260709 13:13:18.307327  2280 raft_consensus.cc:2468] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 0.
I20260709 13:13:18.307510  2429 raft_consensus.cc:2468] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 0.
I20260709 13:13:18.308504  2318 leader_election.cc:304] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b808ef5de06641aaa14ce0a700e57c7e, c2d56e7dfb5540318c7064665f5564ee; no voters: 
I20260709 13:13:18.309157  2476 raft_consensus.cc:2804] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.309525  2476 raft_consensus.cc:493] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.309868  2476 raft_consensus.cc:3060] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.315173  2476 raft_consensus.cc:515] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.316936  2476 leader_election.cc:290] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 election: Requested vote from peers b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711), 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:18.317698  2280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c0855c5c5d4b90bfa70e695a10c492" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
I20260709 13:13:18.317912  2429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c0855c5c5d4b90bfa70e695a10c492" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c"
I20260709 13:13:18.318368  2280 raft_consensus.cc:3060] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.318506  2429 raft_consensus.cc:3060] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.324441  2429 raft_consensus.cc:2468] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 1.
I20260709 13:13:18.325412  2280 raft_consensus.cc:2468] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 1.
I20260709 13:13:18.325475  2318 leader_election.cc:304] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d22bbb83cf74258b84def1ecdcf149c, c2d56e7dfb5540318c7064665f5564ee; no voters: 
I20260709 13:13:18.326556  2476 raft_consensus.cc:2804] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.327018  2476 raft_consensus.cc:697] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Becoming Leader. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Running, Role: LEADER
I20260709 13:13:18.327796  2476 consensus_queue.cc:237] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.334537  2174 catalog_manager.cc:5697] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d56e7dfb5540318c7064665f5564ee (127.24.204.194). New cstate: current_term: 1 leader_uuid: "c2d56e7dfb5540318c7064665f5564ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.405826  2174 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46668:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:18.408216  2174 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:18.434816  2270 tablet_service.cc:1511] Processing CreateTablet for tablet 7b9b352620dd4b46abac86f74f612d84 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3636df342803416b8e0a5d28fef427a4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:18.436029  2345 tablet_service.cc:1511] Processing CreateTablet for tablet 7b9b352620dd4b46abac86f74f612d84 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3636df342803416b8e0a5d28fef427a4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:18.436466  2270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b9b352620dd4b46abac86f74f612d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.437693  2345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b9b352620dd4b46abac86f74f612d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.438678  2418 tablet_service.cc:1511] Processing CreateTablet for tablet 7b9b352620dd4b46abac86f74f612d84 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3636df342803416b8e0a5d28fef427a4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:18.440157  2418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b9b352620dd4b46abac86f74f612d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.442281  2344 tablet_service.cc:1511] Processing CreateTablet for tablet 2644cb5da9a8429f967916a985c99006 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3636df342803416b8e0a5d28fef427a4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:18.443792  2344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2644cb5da9a8429f967916a985c99006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.445451  2419 tablet_service.cc:1511] Processing CreateTablet for tablet 2644cb5da9a8429f967916a985c99006 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3636df342803416b8e0a5d28fef427a4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:18.446059  2269 tablet_service.cc:1511] Processing CreateTablet for tablet 2644cb5da9a8429f967916a985c99006 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3636df342803416b8e0a5d28fef427a4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:18.447000  2419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2644cb5da9a8429f967916a985c99006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.447458  2269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2644cb5da9a8429f967916a985c99006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.458077  2470 tablet_bootstrap.cc:492] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e: Bootstrap starting.
I20260709 13:13:18.465343  2470 tablet_bootstrap.cc:654] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.465934  2472 tablet_bootstrap.cc:492] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c: Bootstrap starting.
I20260709 13:13:18.474185  2472 tablet_bootstrap.cc:654] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.477213  2470 tablet_bootstrap.cc:492] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e: No bootstrap required, opened a new log
I20260709 13:13:18.477787  2470 ts_tablet_manager.cc:1403] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:13:18.481503  2469 tablet_bootstrap.cc:492] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee: Bootstrap starting.
I20260709 13:13:18.480937  2470 raft_consensus.cc:359] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.485035  2470 raft_consensus.cc:385] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.485378  2470 raft_consensus.cc:740] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b808ef5de06641aaa14ce0a700e57c7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.486394  2470 consensus_queue.cc:260] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.488718  2470 ts_tablet_manager.cc:1434] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:18.489346  2469 tablet_bootstrap.cc:654] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.496754  2469 tablet_bootstrap.cc:492] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee: No bootstrap required, opened a new log
I20260709 13:13:18.497282  2469 ts_tablet_manager.cc:1403] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:13:18.500118  2469 raft_consensus.cc:359] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.500733  2469 raft_consensus.cc:385] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.500303  2470 tablet_bootstrap.cc:492] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e: Bootstrap starting.
I20260709 13:13:18.500968  2472 tablet_bootstrap.cc:492] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c: No bootstrap required, opened a new log
I20260709 13:13:18.501529  2472 ts_tablet_manager.cc:1403] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.009s
I20260709 13:13:18.501005  2469 raft_consensus.cc:740] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.502759  2469 consensus_queue.cc:260] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.505173  2469 ts_tablet_manager.cc:1434] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:13:18.505344  2472 raft_consensus.cc:359] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.506201  2472 raft_consensus.cc:385] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.506507  2472 raft_consensus.cc:740] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d22bbb83cf74258b84def1ecdcf149c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.506580  2469 tablet_bootstrap.cc:492] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee: Bootstrap starting.
I20260709 13:13:18.507311  2472 consensus_queue.cc:260] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.508329  2470 tablet_bootstrap.cc:654] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.509704  2472 ts_tablet_manager.cc:1434] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:13:18.510825  2472 tablet_bootstrap.cc:492] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c: Bootstrap starting.
I20260709 13:13:18.519593  2472 tablet_bootstrap.cc:654] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:18.517247  2226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:18.532219  2469 tablet_bootstrap.cc:654] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.539018  2470 tablet_bootstrap.cc:492] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e: No bootstrap required, opened a new log
I20260709 13:13:18.539664  2470 ts_tablet_manager.cc:1403] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.011s
I20260709 13:13:18.541997  2472 tablet_bootstrap.cc:492] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c: No bootstrap required, opened a new log
I20260709 13:13:18.542380  2469 tablet_bootstrap.cc:492] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee: No bootstrap required, opened a new log
I20260709 13:13:18.542629  2472 ts_tablet_manager.cc:1403] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.013s
I20260709 13:13:18.542912  2469 ts_tablet_manager.cc:1403] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.004s
I20260709 13:13:18.543314  2470 raft_consensus.cc:359] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.543983  2470 raft_consensus.cc:385] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.544245  2470 raft_consensus.cc:740] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b808ef5de06641aaa14ce0a700e57c7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.545118  2470 consensus_queue.cc:260] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.545894  2472 raft_consensus.cc:359] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.546701  2472 raft_consensus.cc:385] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.546324  2469 raft_consensus.cc:359] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.547020  2472 raft_consensus.cc:740] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d22bbb83cf74258b84def1ecdcf149c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.547147  2469 raft_consensus.cc:385] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.547492  2470 ts_tablet_manager.cc:1434] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:18.547518  2469 raft_consensus.cc:740] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.547865  2472 consensus_queue.cc:260] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.548982  2476 raft_consensus.cc:493] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.548611  2469 consensus_queue.cc:260] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.549929  2476 raft_consensus.cc:515] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.550890  2472 ts_tablet_manager.cc:1434] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:13:18.552073  2469 ts_tablet_manager.cc:1434] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:13:18.553372  2280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2644cb5da9a8429f967916a985c99006" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e" is_pre_election: true
I20260709 13:13:18.554159  2280 raft_consensus.cc:2468] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 0.
I20260709 13:13:18.553383  2429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2644cb5da9a8429f967916a985c99006" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c" is_pre_election: true
I20260709 13:13:18.555348  2429 raft_consensus.cc:2468] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 0.
I20260709 13:13:18.552196  2476 leader_election.cc:290] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711), 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:18.555491  2318 leader_election.cc:304] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b808ef5de06641aaa14ce0a700e57c7e, c2d56e7dfb5540318c7064665f5564ee; no voters: 
I20260709 13:13:18.558676  2476 raft_consensus.cc:2804] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.559170  2476 raft_consensus.cc:493] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.559489  2476 raft_consensus.cc:3060] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.567183  2476 raft_consensus.cc:515] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.569041  2476 leader_election.cc:290] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 election: Requested vote from peers b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711), 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:18.570294  2280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2644cb5da9a8429f967916a985c99006" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
I20260709 13:13:18.570294  2429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2644cb5da9a8429f967916a985c99006" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c"
I20260709 13:13:18.571272  2280 raft_consensus.cc:3060] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.571295  2429 raft_consensus.cc:3060] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.576458  2280 raft_consensus.cc:2468] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 1.
I20260709 13:13:18.577188  2429 raft_consensus.cc:2468] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 1.
I20260709 13:13:18.577831  2318 leader_election.cc:304] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b808ef5de06641aaa14ce0a700e57c7e, c2d56e7dfb5540318c7064665f5564ee; no voters: 
I20260709 13:13:18.578619  2476 raft_consensus.cc:2804] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.579128  2476 raft_consensus.cc:697] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Becoming Leader. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Running, Role: LEADER
I20260709 13:13:18.579963  2476 consensus_queue.cc:237] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.587255  2178 catalog_manager.cc:5697] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee reported cstate change: term changed from 0 to 1, leader changed from <none> to c2d56e7dfb5540318c7064665f5564ee (127.24.204.194). New cstate: current_term: 1 leader_uuid: "c2d56e7dfb5540318c7064665f5564ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.663244  2478 raft_consensus.cc:493] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.663806  2478 raft_consensus.cc:515] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.666154  2478 leader_election.cc:290] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711), c2d56e7dfb5540318c7064665f5564ee (127.24.204.194:36393)
I20260709 13:13:18.679941  2280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b9b352620dd4b46abac86f74f612d84" candidate_uuid: "5d22bbb83cf74258b84def1ecdcf149c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e" is_pre_election: true
I20260709 13:13:18.680748  2280 raft_consensus.cc:2468] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d22bbb83cf74258b84def1ecdcf149c in term 0.
I20260709 13:13:18.681988  2392 leader_election.cc:304] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d22bbb83cf74258b84def1ecdcf149c, b808ef5de06641aaa14ce0a700e57c7e; no voters: 
I20260709 13:13:18.682727  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b9b352620dd4b46abac86f74f612d84" candidate_uuid: "5d22bbb83cf74258b84def1ecdcf149c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d56e7dfb5540318c7064665f5564ee" is_pre_election: true
I20260709 13:13:18.682963  2478 raft_consensus.cc:2804] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.683449  2355 raft_consensus.cc:2468] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d22bbb83cf74258b84def1ecdcf149c in term 0.
I20260709 13:13:18.683471  2478 raft_consensus.cc:493] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.683961  2478 raft_consensus.cc:3060] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.690202  2478 raft_consensus.cc:515] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.691941  2478 leader_election.cc:290] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [CANDIDATE]: Term 1 election: Requested vote from peers b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711), c2d56e7dfb5540318c7064665f5564ee (127.24.204.194:36393)
I20260709 13:13:18.692836  2280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b9b352620dd4b46abac86f74f612d84" candidate_uuid: "5d22bbb83cf74258b84def1ecdcf149c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
I20260709 13:13:18.693081  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b9b352620dd4b46abac86f74f612d84" candidate_uuid: "5d22bbb83cf74258b84def1ecdcf149c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2d56e7dfb5540318c7064665f5564ee"
I20260709 13:13:18.693581  2280 raft_consensus.cc:3060] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.693737  2355 raft_consensus.cc:3060] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.695438  2476 consensus_queue.cc:1048] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:18.701980  2355 raft_consensus.cc:2468] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d22bbb83cf74258b84def1ecdcf149c in term 1.
I20260709 13:13:18.701980  2280 raft_consensus.cc:2468] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d22bbb83cf74258b84def1ecdcf149c in term 1.
I20260709 13:13:18.704376  2394 leader_election.cc:304] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d22bbb83cf74258b84def1ecdcf149c, c2d56e7dfb5540318c7064665f5564ee; no voters: 
I20260709 13:13:18.705814  2478 raft_consensus.cc:2804] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.707044  2478 raft_consensus.cc:697] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 LEADER]: Becoming Leader. State: Replica: 5d22bbb83cf74258b84def1ecdcf149c, State: Running, Role: LEADER
I20260709 13:13:18.707921  2478 consensus_queue.cc:237] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.716104  2483 consensus_queue.cc:1048] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:18.724642  2175 catalog_manager.cc:5697] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195). New cstate: current_term: 1 leader_uuid: "5d22bbb83cf74258b84def1ecdcf149c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.802290  2355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45e118a79a3046e9b840169569571a7f"
dest_uuid: "c2d56e7dfb5540318c7064665f5564ee"
mode: GRACEFUL
new_leader_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
 from {username='slave'} at 127.0.0.1:55258
I20260709 13:13:18.803014  2355 raft_consensus.cc:606] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Received request to transfer leadership to TS b808ef5de06641aaa14ce0a700e57c7e
I20260709 13:13:18.808784  2355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25c0855c5c5d4b90bfa70e695a10c492"
dest_uuid: "c2d56e7dfb5540318c7064665f5564ee"
mode: GRACEFUL
new_leader_uuid: "5d22bbb83cf74258b84def1ecdcf149c"
 from {username='slave'} at 127.0.0.1:55258
I20260709 13:13:18.809351  2355 raft_consensus.cc:606] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Received request to transfer leadership to TS 5d22bbb83cf74258b84def1ecdcf149c
I20260709 13:13:18.824872  2429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b9b352620dd4b46abac86f74f612d84"
dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c"
mode: GRACEFUL
new_leader_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
 from {username='slave'} at 127.0.0.1:44878
I20260709 13:13:18.825395  2429 raft_consensus.cc:606] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 LEADER]: Received request to transfer leadership to TS b808ef5de06641aaa14ce0a700e57c7e
I20260709 13:13:18.831223  2355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2644cb5da9a8429f967916a985c99006"
dest_uuid: "c2d56e7dfb5540318c7064665f5564ee"
mode: GRACEFUL
new_leader_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
 from {username='slave'} at 127.0.0.1:55258
I20260709 13:13:18.831776  2355 raft_consensus.cc:606] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Received request to transfer leadership to TS b808ef5de06641aaa14ce0a700e57c7e
I20260709 13:13:18.878432  2483 consensus_queue.cc:1048] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.892714  2476 consensus_queue.cc:1048] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.901244  2511 raft_consensus.cc:993] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee: : Instructing follower 5d22bbb83cf74258b84def1ecdcf149c to start an election
I20260709 13:13:18.901798  2476 raft_consensus.cc:1081] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Signalling peer 5d22bbb83cf74258b84def1ecdcf149c to start an election
I20260709 13:13:18.903440  2429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25c0855c5c5d4b90bfa70e695a10c492"
dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c"
 from {username='slave'} at 127.0.0.1:44872
I20260709 13:13:18.904032  2429 raft_consensus.cc:493] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.904379  2429 raft_consensus.cc:3060] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.910975  2429 raft_consensus.cc:515] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.913652  2429 leader_election.cc:290] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [CANDIDATE]: Term 2 election: Requested vote from peers b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711), c2d56e7dfb5540318c7064665f5564ee (127.24.204.194:36393)
I20260709 13:13:18.914357  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c0855c5c5d4b90bfa70e695a10c492" candidate_uuid: "5d22bbb83cf74258b84def1ecdcf149c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2d56e7dfb5540318c7064665f5564ee"
I20260709 13:13:18.914278  2279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c0855c5c5d4b90bfa70e695a10c492" candidate_uuid: "5d22bbb83cf74258b84def1ecdcf149c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
I20260709 13:13:18.915274  2355 raft_consensus.cc:3055] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:18.915328  2279 raft_consensus.cc:3060] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.915678  2355 raft_consensus.cc:740] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Running, Role: LEADER
I20260709 13:13:18.916680  2355 consensus_queue.cc:260] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.917809  2355 raft_consensus.cc:3060] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.923722  2279 raft_consensus.cc:2468] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d22bbb83cf74258b84def1ecdcf149c in term 2.
I20260709 13:13:18.925122  2355 raft_consensus.cc:2468] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d22bbb83cf74258b84def1ecdcf149c in term 2.
I20260709 13:13:18.925191  2392 leader_election.cc:304] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d22bbb83cf74258b84def1ecdcf149c, b808ef5de06641aaa14ce0a700e57c7e; no voters: 
I20260709 13:13:18.926218  2478 raft_consensus.cc:2804] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:18.926671  2478 raft_consensus.cc:697] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 LEADER]: Becoming Leader. State: Replica: 5d22bbb83cf74258b84def1ecdcf149c, State: Running, Role: LEADER
I20260709 13:13:18.927603  2478 consensus_queue.cc:237] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:18.934227  2175 catalog_manager.cc:5697] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c reported cstate change: term changed from 1 to 2, leader changed from c2d56e7dfb5540318c7064665f5564ee (127.24.204.194) to 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195). New cstate: current_term: 2 leader_uuid: "5d22bbb83cf74258b84def1ecdcf149c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.091584  2511 raft_consensus.cc:993] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee: : Instructing follower b808ef5de06641aaa14ce0a700e57c7e to start an election
I20260709 13:13:19.092123  2476 raft_consensus.cc:1081] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Signalling peer b808ef5de06641aaa14ce0a700e57c7e to start an election
I20260709 13:13:19.094031  2279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45e118a79a3046e9b840169569571a7f"
dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
 from {username='slave'} at 127.0.0.1:37818
I20260709 13:13:19.094507  2279 raft_consensus.cc:493] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.094777  2279 raft_consensus.cc:3060] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.100142  2279 raft_consensus.cc:515] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.102635  2279 leader_election.cc:290] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [CANDIDATE]: Term 2 election: Requested vote from peers c2d56e7dfb5540318c7064665f5564ee (127.24.204.194:36393), 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:19.114374  2478 consensus_queue.cc:1048] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:19.115857  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e118a79a3046e9b840169569571a7f" candidate_uuid: "b808ef5de06641aaa14ce0a700e57c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2d56e7dfb5540318c7064665f5564ee"
I20260709 13:13:19.116571  2355 raft_consensus.cc:3055] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:19.116912  2355 raft_consensus.cc:740] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Running, Role: LEADER
I20260709 13:13:19.117347  2429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e118a79a3046e9b840169569571a7f" candidate_uuid: "b808ef5de06641aaa14ce0a700e57c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c"
I20260709 13:13:19.118089  2429 raft_consensus.cc:3060] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.117890  2355 consensus_queue.cc:260] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.118947  2476 consensus_queue.cc:1048] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.120119  2355 raft_consensus.cc:3060] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.128216  2429 raft_consensus.cc:2468] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b808ef5de06641aaa14ce0a700e57c7e in term 2.
I20260709 13:13:19.129799  2243 leader_election.cc:304] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d22bbb83cf74258b84def1ecdcf149c, b808ef5de06641aaa14ce0a700e57c7e; no voters: 
I20260709 13:13:19.130789  2477 raft_consensus.cc:2804] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.133690  2355 raft_consensus.cc:2468] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b808ef5de06641aaa14ce0a700e57c7e in term 2.
I20260709 13:13:19.135864  2502 raft_consensus.cc:993] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c: : Instructing follower b808ef5de06641aaa14ce0a700e57c7e to start an election
I20260709 13:13:19.136372  2478 raft_consensus.cc:1081] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 LEADER]: Signalling peer b808ef5de06641aaa14ce0a700e57c7e to start an election
I20260709 13:13:19.143226  2278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b9b352620dd4b46abac86f74f612d84"
dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
 from {username='slave'} at 127.0.0.1:37832
I20260709 13:13:19.146181  2511 raft_consensus.cc:993] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee: : Instructing follower b808ef5de06641aaa14ce0a700e57c7e to start an election
I20260709 13:13:19.146178  2477 raft_consensus.cc:697] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 2 LEADER]: Becoming Leader. State: Replica: b808ef5de06641aaa14ce0a700e57c7e, State: Running, Role: LEADER
I20260709 13:13:19.148334  2511 raft_consensus.cc:1081] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Signalling peer b808ef5de06641aaa14ce0a700e57c7e to start an election
I20260709 13:13:19.147694  2477 consensus_queue.cc:237] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.166970  2483 consensus_queue.cc:1048] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.160981  2280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2644cb5da9a8429f967916a985c99006"
dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
 from {username='slave'} at 127.0.0.1:37818
I20260709 13:13:19.168658  2280 raft_consensus.cc:493] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.169020  2280 raft_consensus.cc:3060] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.164616  2278 raft_consensus.cc:493] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.149660  2478 consensus_queue.cc:1048] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.170938  2278 raft_consensus.cc:3060] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.183359  2278 raft_consensus.cc:515] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.177151  2280 raft_consensus.cc:515] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.187580  2280 leader_election.cc:290] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [CANDIDATE]: Term 2 election: Requested vote from peers c2d56e7dfb5540318c7064665f5564ee (127.24.204.194:36393), 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:19.188571  2354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2644cb5da9a8429f967916a985c99006" candidate_uuid: "b808ef5de06641aaa14ce0a700e57c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2d56e7dfb5540318c7064665f5564ee"
I20260709 13:13:19.189196  2354 raft_consensus.cc:3055] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:19.189405  2354 raft_consensus.cc:740] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Running, Role: LEADER
I20260709 13:13:19.190358  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2644cb5da9a8429f967916a985c99006" candidate_uuid: "b808ef5de06641aaa14ce0a700e57c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c"
I20260709 13:13:19.190250  2354 consensus_queue.cc:260] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.191355  2354 raft_consensus.cc:3060] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.195485  2175 catalog_manager.cc:5697] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e reported cstate change: term changed from 1 to 2, leader changed from c2d56e7dfb5540318c7064665f5564ee (127.24.204.194) to b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b808ef5de06641aaa14ce0a700e57c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.196725  2278 leader_election.cc:290] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [CANDIDATE]: Term 2 election: Requested vote from peers c2d56e7dfb5540318c7064665f5564ee (127.24.204.194:36393), 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:19.196645  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b9b352620dd4b46abac86f74f612d84" candidate_uuid: "b808ef5de06641aaa14ce0a700e57c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c"
I20260709 13:13:19.197804  2428 raft_consensus.cc:3055] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:19.198123  2428 raft_consensus.cc:740] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d22bbb83cf74258b84def1ecdcf149c, State: Running, Role: LEADER
I20260709 13:13:19.196580  2353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b9b352620dd4b46abac86f74f612d84" candidate_uuid: "b808ef5de06641aaa14ce0a700e57c7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2d56e7dfb5540318c7064665f5564ee"
I20260709 13:13:19.198987  2428 consensus_queue.cc:260] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.200557  2428 raft_consensus.cc:3060] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.205186  2354 raft_consensus.cc:2468] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b808ef5de06641aaa14ce0a700e57c7e in term 2.
I20260709 13:13:19.206770  2245 leader_election.cc:304] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b808ef5de06641aaa14ce0a700e57c7e, c2d56e7dfb5540318c7064665f5564ee; no voters: 5d22bbb83cf74258b84def1ecdcf149c
I20260709 13:13:19.207662  2477 raft_consensus.cc:2804] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.208130  2477 raft_consensus.cc:697] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 2 LEADER]: Becoming Leader. State: Replica: b808ef5de06641aaa14ce0a700e57c7e, State: Running, Role: LEADER
I20260709 13:13:19.209129  2477 consensus_queue.cc:237] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.214825  2428 raft_consensus.cc:2468] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b808ef5de06641aaa14ce0a700e57c7e in term 2.
I20260709 13:13:19.215924  2243 leader_election.cc:304] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d22bbb83cf74258b84def1ecdcf149c, b808ef5de06641aaa14ce0a700e57c7e; no voters: c2d56e7dfb5540318c7064665f5564ee
I20260709 13:13:19.216640  2477 raft_consensus.cc:2804] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.217281  2477 raft_consensus.cc:697] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 2 LEADER]: Becoming Leader. State: Replica: b808ef5de06641aaa14ce0a700e57c7e, State: Running, Role: LEADER
I20260709 13:13:19.216635  2175 catalog_manager.cc:5697] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e reported cstate change: term changed from 1 to 2, leader changed from c2d56e7dfb5540318c7064665f5564ee (127.24.204.194) to b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b808ef5de06641aaa14ce0a700e57c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.218199  2477 consensus_queue.cc:237] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.229550  2175 catalog_manager.cc:5697] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e reported cstate change: term changed from 1 to 2, leader changed from 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195) to b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193). New cstate: current_term: 2 leader_uuid: "b808ef5de06641aaa14ce0a700e57c7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.331912 25395 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:13:19.333482 25395 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:13:19.333925 25395 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:13:19.346781  2278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2644cb5da9a8429f967916a985c99006"
dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
mode: GRACEFUL
new_leader_uuid: "c2d56e7dfb5540318c7064665f5564ee"
 from {username='slave'} at 127.0.0.1:37834
I20260709 13:13:19.347286  2278 raft_consensus.cc:606] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 2 LEADER]: Received request to transfer leadership to TS c2d56e7dfb5540318c7064665f5564ee
I20260709 13:13:19.348475 25395 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:13:19.376924  2354 raft_consensus.cc:1275] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Refusing update from remote peer 5d22bbb83cf74258b84def1ecdcf149c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.378587  2519 consensus_queue.cc:1048] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.388006  2278 raft_consensus.cc:1275] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Refusing update from remote peer 5d22bbb83cf74258b84def1ecdcf149c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.389835  2502 consensus_queue.cc:1048] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.611092  2354 raft_consensus.cc:1275] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Refusing update from remote peer b808ef5de06641aaa14ce0a700e57c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.612407  2477 consensus_queue.cc:1048] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.622515  2428 raft_consensus.cc:1275] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Refusing update from remote peer b808ef5de06641aaa14ce0a700e57c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.625083  2477 consensus_queue.cc:1048] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.645898  2428 raft_consensus.cc:1275] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Refusing update from remote peer b808ef5de06641aaa14ce0a700e57c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.647181  2477 consensus_queue.cc:1048] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.654505  2354 raft_consensus.cc:3060] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.662099  2354 raft_consensus.cc:1275] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Refusing update from remote peer b808ef5de06641aaa14ce0a700e57c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.663564  2518 consensus_queue.cc:1048] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:19.697754  2428 raft_consensus.cc:3060] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.705598  2428 raft_consensus.cc:1275] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Refusing update from remote peer b808ef5de06641aaa14ce0a700e57c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.707331  2518 consensus_queue.cc:1048] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:19.718302  2354 raft_consensus.cc:1275] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Refusing update from remote peer b808ef5de06641aaa14ce0a700e57c7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.721474  2517 consensus_queue.cc:1048] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.729524  2518 raft_consensus.cc:993] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e: : Instructing follower c2d56e7dfb5540318c7064665f5564ee to start an election
I20260709 13:13:19.730183  2517 raft_consensus.cc:1081] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 2 LEADER]: Signalling peer c2d56e7dfb5540318c7064665f5564ee to start an election
I20260709 13:13:19.732729  2354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2644cb5da9a8429f967916a985c99006"
dest_uuid: "c2d56e7dfb5540318c7064665f5564ee"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:13:19.733295  2354 raft_consensus.cc:493] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.733673  2354 raft_consensus.cc:3060] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.740204  2354 raft_consensus.cc:515] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.742646  2354 leader_election.cc:290] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 3 election: Requested vote from peers b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711), 5d22bbb83cf74258b84def1ecdcf149c (127.24.204.195:44613)
I20260709 13:13:19.743517  2278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2644cb5da9a8429f967916a985c99006" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b808ef5de06641aaa14ce0a700e57c7e"
I20260709 13:13:19.744127  2278 raft_consensus.cc:3055] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:19.744239  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2644cb5da9a8429f967916a985c99006" candidate_uuid: "c2d56e7dfb5540318c7064665f5564ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d22bbb83cf74258b84def1ecdcf149c"
I20260709 13:13:19.744489  2278 raft_consensus.cc:740] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b808ef5de06641aaa14ce0a700e57c7e, State: Running, Role: LEADER
I20260709 13:13:19.744807  2428 raft_consensus.cc:3060] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.745451  2278 consensus_queue.cc:260] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.746893  2278 raft_consensus.cc:3060] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.750873  2428 raft_consensus.cc:2468] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 3.
I20260709 13:13:19.752177  2318 leader_election.cc:304] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d22bbb83cf74258b84def1ecdcf149c, c2d56e7dfb5540318c7064665f5564ee; no voters: 
I20260709 13:13:19.752419  2278 raft_consensus.cc:2468] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2d56e7dfb5540318c7064665f5564ee in term 3.
I20260709 13:13:19.752934  2476 raft_consensus.cc:2804] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.754215  2476 raft_consensus.cc:697] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 3 LEADER]: Becoming Leader. State: Replica: c2d56e7dfb5540318c7064665f5564ee, State: Running, Role: LEADER
I20260709 13:13:19.755033  2476 consensus_queue.cc:237] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } }
I20260709 13:13:19.761447  2175 catalog_manager.cc:5697] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee reported cstate change: term changed from 2 to 3, leader changed from b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193) to c2d56e7dfb5540318c7064665f5564ee (127.24.204.194). New cstate: current_term: 3 leader_uuid: "c2d56e7dfb5540318c7064665f5564ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b808ef5de06641aaa14ce0a700e57c7e" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 45711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2d56e7dfb5540318c7064665f5564ee" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 36393 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d22bbb83cf74258b84def1ecdcf149c" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.980326 25395 tablet_server.cc:179] TabletServer@127.24.204.193:0 shutting down...
I20260709 13:13:20.009044 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:20.010128 25395 tablet_replica.cc:333] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e: stopping tablet replica
I20260709 13:13:20.010972 25395 raft_consensus.cc:2243] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.011585 25395 raft_consensus.cc:2272] T 2644cb5da9a8429f967916a985c99006 P b808ef5de06641aaa14ce0a700e57c7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.016705 25395 tablet_replica.cc:333] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e: stopping tablet replica
I20260709 13:13:20.017860 25395 raft_consensus.cc:2243] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.019368 25395 raft_consensus.cc:2272] T 7b9b352620dd4b46abac86f74f612d84 P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.023002 25395 tablet_replica.cc:333] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e: stopping tablet replica
I20260709 13:13:20.023701 25395 raft_consensus.cc:2243] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:20.024009  2392 consensus_peers.cc:597] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c -> Peer b808ef5de06641aaa14ce0a700e57c7e (127.24.204.193:45711): Couldn't send request to peer b808ef5de06641aaa14ce0a700e57c7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.024267 25395 raft_consensus.cc:2272] T 25c0855c5c5d4b90bfa70e695a10c492 P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.027030 25395 tablet_replica.cc:333] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e: stopping tablet replica
I20260709 13:13:20.027558 25395 raft_consensus.cc:2243] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.028395 25395 raft_consensus.cc:2272] T 45e118a79a3046e9b840169569571a7f P b808ef5de06641aaa14ce0a700e57c7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.054499 25395 tablet_server.cc:196] TabletServer@127.24.204.193:0 shutdown complete.
I20260709 13:13:20.069087 25395 tablet_server.cc:179] TabletServer@127.24.204.194:0 shutting down...
I20260709 13:13:20.093909 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:20.094609 25395 tablet_replica.cc:333] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee: stopping tablet replica
I20260709 13:13:20.095118 25395 raft_consensus.cc:2243] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.095690 25395 raft_consensus.cc:2272] T 7b9b352620dd4b46abac86f74f612d84 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.098268 25395 tablet_replica.cc:333] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee: stopping tablet replica
I20260709 13:13:20.098760 25395 raft_consensus.cc:2243] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.099371 25395 pending_rounds.cc:70] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee: Trying to abort 1 pending ops.
I20260709 13:13:20.099531 25395 pending_rounds.cc:77] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637067804852224 op_type: NO_OP noop_request { }
I20260709 13:13:20.099781 25395 raft_consensus.cc:2889] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:20.100003 25395 raft_consensus.cc:2272] T 2644cb5da9a8429f967916a985c99006 P c2d56e7dfb5540318c7064665f5564ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.102479 25395 tablet_replica.cc:333] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee: stopping tablet replica
I20260709 13:13:20.102963 25395 raft_consensus.cc:2243] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.103356 25395 raft_consensus.cc:2272] T 45e118a79a3046e9b840169569571a7f P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.105780 25395 tablet_replica.cc:333] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee: stopping tablet replica
I20260709 13:13:20.106257 25395 raft_consensus.cc:2243] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.106648 25395 raft_consensus.cc:2272] T 25c0855c5c5d4b90bfa70e695a10c492 P c2d56e7dfb5540318c7064665f5564ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.132105 25395 tablet_server.cc:196] TabletServer@127.24.204.194:0 shutdown complete.
I20260709 13:13:20.147593 25395 tablet_server.cc:179] TabletServer@127.24.204.195:0 shutting down...
I20260709 13:13:20.173420 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:20.174360 25395 tablet_replica.cc:333] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c: stopping tablet replica
I20260709 13:13:20.175117 25395 raft_consensus.cc:2243] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.175683 25395 raft_consensus.cc:2272] T 7b9b352620dd4b46abac86f74f612d84 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.178508 25395 tablet_replica.cc:333] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c: stopping tablet replica
I20260709 13:13:20.179155 25395 raft_consensus.cc:2243] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.179667 25395 raft_consensus.cc:2272] T 2644cb5da9a8429f967916a985c99006 P 5d22bbb83cf74258b84def1ecdcf149c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.182336 25395 tablet_replica.cc:333] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c: stopping tablet replica
I20260709 13:13:20.182915 25395 raft_consensus.cc:2243] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.183811 25395 raft_consensus.cc:2272] T 25c0855c5c5d4b90bfa70e695a10c492 P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.186589 25395 tablet_replica.cc:333] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c: stopping tablet replica
I20260709 13:13:20.187141 25395 raft_consensus.cc:2243] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.187614 25395 raft_consensus.cc:2272] T 45e118a79a3046e9b840169569571a7f P 5d22bbb83cf74258b84def1ecdcf149c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.213068 25395 tablet_server.cc:196] TabletServer@127.24.204.195:0 shutdown complete.
I20260709 13:13:20.227613 25395 master.cc:562] Master@127.24.204.254:39635 shutting down...
I20260709 13:13:20.248541 25395 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.249092 25395 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.249365 25395 tablet_replica.cc:333] T 00000000000000000000000000000000 P 217bc0f9fb354609bb122e3415a9d078: stopping tablet replica
I20260709 13:13:20.270406 25395 master.cc:584] Master@127.24.204.254:39635 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2924 ms)
[----------] 6 tests from LeaderRebalancerTest (291854 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:13:20.309402 25395 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.204.254:33555
I20260709 13:13:20.310676 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:20.316510  2531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:20.316807  2532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:20.317859  2534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:20.318441 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:20.319324 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:20.319518 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:20.319651 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602800319639 us; error 0 us; skew 500 ppm
I20260709 13:13:20.320161 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:20.323082 25395 webserver.cc:533] Webserver started at http://127.24.204.254:32851/ using document root <none> and password file <none>
I20260709 13:13:20.323559 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:20.323725 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:20.323956 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:20.325105 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/master-0-root/instance:
uuid: "cc1ac08932574049a668eba12f65d4c6"
format_stamp: "Formatted at 2026-07-09 13:13:20 on dist-test-slave-qv7r"
I20260709 13:13:20.329903 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:13:20.333645  2539 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.334489 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:13:20.334806 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/master-0-root
uuid: "cc1ac08932574049a668eba12f65d4c6"
format_stamp: "Formatted at 2026-07-09 13:13:20 on dist-test-slave-qv7r"
I20260709 13:13:20.335134 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:20.350432 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:20.351821 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:20.394938 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.254:33555
I20260709 13:13:20.395104  2590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.254:33555 every 8 connection(s)
I20260709 13:13:20.399168  2591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.410306  2591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6: Bootstrap starting.
I20260709 13:13:20.415088  2591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.419768  2591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6: No bootstrap required, opened a new log
I20260709 13:13:20.422148  2591 raft_consensus.cc:359] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1ac08932574049a668eba12f65d4c6" member_type: VOTER }
I20260709 13:13:20.422574  2591 raft_consensus.cc:385] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.422793  2591 raft_consensus.cc:740] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1ac08932574049a668eba12f65d4c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.423463  2591 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1ac08932574049a668eba12f65d4c6" member_type: VOTER }
I20260709 13:13:20.423933  2591 raft_consensus.cc:399] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:20.424141  2591 raft_consensus.cc:493] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:20.424371  2591 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.429605  2591 raft_consensus.cc:515] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1ac08932574049a668eba12f65d4c6" member_type: VOTER }
I20260709 13:13:20.430127  2591 leader_election.cc:304] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc1ac08932574049a668eba12f65d4c6; no voters: 
I20260709 13:13:20.431365  2591 leader_election.cc:290] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:20.431732  2594 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.433344  2594 raft_consensus.cc:697] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 1 LEADER]: Becoming Leader. State: Replica: cc1ac08932574049a668eba12f65d4c6, State: Running, Role: LEADER
I20260709 13:13:20.434103  2594 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1ac08932574049a668eba12f65d4c6" member_type: VOTER }
I20260709 13:13:20.434728  2591 sys_catalog.cc:565] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:20.437485  2595 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc1ac08932574049a668eba12f65d4c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1ac08932574049a668eba12f65d4c6" member_type: VOTER } }
I20260709 13:13:20.437511  2596 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc1ac08932574049a668eba12f65d4c6. Latest consensus state: current_term: 1 leader_uuid: "cc1ac08932574049a668eba12f65d4c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1ac08932574049a668eba12f65d4c6" member_type: VOTER } }
I20260709 13:13:20.438485  2595 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:20.438541  2596 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:20.441123  2600 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:20.446256  2600 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:20.453668 25395 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:20.455891  2600 catalog_manager.cc:1383] Generated new cluster ID: f614962fa5f34432bde6af2b175f99e4
I20260709 13:13:20.456213  2600 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:20.474781  2600 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:20.476251  2600 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:20.497330  2600 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6: Generated new TSK 0
I20260709 13:13:20.498019  2600 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:20.521059 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:20.527588  2612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:20.528471  2613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:20.532441 25395 server_base.cc:1061] running on GCE node
W20260709 13:13:20.532263  2615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:20.533895 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:20.534132 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:20.534305 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602800534285 us; error 0 us; skew 500 ppm
I20260709 13:13:20.534848 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:20.537679 25395 webserver.cc:533] Webserver started at http://127.24.204.193:35249/ using document root <none> and password file <none>
I20260709 13:13:20.538174 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:20.538378 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:20.538667 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:20.539748 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-0-root/instance:
uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
format_stamp: "Formatted at 2026-07-09 13:13:20 on dist-test-slave-qv7r"
I20260709 13:13:20.544445 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:20.548161  2620 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.549248 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:13:20.549503 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-0-root
uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
format_stamp: "Formatted at 2026-07-09 13:13:20 on dist-test-slave-qv7r"
I20260709 13:13:20.549854 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:20.572574 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:20.573957 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:20.575700 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:20.578506 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:20.578696 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.578902 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:20.579041 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.621744 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.193:41941
I20260709 13:13:20.621899  2682 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.193:41941 every 8 connection(s)
I20260709 13:13:20.627115 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:20.635249  2687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:20.636978  2688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:20.641207  2690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:20.641860  2683 heartbeater.cc:344] Connected to a master server at 127.24.204.254:33555
I20260709 13:13:20.642138 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:20.642369  2683 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:20.643275  2683 heartbeater.cc:507] Master 127.24.204.254:33555 requested a full tablet report, sending...
I20260709 13:13:20.644024 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:20.644340 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:20.644538 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602800644521 us; error 0 us; skew 500 ppm
I20260709 13:13:20.645280 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:20.645679  2556 ts_manager.cc:194] Registered new tserver with Master: 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941)
I20260709 13:13:20.647820  2556 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50728
I20260709 13:13:20.648303 25395 webserver.cc:533] Webserver started at http://127.24.204.194:40121/ using document root <none> and password file <none>
I20260709 13:13:20.648907 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:20.649142 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:20.649432 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:20.650715 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-1-root/instance:
uuid: "099250c2ee47447f849c9aecd7afe5e2"
format_stamp: "Formatted at 2026-07-09 13:13:20 on dist-test-slave-qv7r"
I20260709 13:13:20.656032 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:20.661791  2695 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.663717 25395 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:13:20.664109 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-1-root
uuid: "099250c2ee47447f849c9aecd7afe5e2"
format_stamp: "Formatted at 2026-07-09 13:13:20 on dist-test-slave-qv7r"
I20260709 13:13:20.664471 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:20.710747 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:20.711962 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:20.713450 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:20.715909 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:20.716152 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.716420 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:20.716599 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.761929 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.194:41897
I20260709 13:13:20.762105  2757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.194:41897 every 8 connection(s)
I20260709 13:13:20.767151 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:20.776062  2762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:20.776438  2761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:20.779286  2764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:20.779628 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:20.781160 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:20.781399  2758 heartbeater.cc:344] Connected to a master server at 127.24.204.254:33555
W20260709 13:13:20.781415 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:20.781951 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602800781929 us; error 0 us; skew 500 ppm
I20260709 13:13:20.782006  2758 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:20.782775 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:20.783041  2758 heartbeater.cc:507] Master 127.24.204.254:33555 requested a full tablet report, sending...
I20260709 13:13:20.785933  2556 ts_manager.cc:194] Registered new tserver with Master: 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:20.786430 25395 webserver.cc:533] Webserver started at http://127.24.204.195:45445/ using document root <none> and password file <none>
I20260709 13:13:20.787333 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:20.787557 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:20.787421  2556 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50738
I20260709 13:13:20.788000 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:20.789400 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-2-root/instance:
uuid: "8d77a93f08ec4c1f95c8ef636803a782"
format_stamp: "Formatted at 2026-07-09 13:13:20 on dist-test-slave-qv7r"
I20260709 13:13:20.794152 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:13:20.798236  2769 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.799317 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:13:20.799587 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-2-root
uuid: "8d77a93f08ec4c1f95c8ef636803a782"
format_stamp: "Formatted at 2026-07-09 13:13:20 on dist-test-slave-qv7r"
I20260709 13:13:20.799839 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602508284650-25395-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:20.852269 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:20.853410 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:20.854732 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:20.856992 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:20.857223 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.857470 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:20.857673 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:20.902199 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.195:39637
I20260709 13:13:20.902266  2831 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.195:39637 every 8 connection(s)
I20260709 13:13:20.916985  2832 heartbeater.cc:344] Connected to a master server at 127.24.204.254:33555
I20260709 13:13:20.917484  2832 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:20.918303  2832 heartbeater.cc:507] Master 127.24.204.254:33555 requested a full tablet report, sending...
I20260709 13:13:20.920779  2556 ts_manager.cc:194] Registered new tserver with Master: 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:20.920987 25395 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015236918s
I20260709 13:13:20.922739  2556 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50752
I20260709 13:13:20.951869  2556 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50764:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:20.955983  2556 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:21.043771  2723 tablet_service.cc:1511] Processing CreateTablet for tablet a0eb8caca99640d7a0d64ebf3353bace (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:21.044800  2720 tablet_service.cc:1511] Processing CreateTablet for tablet 1c553a5e178647d2b4fa86590d962129 (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:21.045457  2723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eb8caca99640d7a0d64ebf3353bace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.046299  2720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c553a5e178647d2b4fa86590d962129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.046849  2795 tablet_service.cc:1511] Processing CreateTablet for tablet 685c5dad375049e8ae64318ca8ab173a (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:21.048306  2722 tablet_service.cc:1511] Processing CreateTablet for tablet 8619ca8ad1ee465784515254d7fd756d (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:21.044330  2797 tablet_service.cc:1511] Processing CreateTablet for tablet a0eb8caca99640d7a0d64ebf3353bace (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:21.049902  2722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8619ca8ad1ee465784515254d7fd756d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.052042  2794 tablet_service.cc:1511] Processing CreateTablet for tablet 1c553a5e178647d2b4fa86590d962129 (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:21.052910  2719 tablet_service.cc:1511] Processing CreateTablet for tablet c56336482a8e4c1db94c7eeeba0a3fab (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:21.054363  2719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56336482a8e4c1db94c7eeeba0a3fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.054095  2721 tablet_service.cc:1511] Processing CreateTablet for tablet 685c5dad375049e8ae64318ca8ab173a (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:21.054502  2793 tablet_service.cc:1511] Processing CreateTablet for tablet c56336482a8e4c1db94c7eeeba0a3fab (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:21.055709  2721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685c5dad375049e8ae64318ca8ab173a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.045648  2796 tablet_service.cc:1511] Processing CreateTablet for tablet 8619ca8ad1ee465784515254d7fd756d (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:21.058236  2792 tablet_service.cc:1511] Processing CreateTablet for tablet c522f3392ecf413b9300903402274585 (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:21.048358  2795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685c5dad375049e8ae64318ca8ab173a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.060197  2792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c522f3392ecf413b9300903402274585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.060850  2796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8619ca8ad1ee465784515254d7fd756d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.061885  2797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eb8caca99640d7a0d64ebf3353bace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.062721  2791 tablet_service.cc:1511] Processing CreateTablet for tablet d402ce9601b14df8a47ced4dbcbf59c6 (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:21.064119  2791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d402ce9601b14df8a47ced4dbcbf59c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.064864  2794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c553a5e178647d2b4fa86590d962129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.067461  2790 tablet_service.cc:1511] Processing CreateTablet for tablet 58abab3ac23a474286cfa01dbd7a0b1b (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:21.068920  2790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58abab3ac23a474286cfa01dbd7a0b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.071434  2789 tablet_service.cc:1511] Processing CreateTablet for tablet ab68d90fa54d47ce83ddf5520d54389f (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:21.072894  2789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab68d90fa54d47ce83ddf5520d54389f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.074066  2793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56336482a8e4c1db94c7eeeba0a3fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.087790  2648 tablet_service.cc:1511] Processing CreateTablet for tablet a0eb8caca99640d7a0d64ebf3353bace (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:21.088325  2646 tablet_service.cc:1511] Processing CreateTablet for tablet 685c5dad375049e8ae64318ca8ab173a (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:21.089448  2648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eb8caca99640d7a0d64ebf3353bace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.090709  2645 tablet_service.cc:1511] Processing CreateTablet for tablet 1c553a5e178647d2b4fa86590d962129 (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:21.092299  2645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c553a5e178647d2b4fa86590d962129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.094679  2647 tablet_service.cc:1511] Processing CreateTablet for tablet 8619ca8ad1ee465784515254d7fd756d (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:21.096161  2647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8619ca8ad1ee465784515254d7fd756d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.095868  2643 tablet_service.cc:1511] Processing CreateTablet for tablet c522f3392ecf413b9300903402274585 (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:21.094679  2644 tablet_service.cc:1511] Processing CreateTablet for tablet c56336482a8e4c1db94c7eeeba0a3fab (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:21.097225  2643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c522f3392ecf413b9300903402274585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.098295  2642 tablet_service.cc:1511] Processing CreateTablet for tablet d402ce9601b14df8a47ced4dbcbf59c6 (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:21.100485  2641 tablet_service.cc:1511] Processing CreateTablet for tablet 58abab3ac23a474286cfa01dbd7a0b1b (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:21.101910  2641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58abab3ac23a474286cfa01dbd7a0b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.102578  2644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56336482a8e4c1db94c7eeeba0a3fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.104027  2640 tablet_service.cc:1511] Processing CreateTablet for tablet ab68d90fa54d47ce83ddf5520d54389f (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:21.105403  2640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab68d90fa54d47ce83ddf5520d54389f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.110406  2646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685c5dad375049e8ae64318ca8ab173a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.118305  2642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d402ce9601b14df8a47ced4dbcbf59c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.143396  2847 tablet_bootstrap.cc:492] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:21.151098  2723 tablet_service.cc:1511] Processing CreateTablet for tablet c522f3392ecf413b9300903402274585 (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:21.152494  2723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c522f3392ecf413b9300903402274585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.155827  2848 tablet_bootstrap.cc:492] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:21.156316  2721 tablet_service.cc:1511] Processing CreateTablet for tablet d402ce9601b14df8a47ced4dbcbf59c6 (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:21.158742  2718 tablet_service.cc:1511] Processing CreateTablet for tablet 58abab3ac23a474286cfa01dbd7a0b1b (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:21.161194  2717 tablet_service.cc:1511] Processing CreateTablet for tablet ab68d90fa54d47ce83ddf5520d54389f (DEFAULT_TABLE table=test-workload [id=09ae199a5e664fdc850fb2f6680acb84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:21.162724  2717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab68d90fa54d47ce83ddf5520d54389f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.165971  2721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d402ce9601b14df8a47ced4dbcbf59c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.167894  2847 tablet_bootstrap.cc:654] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.172426  2848 tablet_bootstrap.cc:654] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.173971  2718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58abab3ac23a474286cfa01dbd7a0b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.214095  2849 tablet_bootstrap.cc:492] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:21.226775  2848 tablet_bootstrap.cc:492] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:21.227375  2848 ts_tablet_manager.cc:1403] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.004s
I20260709 13:13:21.233091  2848 raft_consensus.cc:359] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.233739  2848 raft_consensus.cc:385] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.234057  2848 raft_consensus.cc:740] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.234993  2848 consensus_queue.cc:260] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.248152  2849 tablet_bootstrap.cc:654] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.259366  2847 tablet_bootstrap.cc:492] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:21.259909  2847 ts_tablet_manager.cc:1403] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.022s
I20260709 13:13:21.262838  2848 ts_tablet_manager.cc:1434] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.010s
I20260709 13:13:21.262728  2847 raft_consensus.cc:359] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.263603  2847 raft_consensus.cc:385] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.263830  2758 heartbeater.cc:499] Master 127.24.204.254:33555 was elected leader, sending a full tablet report...
I20260709 13:13:21.263917  2847 raft_consensus.cc:740] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.264904  2847 consensus_queue.cc:260] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.274704  2848 tablet_bootstrap.cc:492] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:21.298388  2848 tablet_bootstrap.cc:654] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.300823  2849 tablet_bootstrap.cc:492] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:21.301513  2849 ts_tablet_manager.cc:1403] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.013s
I20260709 13:13:21.304701  2847 ts_tablet_manager.cc:1434] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.044s	user 0.022s	sys 0.018s
I20260709 13:13:21.305596  2832 heartbeater.cc:499] Master 127.24.204.254:33555 was elected leader, sending a full tablet report...
I20260709 13:13:21.306016  2847 tablet_bootstrap.cc:492] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:21.306071  2849 raft_consensus.cc:359] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.307071  2849 raft_consensus.cc:385] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.307384  2849 raft_consensus.cc:740] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.308413  2849 consensus_queue.cc:260] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.313483  2848 tablet_bootstrap.cc:492] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:21.314078  2848 ts_tablet_manager.cc:1403] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.006s
I20260709 13:13:21.316187  2848 raft_consensus.cc:359] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.316717  2848 raft_consensus.cc:385] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.317039  2848 raft_consensus.cc:740] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.317797  2848 consensus_queue.cc:260] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.321213  2848 ts_tablet_manager.cc:1434] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:21.324512  2847 tablet_bootstrap.cc:654] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.326289  2856 raft_consensus.cc:493] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.326323  2683 heartbeater.cc:499] Master 127.24.204.254:33555 was elected leader, sending a full tablet report...
I20260709 13:13:21.327015  2856 raft_consensus.cc:515] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.336763  2856 leader_election.cc:290] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.339661  2848 tablet_bootstrap.cc:492] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:21.350284  2849 ts_tablet_manager.cc:1434] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.048s	user 0.013s	sys 0.011s
I20260709 13:13:21.351960  2848 tablet_bootstrap.cc:654] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.353754  2849 tablet_bootstrap.cc:492] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:21.369921  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
W20260709 13:13:21.372346  2621 leader_election.cc:343] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.375813  2848 tablet_bootstrap.cc:492] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:21.376514  2848 ts_tablet_manager.cc:1403] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.009s
I20260709 13:13:21.378793  2849 tablet_bootstrap.cc:654] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.379693  2848 raft_consensus.cc:359] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.381927  2848 raft_consensus.cc:385] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.382292  2848 raft_consensus.cc:740] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.382684  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:21.381443  2847 tablet_bootstrap.cc:492] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:21.383126  2848 consensus_queue.cc:260] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.384105  2847 ts_tablet_manager.cc:1403] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.078s	user 0.038s	sys 0.022s
W20260709 13:13:21.384275  2624 leader_election.cc:343] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.384755  2624 leader_election.cc:304] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:21.386075  2857 raft_consensus.cc:2749] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.387317  2847 raft_consensus.cc:359] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.388053  2847 raft_consensus.cc:385] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.388360  2847 raft_consensus.cc:740] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.389132  2848 ts_tablet_manager.cc:1434] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:13:21.389292  2847 consensus_queue.cc:260] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.390338  2852 raft_consensus.cc:493] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.390842  2852 raft_consensus.cc:515] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.391695  2847 ts_tablet_manager.cc:1434] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:21.392742  2847 tablet_bootstrap.cc:492] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:21.395135  2849 tablet_bootstrap.cc:492] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:21.395750  2849 ts_tablet_manager.cc:1403] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.000s
I20260709 13:13:21.398722  2847 tablet_bootstrap.cc:654] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.401471  2849 raft_consensus.cc:359] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.402483  2849 raft_consensus.cc:385] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.402557  2852 leader_election.cc:290] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.402858  2849 raft_consensus.cc:740] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.406873  2849 consensus_queue.cc:260] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.408605  2848 tablet_bootstrap.cc:492] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:21.410307  2847 tablet_bootstrap.cc:492] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:21.410844  2847 ts_tablet_manager.cc:1403] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.010s
I20260709 13:13:21.414031  2847 raft_consensus.cc:359] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.414796  2847 raft_consensus.cc:385] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.415096  2847 raft_consensus.cc:740] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.416133  2847 consensus_queue.cc:260] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.417212  2849 ts_tablet_manager.cc:1434] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:13:21.418300  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685c5dad375049e8ae64318ca8ab173a" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:21.419023  2807 raft_consensus.cc:2468] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:21.420485  2699 leader_election.cc:304] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:21.420796  2849 tablet_bootstrap.cc:492] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:21.421427  2852 raft_consensus.cc:2804] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.421823  2852 raft_consensus.cc:493] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.422164  2852 raft_consensus.cc:3060] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.423242  2854 raft_consensus.cc:493] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.423724  2854 raft_consensus.cc:515] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.427466  2854 leader_election.cc:290] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:21.428040  2849 tablet_bootstrap.cc:654] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.422575  2847 ts_tablet_manager.cc:1434] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:13:21.432725  2847 tablet_bootstrap.cc:492] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:21.440366  2847 tablet_bootstrap.cc:654] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:21.448618  2604 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:21.456987  2852 raft_consensus.cc:515] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.460640  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685c5dad375049e8ae64318ca8ab173a" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
W20260709 13:13:21.462855  2697 leader_election.cc:343] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.469537  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685c5dad375049e8ae64318ca8ab173a" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:21.469825  2848 tablet_bootstrap.cc:654] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:21.471261  2697 leader_election.cc:343] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.473960  2849 tablet_bootstrap.cc:492] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:21.471303  2847 tablet_bootstrap.cc:492] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:21.474728  2849 ts_tablet_manager.cc:1403] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.014s
I20260709 13:13:21.475423  2847 ts_tablet_manager.cc:1403] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.009s
I20260709 13:13:21.478900  2871 raft_consensus.cc:493] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.478899  2849 raft_consensus.cc:359] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.479880  2849 raft_consensus.cc:385] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.479700  2871 raft_consensus.cc:515] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.480238  2849 raft_consensus.cc:740] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.481362  2848 tablet_bootstrap.cc:492] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:21.481849  2852 leader_election.cc:290] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.482862  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:21.481043  2849 consensus_queue.cc:260] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.483276  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685c5dad375049e8ae64318ca8ab173a" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:21.483873  2807 raft_consensus.cc:3060] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:21.484329  2697 leader_election.cc:343] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.485504  2849 ts_tablet_manager.cc:1434] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:13:21.486639  2849 tablet_bootstrap.cc:492] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:21.486720  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:21.489090  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:21.489864  2658 raft_consensus.cc:2468] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 0.
I20260709 13:13:21.491436  2771 leader_election.cc:304] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:21.492390  2854 raft_consensus.cc:2804] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.492743  2854 raft_consensus.cc:493] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.493175  2854 raft_consensus.cc:3060] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.493446  2849 tablet_bootstrap.cc:654] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.483335  2847 raft_consensus.cc:359] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.495851  2847 raft_consensus.cc:385] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.496206  2847 raft_consensus.cc:740] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.497093  2847 consensus_queue.cc:260] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.498019  2806 raft_consensus.cc:2468] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:21.498083  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
W20260709 13:13:21.500701  2770 leader_election.cc:343] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.502147  2699 leader_election.cc:304] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:21.503409  2852 raft_consensus.cc:2804] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.503774  2852 raft_consensus.cc:493] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.504137  2852 raft_consensus.cc:3060] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.508319  2854 raft_consensus.cc:515] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.509855  2852 raft_consensus.cc:515] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.510104  2871 leader_election.cc:290] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.492712  2807 raft_consensus.cc:2468] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:21.512187  2699 leader_election.cc:304] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:21.513406  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:21.513823  2871 raft_consensus.cc:2804] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:21.515185  2697 leader_election.cc:343] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.509852  2848 ts_tablet_manager.cc:1403] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.101s	user 0.005s	sys 0.014s
I20260709 13:13:21.517951  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:21.518719  2806 raft_consensus.cc:3060] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.519686  2848 raft_consensus.cc:359] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.520824  2848 raft_consensus.cc:385] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.529390  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:21.529847  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:21.530447  2658 raft_consensus.cc:3060] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:21.532078  2770 leader_election.cc:343] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.532932  2871 raft_consensus.cc:697] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:21.534538  2871 consensus_queue.cc:237] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.521227  2848 raft_consensus.cc:740] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.540596  2854 leader_election.cc:290] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:21.541702  2852 leader_election.cc:290] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.538252  2848 consensus_queue.cc:260] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.544673  2806 raft_consensus.cc:2468] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:21.544967  2847 ts_tablet_manager.cc:1434] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.026s
I20260709 13:13:21.546113  2699 leader_election.cc:304] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:21.547335  2852 raft_consensus.cc:2804] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.547888  2852 raft_consensus.cc:697] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:21.549753  2847 tablet_bootstrap.cc:492] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:21.549629  2852 consensus_queue.cc:237] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.551481  2848 ts_tablet_manager.cc:1434] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.005s
I20260709 13:13:21.552987  2848 tablet_bootstrap.cc:492] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:21.554176  2854 raft_consensus.cc:493] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.554714  2854 raft_consensus.cc:515] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.557833  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c553a5e178647d2b4fa86590d962129" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:21.547794  2658 raft_consensus.cc:2468] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 1.
I20260709 13:13:21.559365  2848 tablet_bootstrap.cc:654] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:21.559345  2771 leader_election.cc:343] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.560647  2771 leader_election.cc:304] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 099250c2ee47447f849c9aecd7afe5e2
I20260709 13:13:21.561697  2874 raft_consensus.cc:2804] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.563442  2874 raft_consensus.cc:697] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Becoming Leader. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:21.564348  2874 consensus_queue.cc:237] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.559715  2847 tablet_bootstrap.cc:654] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.567301  2848 tablet_bootstrap.cc:492] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:21.567924  2848 ts_tablet_manager.cc:1403] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.006s
I20260709 13:13:21.569183  2555 catalog_manager.cc:5697] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.571372  2848 raft_consensus.cc:359] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.572227  2848 raft_consensus.cc:385] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.572731  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c553a5e178647d2b4fa86590d962129" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:21.574592  2854 leader_election.cc:290] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
W20260709 13:13:21.574673  2770 leader_election.cc:343] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.575507  2849 tablet_bootstrap.cc:492] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:21.575783  2871 raft_consensus.cc:493] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.576725  2770 leader_election.cc:304] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d77a93f08ec4c1f95c8ef636803a782; no voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:21.576846  2871 raft_consensus.cc:515] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.572731  2848 raft_consensus.cc:740] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.580525  2848 consensus_queue.cc:260] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.582278  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:21.582845  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:21.584726  2848 ts_tablet_manager.cc:1434] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
W20260709 13:13:21.584884  2697 leader_election.cc:343] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.585886  2848 tablet_bootstrap.cc:492] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
W20260709 13:13:21.586675  2699 leader_election.cc:343] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.587345  2699 leader_election.cc:304] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2; no voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:21.587611  2556 catalog_manager.cc:5697] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:21.588536  2871 leader_election.cc:290] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.588584  2875 raft_consensus.cc:2749] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.590252  2849 ts_tablet_manager.cc:1403] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.104s	user 0.036s	sys 0.034s
I20260709 13:13:21.591190  2874 raft_consensus.cc:2749] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.594503  2849 raft_consensus.cc:359] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.595599  2849 raft_consensus.cc:385] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.595975  2849 raft_consensus.cc:740] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.597466  2849 consensus_queue.cc:260] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.599858  2849 ts_tablet_manager.cc:1434] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:21.605949  2849 tablet_bootstrap.cc:492] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:21.607223  2848 tablet_bootstrap.cc:654] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.607771  2847 tablet_bootstrap.cc:492] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:21.608417  2847 ts_tablet_manager.cc:1403] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.025s
I20260709 13:13:21.611788  2847 raft_consensus.cc:359] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.614986  2847 raft_consensus.cc:385] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.615396  2847 raft_consensus.cc:740] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.612746  2849 tablet_bootstrap.cc:654] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.616221  2847 consensus_queue.cc:260] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.618903  2847 ts_tablet_manager.cc:1434] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:13:21.620306  2847 tablet_bootstrap.cc:492] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:21.631692  2847 tablet_bootstrap.cc:654] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.635528  2852 raft_consensus.cc:493] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.636428  2852 raft_consensus.cc:515] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.638525  2555 catalog_manager.cc:5697] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.640671  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eb8caca99640d7a0d64ebf3353bace" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:21.641815  2806 raft_consensus.cc:2468] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:21.643790  2699 leader_election.cc:304] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:21.645102  2871 raft_consensus.cc:2804] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.645758  2871 raft_consensus.cc:493] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.645915  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eb8caca99640d7a0d64ebf3353bace" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:21.646329  2871 raft_consensus.cc:3060] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.646692  2658 raft_consensus.cc:2468] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:21.645224  2852 leader_election.cc:290] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.651790  2849 tablet_bootstrap.cc:492] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:21.652666  2849 ts_tablet_manager.cc:1403] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.005s
I20260709 13:13:21.655936  2871 raft_consensus.cc:515] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.656527  2849 raft_consensus.cc:359] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.657363  2849 raft_consensus.cc:385] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.657706  2849 raft_consensus.cc:740] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.651768  2848 tablet_bootstrap.cc:492] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:21.658972  2848 ts_tablet_manager.cc:1403] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.073s	user 0.028s	sys 0.019s
I20260709 13:13:21.660439  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eb8caca99640d7a0d64ebf3353bace" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:21.661188  2806 raft_consensus.cc:3060] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.663851  2848 raft_consensus.cc:359] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.664727  2848 raft_consensus.cc:385] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.665361  2849 consensus_queue.cc:260] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.665011  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eb8caca99640d7a0d64ebf3353bace" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:21.667732  2658 raft_consensus.cc:3060] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.668287  2849 ts_tablet_manager.cc:1434] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:13:21.669457  2849 tablet_bootstrap.cc:492] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:21.669987  2806 raft_consensus.cc:2468] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:21.671360  2699 leader_election.cc:304] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:21.672307  2852 raft_consensus.cc:2804] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.672878  2852 raft_consensus.cc:697] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:21.673885  2852 consensus_queue.cc:237] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.677459  2849 tablet_bootstrap.cc:654] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.680109  2871 leader_election.cc:290] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.665058  2848 raft_consensus.cc:740] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.690198  2849 tablet_bootstrap.cc:492] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:21.690817  2849 ts_tablet_manager.cc:1403] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 13:13:21.691504  2848 consensus_queue.cc:260] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.693492  2847 tablet_bootstrap.cc:492] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:21.692804  2658 raft_consensus.cc:2468] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:21.694042  2847 ts_tablet_manager.cc:1403] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.074s	user 0.027s	sys 0.018s
I20260709 13:13:21.694259  2849 raft_consensus.cc:359] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.695163  2849 raft_consensus.cc:385] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.695506  2849 raft_consensus.cc:740] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.695544  2554 catalog_manager.cc:5697] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.696656  2848 ts_tablet_manager.cc:1434] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:13:21.696671  2849 consensus_queue.cc:260] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.697320  2847 raft_consensus.cc:359] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.698117  2847 raft_consensus.cc:385] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.698117  2848 tablet_bootstrap.cc:492] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:21.701507  2849 ts_tablet_manager.cc:1434] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:13:21.702661  2849 tablet_bootstrap.cc:492] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:21.698467  2847 raft_consensus.cc:740] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.706228  2848 tablet_bootstrap.cc:654] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.706481  2847 consensus_queue.cc:260] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.708956  2847 ts_tablet_manager.cc:1434] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:13:21.709970  2849 tablet_bootstrap.cc:654] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.714413  2847 tablet_bootstrap.cc:492] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:21.720865  2849 tablet_bootstrap.cc:492] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:21.720903  2848 tablet_bootstrap.cc:492] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:21.721736  2849 ts_tablet_manager.cc:1403] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:13:21.721794  2848 ts_tablet_manager.cc:1403] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.002s
I20260709 13:13:21.725207  2849 raft_consensus.cc:359] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.726040  2849 raft_consensus.cc:385] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.726334  2849 raft_consensus.cc:740] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.727089  2849 consensus_queue.cc:260] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.728826  2847 tablet_bootstrap.cc:654] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.729432  2849 ts_tablet_manager.cc:1434] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:13:21.730722  2849 tablet_bootstrap.cc:492] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:21.730942  2848 raft_consensus.cc:359] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.731806  2848 raft_consensus.cc:385] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.732164  2848 raft_consensus.cc:740] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.733047  2848 consensus_queue.cc:260] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.736017  2848 ts_tablet_manager.cc:1434] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:13:21.737345  2848 tablet_bootstrap.cc:492] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:21.740507  2849 tablet_bootstrap.cc:654] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.744859  2848 tablet_bootstrap.cc:654] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.758685  2847 tablet_bootstrap.cc:492] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:21.759184  2849 tablet_bootstrap.cc:492] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:21.759207  2847 ts_tablet_manager.cc:1403] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.023s
I20260709 13:13:21.759855  2849 ts_tablet_manager.cc:1403] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.016s
I20260709 13:13:21.760452  2857 raft_consensus.cc:493] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.760947  2857 raft_consensus.cc:515] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.762614  2849 raft_consensus.cc:359] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.763197  2857 leader_election.cc:290] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.763336  2849 raft_consensus.cc:385] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.763747  2849 raft_consensus.cc:740] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.764415  2849 consensus_queue.cc:260] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.764994  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522f3392ecf413b9300903402274585" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:21.766490  2849 ts_tablet_manager.cc:1434] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
W20260709 13:13:21.767189  2624 leader_election.cc:343] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.767172  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522f3392ecf413b9300903402274585" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
W20260709 13:13:21.769219  2621 leader_election.cc:343] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.769634  2849 tablet_bootstrap.cc:492] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:21.769858  2621 leader_election.cc:304] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:21.770810  2857 raft_consensus.cc:2749] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.771901  2847 raft_consensus.cc:359] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.772701  2848 tablet_bootstrap.cc:492] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:21.772714  2847 raft_consensus.cc:385] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.773418  2847 raft_consensus.cc:740] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.773973  2857 raft_consensus.cc:493] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.774359  2847 consensus_queue.cc:260] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.774518  2857 raft_consensus.cc:515] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.776324  2849 tablet_bootstrap.cc:654] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.778306  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:21.779067  2733 raft_consensus.cc:2468] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 0.
I20260709 13:13:21.780494  2621 leader_election.cc:304] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:21.781450  2856 raft_consensus.cc:2804] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.781874  2856 raft_consensus.cc:493] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.782233  2856 raft_consensus.cc:3060] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.787192  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
W20260709 13:13:21.789008  2624 leader_election.cc:343] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.790145  2857 leader_election.cc:290] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.773445  2848 ts_tablet_manager.cc:1403] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.015s
I20260709 13:13:21.791275  2847 ts_tablet_manager.cc:1434] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:13:21.793375  2856 raft_consensus.cc:515] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.794543  2848 raft_consensus.cc:359] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.795379  2848 raft_consensus.cc:385] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.795744  2848 raft_consensus.cc:740] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.796588  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:21.796793  2847 tablet_bootstrap.cc:492] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:21.797344  2733 raft_consensus.cc:3060] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.799145  2854 raft_consensus.cc:493] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.799590  2849 tablet_bootstrap.cc:492] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:21.800231  2849 ts_tablet_manager.cc:1403] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.012s
I20260709 13:13:21.799711  2854 raft_consensus.cc:515] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.796661  2848 consensus_queue.cc:260] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.804178  2848 ts_tablet_manager.cc:1434] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:13:21.804612  2849 raft_consensus.cc:359] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.805367  2849 raft_consensus.cc:385] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.805742  2849 raft_consensus.cc:740] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.805153  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58abab3ac23a474286cfa01dbd7a0b1b" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:21.806540  2658 raft_consensus.cc:2468] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 0.
I20260709 13:13:21.806463  2849 consensus_queue.cc:260] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.808041  2771 leader_election.cc:304] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:21.808892  2874 raft_consensus.cc:2804] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.809243  2874 raft_consensus.cc:493] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.809541  2874 raft_consensus.cc:3060] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.810125  2733 raft_consensus.cc:2468] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 1.
I20260709 13:13:21.811132  2849 ts_tablet_manager.cc:1434] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:13:21.811715  2848 tablet_bootstrap.cc:492] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:21.813392  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58abab3ac23a474286cfa01dbd7a0b1b" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:21.814155  2732 raft_consensus.cc:2468] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 0.
I20260709 13:13:21.817014  2856 leader_election.cc:290] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.817902  2621 leader_election.cc:304] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:21.818764  2852 raft_consensus.cc:493] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.817246  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:21.819254  2852 raft_consensus.cc:515] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
W20260709 13:13:21.820241  2624 leader_election.cc:343] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.821431  2852 leader_election.cc:290] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.822846  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522f3392ecf413b9300903402274585" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:21.823159  2847 tablet_bootstrap.cc:654] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:21.824394  2699 leader_election.cc:343] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.824415  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522f3392ecf413b9300903402274585" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:21.825762  2658 raft_consensus.cc:2468] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:21.826654  2848 tablet_bootstrap.cc:654] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.827025  2697 leader_election.cc:304] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:21.827813  2852 raft_consensus.cc:2804] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.824518  2854 leader_election.cc:290] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:21.828179  2852 raft_consensus.cc:493] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.828557  2852 raft_consensus.cc:3060] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.832808  2874 raft_consensus.cc:515] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.836133  2856 raft_consensus.cc:2804] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.836256  2852 raft_consensus.cc:515] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.837612  2856 raft_consensus.cc:697] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:21.837870  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58abab3ac23a474286cfa01dbd7a0b1b" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:21.838572  2856 consensus_queue.cc:237] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.838795  2658 raft_consensus.cc:3060] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.836593  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58abab3ac23a474286cfa01dbd7a0b1b" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:21.839429  2847 tablet_bootstrap.cc:492] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:21.839805  2732 raft_consensus.cc:3060] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.840008  2847 ts_tablet_manager.cc:1403] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.000s
I20260709 13:13:21.840378  2874 leader_election.cc:290] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:21.843197  2847 raft_consensus.cc:359] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.843926  2847 raft_consensus.cc:385] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.844235  2847 raft_consensus.cc:740] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.845060  2847 consensus_queue.cc:260] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.845745  2848 tablet_bootstrap.cc:492] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:21.846349  2848 ts_tablet_manager.cc:1403] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.015s
I20260709 13:13:21.847193  2847 ts_tablet_manager.cc:1434] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:21.850237  2732 raft_consensus.cc:2468] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 1.
I20260709 13:13:21.850041  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522f3392ecf413b9300903402274585" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:21.857887  2657 raft_consensus.cc:3060] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.858603  2770 leader_election.cc:304] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:21.851821  2847 tablet_bootstrap.cc:492] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:21.859669  2874 raft_consensus.cc:2804] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.860329  2874 raft_consensus.cc:697] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Becoming Leader. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:21.861217  2874 consensus_queue.cc:237] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.850025  2848 raft_consensus.cc:359] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.852392  2852 leader_election.cc:290] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.853888  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522f3392ecf413b9300903402274585" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:21.866026  2848 raft_consensus.cc:385] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.866129  2806 raft_consensus.cc:3060] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.866385  2848 raft_consensus.cc:740] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.866582  2847 tablet_bootstrap.cc:654] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.866519  2657 raft_consensus.cc:2468] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:21.867319  2848 consensus_queue.cc:260] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.867964  2697 leader_election.cc:304] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:21.868846  2852 raft_consensus.cc:2804] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.869470  2852 raft_consensus.cc:697] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:21.870388  2852 consensus_queue.cc:237] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.856980  2658 raft_consensus.cc:2468] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 1.
I20260709 13:13:21.871690  2848 ts_tablet_manager.cc:1434] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:13:21.859633  2554 catalog_manager.cc:5697] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 1 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.878409  2856 raft_consensus.cc:493] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.879280  2856 raft_consensus.cc:515] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.886684  2856 leader_election.cc:290] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.888803  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:21.889724  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:21.890604  2807 raft_consensus.cc:2393] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in current term 1: Already voted for candidate 099250c2ee47447f849c9aecd7afe5e2 in this term.
I20260709 13:13:21.891744  2624 leader_election.cc:304] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:21.893437  2856 raft_consensus.cc:3060] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.887110  2806 raft_consensus.cc:2468] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:21.899487  2554 catalog_manager.cc:5697] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.901298  2856 raft_consensus.cc:2749] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.903381  2847 tablet_bootstrap.cc:492] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:21.902884  2556 catalog_manager.cc:5697] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:21.903887  2847 ts_tablet_manager.cc:1403] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 13:13:21.907080  2847 raft_consensus.cc:359] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.907639  2847 raft_consensus.cc:385] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.907922  2847 raft_consensus.cc:740] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.908782  2847 consensus_queue.cc:260] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.910912  2847 ts_tablet_manager.cc:1434] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:21.948153  2852 raft_consensus.cc:493] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.948870  2852 raft_consensus.cc:515] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.950575  2852 leader_election.cc:290] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.951812  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:21.951742  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:21.953169  2658 raft_consensus.cc:2393] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 099250c2ee47447f849c9aecd7afe5e2 in current term 1: Already voted for candidate 8d77a93f08ec4c1f95c8ef636803a782 in this term.
I20260709 13:13:21.954486  2697 leader_election.cc:304] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2; no voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:21.955469  2852 raft_consensus.cc:3060] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.961941  2852 raft_consensus.cc:2749] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.966323  2874 consensus_queue.cc:1048] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.980145  2856 raft_consensus.cc:493] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.980943  2856 raft_consensus.cc:515] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.984524  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685c5dad375049e8ae64318ca8ab173a" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:21.986459  2905 raft_consensus.cc:493] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.987113  2905 raft_consensus.cc:515] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:21.989349  2905 leader_election.cc:290] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:21.989918  2905 consensus_queue.cc:1048] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.990501  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:21.992800  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:21.993698  2733 raft_consensus.cc:2393] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d77a93f08ec4c1f95c8ef636803a782 in current term 1: Already voted for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in this term.
I20260709 13:13:21.994876  2770 leader_election.cc:304] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d77a93f08ec4c1f95c8ef636803a782; no voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:21.997795  2904 raft_consensus.cc:3060] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.998926  2856 leader_election.cc:290] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:21.999598  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685c5dad375049e8ae64318ca8ab173a" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:22.000638  2806 raft_consensus.cc:2393] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in current term 1: Already voted for candidate 099250c2ee47447f849c9aecd7afe5e2 in this term.
I20260709 13:13:22.001956  2624 leader_election.cc:304] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:22.003165  2856 raft_consensus.cc:3060] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.007794  2904 raft_consensus.cc:2749] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:22.012552  2856 raft_consensus.cc:2749] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:22.039402  2852 raft_consensus.cc:493] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.040040  2852 raft_consensus.cc:515] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.041980  2852 leader_election.cc:290] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:22.042959  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c553a5e178647d2b4fa86590d962129" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:22.043138  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c553a5e178647d2b4fa86590d962129" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:22.043609  2658 raft_consensus.cc:2468] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:22.044003  2806 raft_consensus.cc:2468] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:22.044700  2697 leader_election.cc:304] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:22.045775  2852 raft_consensus.cc:2804] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.046152  2852 raft_consensus.cc:493] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.046445  2852 raft_consensus.cc:3060] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.051945  2852 raft_consensus.cc:515] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.053627  2852 leader_election.cc:290] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:22.054585  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c553a5e178647d2b4fa86590d962129" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:22.055222  2658 raft_consensus.cc:3060] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.054973  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c553a5e178647d2b4fa86590d962129" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:22.055723  2806 raft_consensus.cc:3060] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.060364  2658 raft_consensus.cc:2468] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:22.061157  2806 raft_consensus.cc:2468] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:22.061697  2697 leader_election.cc:304] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:22.062729  2852 raft_consensus.cc:2804] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:22.063118  2852 raft_consensus.cc:697] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:22.063853  2852 consensus_queue.cc:237] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.067564  2852 consensus_queue.cc:1048] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.074898  2556 catalog_manager.cc:5697] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.085420  2875 consensus_queue.cc:1048] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.085654  2852 consensus_queue.cc:1048] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.094660  2911 consensus_queue.cc:1048] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:22.183696  2915 consensus_queue.cc:1048] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.186654  2915 consensus_queue.cc:1048] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.187718  2905 raft_consensus.cc:493] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.188380  2905 raft_consensus.cc:515] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.190676  2905 leader_election.cc:290] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:22.191425  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab68d90fa54d47ce83ddf5520d54389f" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:22.192160  2658 raft_consensus.cc:2468] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 0.
I20260709 13:13:22.193477  2771 leader_election.cc:304] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:22.194199  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab68d90fa54d47ce83ddf5520d54389f" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:22.194506  2904 raft_consensus.cc:2804] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.194924  2904 raft_consensus.cc:493] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.194955  2732 raft_consensus.cc:2468] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 0.
I20260709 13:13:22.195348  2904 raft_consensus.cc:3060] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.204584  2904 raft_consensus.cc:515] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.208527  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab68d90fa54d47ce83ddf5520d54389f" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:22.209267  2732 raft_consensus.cc:3060] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.210016  2904 leader_election.cc:290] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:22.212093  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab68d90fa54d47ce83ddf5520d54389f" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:22.212800  2658 raft_consensus.cc:3060] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.217151  2732 raft_consensus.cc:2468] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 1.
I20260709 13:13:22.218463  2770 leader_election.cc:304] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:22.219290  2904 raft_consensus.cc:2804] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:22.219837  2904 raft_consensus.cc:697] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Becoming Leader. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:22.220328  2658 raft_consensus.cc:2468] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 1.
I20260709 13:13:22.220661  2904 consensus_queue.cc:237] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.228384  2555 catalog_manager.cc:5697] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:22.317126  2904 consensus_queue.cc:1048] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.320820  2856 consensus_queue.cc:1048] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.330050  2915 consensus_queue.cc:1048] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.335816  2905 consensus_queue.cc:1048] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.339550  2856 consensus_queue.cc:1048] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:22.366693  2875 consensus_queue.cc:1048] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.470220  2732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0eb8caca99640d7a0d64ebf3353bace"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
mode: GRACEFUL
new_leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:49976
I20260709 13:13:22.470775  2732 raft_consensus.cc:606] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Received request to transfer leadership to TS 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:22.476516  2732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
mode: GRACEFUL
new_leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:49976
I20260709 13:13:22.477177  2732 raft_consensus.cc:606] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Received request to transfer leadership to TS 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:22.483103  2732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "685c5dad375049e8ae64318ca8ab173a"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
mode: GRACEFUL
new_leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:49976
I20260709 13:13:22.483650  2732 raft_consensus.cc:606] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Received request to transfer leadership to TS 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:22.489317  2732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c553a5e178647d2b4fa86590d962129"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
mode: GRACEFUL
new_leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:49976
I20260709 13:13:22.490034  2732 raft_consensus.cc:606] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Received request to transfer leadership to TS 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:22.504046  2807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab"
dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
mode: GRACEFUL
new_leader_uuid: "099250c2ee47447f849c9aecd7afe5e2"
 from {username='slave'} at 127.0.0.1:44706
I20260709 13:13:22.504557  2807 raft_consensus.cc:606] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Received request to transfer leadership to TS 099250c2ee47447f849c9aecd7afe5e2
I20260709 13:13:22.522925  2658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
mode: GRACEFUL
new_leader_uuid: "099250c2ee47447f849c9aecd7afe5e2"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:13:22.523627  2658 raft_consensus.cc:606] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Received request to transfer leadership to TS 099250c2ee47447f849c9aecd7afe5e2
I20260709 13:13:22.529542  2807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58abab3ac23a474286cfa01dbd7a0b1b"
dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
mode: GRACEFUL
new_leader_uuid: "099250c2ee47447f849c9aecd7afe5e2"
 from {username='slave'} at 127.0.0.1:44706
I20260709 13:13:22.530118  2807 raft_consensus.cc:606] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Received request to transfer leadership to TS 099250c2ee47447f849c9aecd7afe5e2
I20260709 13:13:22.572417  2852 raft_consensus.cc:993] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2: : Instructing follower 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:22.573078  2875 raft_consensus.cc:1081] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Signalling peer 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:22.574821  2658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:35950
I20260709 13:13:22.575387  2658 raft_consensus.cc:493] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.575670  2658 raft_consensus.cc:3060] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.581085  2658 raft_consensus.cc:515] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.582880  2658 leader_election.cc:290] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:22.583896  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:22.584051  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:22.584554  2732 raft_consensus.cc:3055] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.584728  2807 raft_consensus.cc:3060] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.584882  2732 raft_consensus.cc:740] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:22.585839  2732 consensus_queue.cc:260] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.586800  2732 raft_consensus.cc:3060] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.590876  2807 raft_consensus.cc:2468] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:22.592268  2624 leader_election.cc:304] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:22.592793  2732 raft_consensus.cc:2468] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:22.593057  2922 raft_consensus.cc:2804] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.593605  2922 raft_consensus.cc:697] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:22.594326  2875 consensus_queue.cc:1048] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.594450  2922 consensus_queue.cc:237] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.603639  2555 catalog_manager.cc:5697] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 1 to 2, leader changed from 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194) to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 2 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.606158  2911 consensus_queue.cc:1048] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.614941  2852 raft_consensus.cc:993] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2: : Instructing follower 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:22.615406  2911 raft_consensus.cc:1081] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Signalling peer 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:22.617014  2658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c553a5e178647d2b4fa86590d962129"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:35950
I20260709 13:13:22.617712  2658 raft_consensus.cc:493] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.618086  2658 raft_consensus.cc:3060] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.623288  2658 raft_consensus.cc:515] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.624907  2658 leader_election.cc:290] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:22.625809  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c553a5e178647d2b4fa86590d962129" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:22.626471  2732 raft_consensus.cc:3055] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.626204  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c553a5e178647d2b4fa86590d962129" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:22.626816  2732 raft_consensus.cc:740] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:22.627089  2807 raft_consensus.cc:3060] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.627669  2732 consensus_queue.cc:260] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.628644  2732 raft_consensus.cc:3060] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.632710  2807 raft_consensus.cc:2468] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:22.633492  2732 raft_consensus.cc:2468] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:22.633978  2624 leader_election.cc:304] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:22.634884  2922 raft_consensus.cc:2804] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.635313  2922 raft_consensus.cc:697] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:22.636093  2922 consensus_queue.cc:237] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.643123  2556 catalog_manager.cc:5697] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 1 to 2, leader changed from 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194) to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 2 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.649909  2852 raft_consensus.cc:993] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2: : Instructing follower 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:22.650529  2911 raft_consensus.cc:1081] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Signalling peer 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:22.652567  2658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "685c5dad375049e8ae64318ca8ab173a"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:35950
I20260709 13:13:22.653191  2658 raft_consensus.cc:493] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.653577  2658 raft_consensus.cc:3060] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.658731  2658 raft_consensus.cc:515] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.660344  2658 leader_election.cc:290] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:22.661465  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685c5dad375049e8ae64318ca8ab173a" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:22.661614  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685c5dad375049e8ae64318ca8ab173a" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:22.662119  2732 raft_consensus.cc:3055] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.662359  2807 raft_consensus.cc:3060] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.662470  2732 raft_consensus.cc:740] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:22.663381  2732 consensus_queue.cc:260] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.664340  2732 raft_consensus.cc:3060] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.669394  2807 raft_consensus.cc:2468] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:22.670497  2732 raft_consensus.cc:2468] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:22.670745  2624 leader_election.cc:304] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:22.671958  2922 raft_consensus.cc:2804] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.672348  2922 raft_consensus.cc:697] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:22.673142  2922 consensus_queue.cc:237] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.679404  2556 catalog_manager.cc:5697] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 1 to 2, leader changed from 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194) to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 2 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.764163  2852 raft_consensus.cc:993] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2: : Instructing follower 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:22.764611  2911 raft_consensus.cc:1081] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Signalling peer 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:22.766129  2658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0eb8caca99640d7a0d64ebf3353bace"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:35950
I20260709 13:13:22.766638  2658 raft_consensus.cc:493] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.767022  2658 raft_consensus.cc:3060] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.772183  2658 raft_consensus.cc:515] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.773943  2658 leader_election.cc:290] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:22.774976  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eb8caca99640d7a0d64ebf3353bace" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:22.775092  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eb8caca99640d7a0d64ebf3353bace" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:22.775554  2732 raft_consensus.cc:3055] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.775717  2807 raft_consensus.cc:3060] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.775890  2732 raft_consensus.cc:740] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:22.776736  2732 consensus_queue.cc:260] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.777776  2732 raft_consensus.cc:3060] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.781184  2807 raft_consensus.cc:2468] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:22.782472  2624 leader_election.cc:304] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:22.783161  2732 raft_consensus.cc:2468] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:22.783382  2922 raft_consensus.cc:2804] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.784132  2922 raft_consensus.cc:697] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:22.784899  2922 consensus_queue.cc:237] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.792073  2556 catalog_manager.cc:5697] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 1 to 2, leader changed from 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194) to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 2 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.803339  2854 consensus_queue.cc:1048] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.815718  2904 consensus_queue.cc:1048] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.817806  2878 raft_consensus.cc:993] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782: : Instructing follower 099250c2ee47447f849c9aecd7afe5e2 to start an election
I20260709 13:13:22.818341  2878 raft_consensus.cc:1081] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Signalling peer 099250c2ee47447f849c9aecd7afe5e2 to start an election
I20260709 13:13:22.820330  2732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
 from {username='slave'} at 127.0.0.1:49968
I20260709 13:13:22.820935  2732 raft_consensus.cc:493] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.821412  2732 raft_consensus.cc:3060] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.829407  2732 raft_consensus.cc:515] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.831779  2732 leader_election.cc:290] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 2 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:22.832100  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:22.832409  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56336482a8e4c1db94c7eeeba0a3fab" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:22.832847  2658 raft_consensus.cc:3060] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.833105  2807 raft_consensus.cc:3055] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.833457  2807 raft_consensus.cc:740] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:22.834314  2807 consensus_queue.cc:260] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.835644  2807 raft_consensus.cc:3060] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.839195  2658 raft_consensus.cc:2468] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 2.
I20260709 13:13:22.840538  2697 leader_election.cc:304] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:22.841509  2911 raft_consensus.cc:2804] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.841621  2807 raft_consensus.cc:2468] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 2.
I20260709 13:13:22.842180  2911 raft_consensus.cc:697] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 2 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:22.843169  2911 consensus_queue.cc:237] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.849823  2555 catalog_manager.cc:5697] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 1 to 2, leader changed from 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195) to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.856320  2921 raft_consensus.cc:993] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a: : Instructing follower 099250c2ee47447f849c9aecd7afe5e2 to start an election
I20260709 13:13:22.857049  2921 raft_consensus.cc:1081] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Signalling peer 099250c2ee47447f849c9aecd7afe5e2 to start an election
I20260709 13:13:22.858729  2732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
 from {username='slave'} at 127.0.0.1:58958
I20260709 13:13:22.859372  2732 raft_consensus.cc:493] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.859673  2732 raft_consensus.cc:3060] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.865087  2732 raft_consensus.cc:515] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.867245  2732 leader_election.cc:290] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 2 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:22.868340  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:22.868533  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d402ce9601b14df8a47ced4dbcbf59c6" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:22.869499  2658 raft_consensus.cc:3055] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.869520  2807 raft_consensus.cc:3060] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.870085  2658 raft_consensus.cc:740] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:22.871047  2658 consensus_queue.cc:260] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.872514  2658 raft_consensus.cc:3060] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.878150  2807 raft_consensus.cc:2468] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 2.
I20260709 13:13:22.879654  2699 leader_election.cc:304] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:22.880447  2911 raft_consensus.cc:2804] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.880451  2658 raft_consensus.cc:2468] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 2.
I20260709 13:13:22.881145  2911 raft_consensus.cc:697] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:22.882279  2911 consensus_queue.cc:237] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.889496  2555 catalog_manager.cc:5697] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 1 to 2, leader changed from 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193) to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.944767  2905 raft_consensus.cc:993] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782: : Instructing follower 099250c2ee47447f849c9aecd7afe5e2 to start an election
I20260709 13:13:22.945282  2904 raft_consensus.cc:1081] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Signalling peer 099250c2ee47447f849c9aecd7afe5e2 to start an election
I20260709 13:13:22.947033  2732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58abab3ac23a474286cfa01dbd7a0b1b"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
 from {username='slave'} at 127.0.0.1:49968
I20260709 13:13:22.947589  2732 raft_consensus.cc:493] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.947961  2732 raft_consensus.cc:3060] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.954581  2732 raft_consensus.cc:515] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.956123  2732 leader_election.cc:290] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 2 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:22.956861  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58abab3ac23a474286cfa01dbd7a0b1b" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:22.957237  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58abab3ac23a474286cfa01dbd7a0b1b" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:22.957571  2658 raft_consensus.cc:3060] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.957919  2807 raft_consensus.cc:3055] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.958248  2807 raft_consensus.cc:740] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:22.958942  2807 consensus_queue.cc:260] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.959928  2807 raft_consensus.cc:3060] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.962642  2658 raft_consensus.cc:2468] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 2.
I20260709 13:13:22.963730  2697 leader_election.cc:304] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:22.964766  2911 raft_consensus.cc:2804] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.965214  2911 raft_consensus.cc:697] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 2 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:22.965232  2807 raft_consensus.cc:2468] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 2.
I20260709 13:13:22.966313  2911 consensus_queue.cc:237] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:22.973732  2555 catalog_manager.cc:5697] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 1 to 2, leader changed from 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195) to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.090519  2732 raft_consensus.cc:1275] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.092036  2921 consensus_queue.cc:1048] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.102234  2807 raft_consensus.cc:1275] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.104717  2921 consensus_queue.cc:1048] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.119769  2732 raft_consensus.cc:1275] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.121197  2921 consensus_queue.cc:1048] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.130301  2807 raft_consensus.cc:1275] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.132879  2937 consensus_queue.cc:1048] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.144663  2732 raft_consensus.cc:1275] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.146109  2937 consensus_queue.cc:1048] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.155145  2807 raft_consensus.cc:1275] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.156941  2937 consensus_queue.cc:1048] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.175066  2807 raft_consensus.cc:1275] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.176646  2937 consensus_queue.cc:1048] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.187280  2732 raft_consensus.cc:1275] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.189424  2921 consensus_queue.cc:1048] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.229734  2658 raft_consensus.cc:1275] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Refusing update from remote peer 099250c2ee47447f849c9aecd7afe5e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.231379  2911 consensus_queue.cc:1048] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.240289  2807 raft_consensus.cc:1275] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 099250c2ee47447f849c9aecd7afe5e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.242494  2852 consensus_queue.cc:1048] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.292104  2658 raft_consensus.cc:1275] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Refusing update from remote peer 099250c2ee47447f849c9aecd7afe5e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.293363  2852 consensus_queue.cc:1048] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.302783  2807 raft_consensus.cc:1275] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 099250c2ee47447f849c9aecd7afe5e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.304409  2944 consensus_queue.cc:1048] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.484123  2658 raft_consensus.cc:1275] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Refusing update from remote peer 099250c2ee47447f849c9aecd7afe5e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.485462  2944 consensus_queue.cc:1048] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.496070  2807 raft_consensus.cc:1275] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 099250c2ee47447f849c9aecd7afe5e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.497821  2944 consensus_queue.cc:1048] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:25.562378  2555 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57322:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:25.564685  2555 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:25.620944  2640 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae7e22bd2694e9482a46822255bee03 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:25.622328  2640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae7e22bd2694e9482a46822255bee03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.622099  2717 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae7e22bd2694e9482a46822255bee03 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:25.623396  2717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae7e22bd2694e9482a46822255bee03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.623310  2791 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae7e22bd2694e9482a46822255bee03 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:25.624668  2791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae7e22bd2694e9482a46822255bee03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.626856  2718 tablet_service.cc:1511] Processing CreateTablet for tablet 3b56b85638d144799e2533a4acf7018f (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:25.628162  2718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b56b85638d144799e2533a4acf7018f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.629457  2792 tablet_service.cc:1511] Processing CreateTablet for tablet 3b56b85638d144799e2533a4acf7018f (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:25.630817  2792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b56b85638d144799e2533a4acf7018f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.635285  2645 tablet_service.cc:1511] Processing CreateTablet for tablet 3b56b85638d144799e2533a4acf7018f (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:25.635552  2644 tablet_service.cc:1511] Processing CreateTablet for tablet 267a1bc0d7e74e1f84f8cfe00b491b9c (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:25.635877  2641 tablet_service.cc:1511] Processing CreateTablet for tablet fb61f680ab7540fea3cb10de29f9fe02 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:25.638695  2645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b56b85638d144799e2533a4acf7018f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.640175  2790 tablet_service.cc:1511] Processing CreateTablet for tablet fb61f680ab7540fea3cb10de29f9fe02 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:25.641593  2790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb61f680ab7540fea3cb10de29f9fe02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.643077  2646 tablet_service.cc:1511] Processing CreateTablet for tablet 09c352675a934ec892c7c2578da74be1 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:25.643815  2644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267a1bc0d7e74e1f84f8cfe00b491b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.645219  2789 tablet_service.cc:1511] Processing CreateTablet for tablet 267a1bc0d7e74e1f84f8cfe00b491b9c (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:25.646130  2641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb61f680ab7540fea3cb10de29f9fe02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.646582  2789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267a1bc0d7e74e1f84f8cfe00b491b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.653225  2720 tablet_service.cc:1511] Processing CreateTablet for tablet fb61f680ab7540fea3cb10de29f9fe02 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:25.653637  2723 tablet_service.cc:1511] Processing CreateTablet for tablet 267a1bc0d7e74e1f84f8cfe00b491b9c (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:25.654767  2720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb61f680ab7540fea3cb10de29f9fe02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.655191  2646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c352675a934ec892c7c2578da74be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.653429  2719 tablet_service.cc:1511] Processing CreateTablet for tablet 09c352675a934ec892c7c2578da74be1 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:25.655776  2723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267a1bc0d7e74e1f84f8cfe00b491b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.656553  2719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c352675a934ec892c7c2578da74be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.683640  2958 tablet_bootstrap.cc:492] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:25.685593  2647 tablet_service.cc:1511] Processing CreateTablet for tablet 3dbb647f54ad48fb835aa4b4853762de (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:25.686957  2647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dbb647f54ad48fb835aa4b4853762de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.687776  2721 tablet_service.cc:1511] Processing CreateTablet for tablet 3dbb647f54ad48fb835aa4b4853762de (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:25.689128  2721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dbb647f54ad48fb835aa4b4853762de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.681137  2797 tablet_service.cc:1511] Processing CreateTablet for tablet 09c352675a934ec892c7c2578da74be1 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:25.690789  2797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c352675a934ec892c7c2578da74be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.708637  2790 tablet_service.cc:1511] Processing CreateTablet for tablet 3dbb647f54ad48fb835aa4b4853762de (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:25.710605  2790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dbb647f54ad48fb835aa4b4853762de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.720984  2958 tablet_bootstrap.cc:654] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.724833  2959 tablet_bootstrap.cc:492] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:25.726042  2646 tablet_service.cc:1511] Processing CreateTablet for tablet a1d6dc8bff1a4bd2a2d9eb4810cbc875 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:25.730454  2646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d6dc8bff1a4bd2a2d9eb4810cbc875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.732690  2722 tablet_service.cc:1511] Processing CreateTablet for tablet a1d6dc8bff1a4bd2a2d9eb4810cbc875 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:25.734112  2722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d6dc8bff1a4bd2a2d9eb4810cbc875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.746698  2640 tablet_service.cc:1511] Processing CreateTablet for tablet 3a19f2fd2513452d8e706d417b782a93 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:25.748160  2640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a19f2fd2513452d8e706d417b782a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.755671  2716 tablet_service.cc:1511] Processing CreateTablet for tablet 3a19f2fd2513452d8e706d417b782a93 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:25.757257  2716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a19f2fd2513452d8e706d417b782a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.758512  2789 tablet_service.cc:1511] Processing CreateTablet for tablet a1d6dc8bff1a4bd2a2d9eb4810cbc875 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:25.764586  2959 tablet_bootstrap.cc:654] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.778278  2641 tablet_service.cc:1511] Processing CreateTablet for tablet a696a2b606d1443e8f83946d9be27938 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:25.780247  2641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a696a2b606d1443e8f83946d9be27938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.778956  2720 tablet_service.cc:1511] Processing CreateTablet for tablet a696a2b606d1443e8f83946d9be27938 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:25.784782  2720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a696a2b606d1443e8f83946d9be27938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.785887  2960 tablet_bootstrap.cc:492] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:25.783736  2789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d6dc8bff1a4bd2a2d9eb4810cbc875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.795256  2958 tablet_bootstrap.cc:492] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:25.799790  2958 ts_tablet_manager.cc:1403] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.116s	user 0.020s	sys 0.015s
I20260709 13:13:25.802062  2792 tablet_service.cc:1511] Processing CreateTablet for tablet 3a19f2fd2513452d8e706d417b782a93 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:25.803465  2792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a19f2fd2513452d8e706d417b782a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.803004  2958 raft_consensus.cc:359] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.803985  2958 raft_consensus.cc:385] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.804298  2958 raft_consensus.cc:740] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.805065  2958 consensus_queue.cc:260] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.808753  2958 ts_tablet_manager.cc:1434] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:25.809625  2960 tablet_bootstrap.cc:654] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.809839  2958 tablet_bootstrap.cc:492] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:25.819766  2790 tablet_service.cc:1511] Processing CreateTablet for tablet a696a2b606d1443e8f83946d9be27938 (DEFAULT_TABLE table=soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:25.821079  2790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a696a2b606d1443e8f83946d9be27938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.823624  2958 tablet_bootstrap.cc:654] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.845065  2959 tablet_bootstrap.cc:492] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:25.845844  2959 ts_tablet_manager.cc:1403] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.008s
I20260709 13:13:25.850106  2959 raft_consensus.cc:359] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.850728  2959 raft_consensus.cc:385] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.851228  2959 raft_consensus.cc:740] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.852265  2958 tablet_bootstrap.cc:492] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:25.852059  2959 consensus_queue.cc:260] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.852849  2958 ts_tablet_manager.cc:1403] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.009s
I20260709 13:13:25.853654  2960 tablet_bootstrap.cc:492] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:25.854242  2960 ts_tablet_manager.cc:1403] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.011s
I20260709 13:13:25.854574  2959 ts_tablet_manager.cc:1434] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:13:25.855729  2959 tablet_bootstrap.cc:492] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:25.855954  2958 raft_consensus.cc:359] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.856709  2958 raft_consensus.cc:385] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.857018  2958 raft_consensus.cc:740] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.857529  2960 raft_consensus.cc:359] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.857806  2958 consensus_queue.cc:260] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.858373  2960 raft_consensus.cc:385] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.860390  2958 ts_tablet_manager.cc:1434] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:25.861446  2958 tablet_bootstrap.cc:492] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:25.863442  2959 tablet_bootstrap.cc:654] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.868357  2958 tablet_bootstrap.cc:654] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.874869  2960 raft_consensus.cc:740] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.875787  2960 consensus_queue.cc:260] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.879590  2960 ts_tablet_manager.cc:1434] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:13:25.881234  2960 tablet_bootstrap.cc:492] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:25.891202  2958 tablet_bootstrap.cc:492] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:25.891819  2958 ts_tablet_manager.cc:1403] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.018s
I20260709 13:13:25.893110  2959 tablet_bootstrap.cc:492] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:25.893878  2959 ts_tablet_manager.cc:1403] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.006s
I20260709 13:13:25.895700  2958 raft_consensus.cc:359] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.896486  2958 raft_consensus.cc:385] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.896782  2958 raft_consensus.cc:740] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.897171  2959 raft_consensus.cc:359] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.898175  2959 raft_consensus.cc:385] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.897800  2958 consensus_queue.cc:260] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.898471  2959 raft_consensus.cc:740] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.899243  2959 consensus_queue.cc:260] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.900543  2960 tablet_bootstrap.cc:654] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.900718  2958 ts_tablet_manager.cc:1434] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:25.901396  2959 ts_tablet_manager.cc:1434] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:13:25.902048  2958 tablet_bootstrap.cc:492] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:25.904008  2959 tablet_bootstrap.cc:492] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:25.910482  2958 tablet_bootstrap.cc:654] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.911443  2959 tablet_bootstrap.cc:654] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.924261  2960 tablet_bootstrap.cc:492] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:25.924263  2958 tablet_bootstrap.cc:492] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:25.925002  2960 ts_tablet_manager.cc:1403] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.002s
I20260709 13:13:25.925081  2958 ts_tablet_manager.cc:1403] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:13:25.928648  2960 raft_consensus.cc:359] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.929765  2960 raft_consensus.cc:385] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.930220  2960 raft_consensus.cc:740] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.931180  2960 consensus_queue.cc:260] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.928845  2958 raft_consensus.cc:359] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.932194  2958 raft_consensus.cc:385] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.932565  2958 raft_consensus.cc:740] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.932674  2959 tablet_bootstrap.cc:492] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:25.933449  2959 ts_tablet_manager.cc:1403] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.004s
I20260709 13:13:25.933519  2958 consensus_queue.cc:260] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.934617  2960 ts_tablet_manager.cc:1434] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:13:25.935791  2960 tablet_bootstrap.cc:492] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:25.936312  2958 ts_tablet_manager.cc:1434] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:25.936700  2959 raft_consensus.cc:359] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.937475  2958 tablet_bootstrap.cc:492] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:25.937580  2959 raft_consensus.cc:385] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.938105  2959 raft_consensus.cc:740] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.938951  2959 consensus_queue.cc:260] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.940656  2959 ts_tablet_manager.cc:1434] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:25.941664  2959 tablet_bootstrap.cc:492] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:25.944926  2960 tablet_bootstrap.cc:654] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.945403  2958 tablet_bootstrap.cc:654] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.948011  2959 tablet_bootstrap.cc:654] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.955303  2959 tablet_bootstrap.cc:492] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:25.955809  2959 ts_tablet_manager.cc:1403] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:13:25.958904  2959 raft_consensus.cc:359] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.959642  2959 raft_consensus.cc:385] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.959918  2959 raft_consensus.cc:740] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.960605  2959 consensus_queue.cc:260] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.964301  2959 ts_tablet_manager.cc:1434] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:25.965061  2960 tablet_bootstrap.cc:492] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:25.965788  2960 ts_tablet_manager.cc:1403] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.007s
I20260709 13:13:25.968170  2959 tablet_bootstrap.cc:492] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:25.969372  2960 raft_consensus.cc:359] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.970374  2960 raft_consensus.cc:385] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.970753  2960 raft_consensus.cc:740] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.971608  2958 tablet_bootstrap.cc:492] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:25.972321  2958 ts_tablet_manager.cc:1403] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.013s
I20260709 13:13:25.971709  2960 consensus_queue.cc:260] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.974778  2960 ts_tablet_manager.cc:1434] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:13:25.975512  2959 tablet_bootstrap.cc:654] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.975757  2958 raft_consensus.cc:359] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.976502  2958 raft_consensus.cc:385] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.976770  2958 raft_consensus.cc:740] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.977546  2958 consensus_queue.cc:260] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.980603  2958 ts_tablet_manager.cc:1434] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:25.981062  2960 tablet_bootstrap.cc:492] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:25.981748  2958 tablet_bootstrap.cc:492] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:25.988104  2959 tablet_bootstrap.cc:492] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:25.988849  2959 ts_tablet_manager.cc:1403] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:13:25.989807  2960 tablet_bootstrap.cc:654] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.992019  2959 raft_consensus.cc:359] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.992825  2959 raft_consensus.cc:385] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.993132  2959 raft_consensus.cc:740] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.994084  2959 consensus_queue.cc:260] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:25.995406  2958 tablet_bootstrap.cc:654] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.996830  2959 ts_tablet_manager.cc:1434] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:25.997962  2959 tablet_bootstrap.cc:492] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:26.003340  2960 tablet_bootstrap.cc:492] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:26.004185  2960 ts_tablet_manager.cc:1403] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.010s
I20260709 13:13:26.004951  2959 tablet_bootstrap.cc:654] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.007283  2958 tablet_bootstrap.cc:492] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:26.007859  2958 ts_tablet_manager.cc:1403] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.026s	user 0.003s	sys 0.014s
I20260709 13:13:26.009122  2960 raft_consensus.cc:359] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.010097  2960 raft_consensus.cc:385] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.010473  2960 raft_consensus.cc:740] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.011274  2958 raft_consensus.cc:359] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.011508  2960 consensus_queue.cc:260] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.012140  2958 raft_consensus.cc:385] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.013156  2958 raft_consensus.cc:740] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.014149  2958 consensus_queue.cc:260] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.015404  2960 ts_tablet_manager.cc:1434] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:13:26.016729  2959 tablet_bootstrap.cc:492] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:26.016723  2960 tablet_bootstrap.cc:492] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:26.017146  2958 ts_tablet_manager.cc:1434] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:13:26.017320  2959 ts_tablet_manager.cc:1403] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.012s
I20260709 13:13:26.018380  2958 tablet_bootstrap.cc:492] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:26.020496  2959 raft_consensus.cc:359] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.021529  2959 raft_consensus.cc:385] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.025290  2960 tablet_bootstrap.cc:654] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.026089  2959 raft_consensus.cc:740] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.026638  2958 tablet_bootstrap.cc:654] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.027048  2959 consensus_queue.cc:260] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.029810  2959 ts_tablet_manager.cc:1434] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:13:26.030827  2959 tablet_bootstrap.cc:492] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:26.037765  2959 tablet_bootstrap.cc:654] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.038677  2958 tablet_bootstrap.cc:492] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:26.038679  2960 tablet_bootstrap.cc:492] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:26.039469  2960 ts_tablet_manager.cc:1403] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.014s
I20260709 13:13:26.039438  2958 ts_tablet_manager.cc:1403] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:13:26.042860  2960 raft_consensus.cc:359] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.043064  2958 raft_consensus.cc:359] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.043761  2960 raft_consensus.cc:385] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.043802  2958 raft_consensus.cc:385] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.044337  2960 raft_consensus.cc:740] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.044351  2958 raft_consensus.cc:740] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.045732  2960 consensus_queue.cc:260] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.046283  2958 consensus_queue.cc:260] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.048627  2960 ts_tablet_manager.cc:1434] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:13:26.050369  2878 raft_consensus.cc:493] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.050526  2959 tablet_bootstrap.cc:492] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:26.051183  2959 ts_tablet_manager.cc:1403] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:13:26.050907  2878 raft_consensus.cc:515] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.051851  2960 tablet_bootstrap.cc:492] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:26.054046  2878 leader_election.cc:290] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:26.051302  2958 ts_tablet_manager.cc:1434] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:13:26.055480  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb61f680ab7540fea3cb10de29f9fe02" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:26.055416  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb61f680ab7540fea3cb10de29f9fe02" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:26.056272  2732 raft_consensus.cc:2468] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 0.
I20260709 13:13:26.056383  2658 raft_consensus.cc:2468] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 0.
I20260709 13:13:26.059019  2770 leader_election.cc:304] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.059917  2959 raft_consensus.cc:359] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.062047  2959 raft_consensus.cc:385] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.062892  2878 raft_consensus.cc:493] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.064035  2878 raft_consensus.cc:515] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.075042  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:26.075393  2960 tablet_bootstrap.cc:654] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.075690  2658 raft_consensus.cc:2468] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 0.
I20260709 13:13:26.077098  2771 leader_election.cc:304] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.078877  2878 leader_election.cc:290] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:26.080247  2878 raft_consensus.cc:2804] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.081190  2878 raft_consensus.cc:493] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.081959  2878 raft_consensus.cc:3060] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.083446  2958 tablet_bootstrap.cc:492] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:26.085888  2875 raft_consensus.cc:493] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.086481  2875 raft_consensus.cc:515] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.088873  2875 leader_election.cc:290] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.090284  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:26.090637  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:26.091075  2807 raft_consensus.cc:2468] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:26.091259  2658 raft_consensus.cc:2468] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:26.092732  2699 leader_election.cc:304] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.063575  2959 raft_consensus.cc:740] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.097724  2958 tablet_bootstrap.cc:654] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.098124  2875 raft_consensus.cc:2804] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.098601  2875 raft_consensus.cc:493] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.099012  2875 raft_consensus.cc:3060] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.099202  2878 raft_consensus.cc:515] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.101091  2982 raft_consensus.cc:2804] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.101555  2982 raft_consensus.cc:493] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.101953  2982 raft_consensus.cc:3060] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.101634  2959 consensus_queue.cc:260] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.102797  2878 leader_election.cc:290] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:26.105415  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb61f680ab7540fea3cb10de29f9fe02" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:26.106019  2658 raft_consensus.cc:3060] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.106328  2960 tablet_bootstrap.cc:492] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:26.106835  2960 ts_tablet_manager.cc:1403] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.001s
I20260709 13:13:26.110021  2960 raft_consensus.cc:359] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.110803  2960 raft_consensus.cc:385] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.111202  2960 raft_consensus.cc:740] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.110929  2982 raft_consensus.cc:515] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.112309  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:26.115024  2658 raft_consensus.cc:2468] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 1.
I20260709 13:13:26.112053  2960 consensus_queue.cc:260] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.124207  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb61f680ab7540fea3cb10de29f9fe02" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:26.125636  2959 ts_tablet_manager.cc:1434] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 13:13:26.125634  2733 raft_consensus.cc:3060] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.127020  2959 tablet_bootstrap.cc:492] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:26.130946  2771 leader_election.cc:304] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.132259  2981 raft_consensus.cc:2804] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.132973  2981 raft_consensus.cc:697] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Becoming Leader. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:26.134112  2981 consensus_queue.cc:237] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.135210  2959 tablet_bootstrap.cc:654] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.117892  2875 raft_consensus.cc:515] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.136375  2732 raft_consensus.cc:2393] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d77a93f08ec4c1f95c8ef636803a782 in current term 1: Already voted for candidate 099250c2ee47447f849c9aecd7afe5e2 in this term.
I20260709 13:13:26.142809  2733 raft_consensus.cc:2468] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 1.
I20260709 13:13:26.145390  2875 leader_election.cc:290] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.150100  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:26.149483  2989 raft_consensus.cc:493] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.150897  2657 raft_consensus.cc:3060] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.151132  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:26.152669  2959 tablet_bootstrap.cc:492] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:26.153270  2959 ts_tablet_manager.cc:1403] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.003s
I20260709 13:13:26.155296  2982 leader_election.cc:290] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:26.155882  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:26.156625  2959 raft_consensus.cc:359] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.150939  2958 tablet_bootstrap.cc:492] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:26.159466  2807 raft_consensus.cc:2393] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 099250c2ee47447f849c9aecd7afe5e2 in current term 1: Already voted for candidate 8d77a93f08ec4c1f95c8ef636803a782 in this term.
I20260709 13:13:26.159610  2657 raft_consensus.cc:2468] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:26.159782  2958 ts_tablet_manager.cc:1403] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.016s
I20260709 13:13:26.162163  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:26.162973  2733 raft_consensus.cc:2393] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d77a93f08ec4c1f95c8ef636803a782 in current term 1: Already voted for candidate 099250c2ee47447f849c9aecd7afe5e2 in this term.
I20260709 13:13:26.163388  2958 raft_consensus.cc:359] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.163833  2697 leader_election.cc:304] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:26.164438  2958 raft_consensus.cc:385] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.164022  2770 leader_election.cc:304] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d77a93f08ec4c1f95c8ef636803a782; no voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:26.164987  2958 raft_consensus.cc:740] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.165731  2982 raft_consensus.cc:2749] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:26.165860  2958 consensus_queue.cc:260] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.167618  2986 raft_consensus.cc:2804] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.168305  2986 raft_consensus.cc:697] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:26.168606  2958 ts_tablet_manager.cc:1434] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:26.169847  2958 tablet_bootstrap.cc:492] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782: Bootstrap starting.
I20260709 13:13:26.151018  2989 raft_consensus.cc:515] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.170217  2959 raft_consensus.cc:385] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.173269  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:26.169341  2986 consensus_queue.cc:237] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.173813  2959 raft_consensus.cc:740] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.174100  2657 raft_consensus.cc:2468] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:26.174991  2989 leader_election.cc:290] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.175382  2697 leader_election.cc:304] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:26.175004  2959 consensus_queue.cc:260] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.177966  2959 ts_tablet_manager.cc:1434] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:13:26.178030  2960 ts_tablet_manager.cc:1434] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.071s	user 0.017s	sys 0.008s
I20260709 13:13:26.179096  2959 tablet_bootstrap.cc:492] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Bootstrap starting.
I20260709 13:13:26.179338  2960 tablet_bootstrap.cc:492] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:26.184023  2973 raft_consensus.cc:493] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.184618  2973 raft_consensus.cc:515] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.187803  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19f2fd2513452d8e706d417b782a93" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:26.188880  2960 tablet_bootstrap.cc:654] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:26.189386  2621 leader_election.cc:343] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.189508  2958 tablet_bootstrap.cc:654] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.189638  2922 raft_consensus.cc:493] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.190280  2922 raft_consensus.cc:515] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.191480  2959 tablet_bootstrap.cc:654] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.194581  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae7e22bd2694e9482a46822255bee03" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:26.195479  2806 raft_consensus.cc:2468] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 0.
I20260709 13:13:26.197209  2624 leader_election.cc:304] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.191653  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19f2fd2513452d8e706d417b782a93" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:26.199465  2878 raft_consensus.cc:493] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.200188  2878 raft_consensus.cc:515] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.202879  2984 raft_consensus.cc:2804] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.203320  2984 raft_consensus.cc:493] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.203763  2984 raft_consensus.cc:3060] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.206104  2982 raft_consensus.cc:493] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.206779  2982 raft_consensus.cc:515] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.211287  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:26.212184  2807 raft_consensus.cc:2468] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:26.214035  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae7e22bd2694e9482a46822255bee03" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:26.214927  2733 raft_consensus.cc:2468] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 0.
I20260709 13:13:26.218489  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:26.218766  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:26.219142  2657 raft_consensus.cc:2468] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 0.
I20260709 13:13:26.219888  2878 leader_election.cc:290] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:26.192242  2973 leader_election.cc:290] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.192762  2922 leader_election.cc:290] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.229444  2922 raft_consensus.cc:2804] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.231611  2922 raft_consensus.cc:493] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.232014  2922 raft_consensus.cc:3060] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.234236  2959 tablet_bootstrap.cc:492] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a: No bootstrap required, opened a new log
I20260709 13:13:26.234822  2959 ts_tablet_manager.cc:1403] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.005s
I20260709 13:13:26.229363  2771 leader_election.cc:304] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.238271  2959 raft_consensus.cc:359] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.239375  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d6dc8bff1a4bd2a2d9eb4810cbc875" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:26.240306  2657 raft_consensus.cc:2468] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 0.
I20260709 13:13:26.241125  2959 raft_consensus.cc:385] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.241833  2959 raft_consensus.cc:740] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.242954  2959 consensus_queue.cc:260] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.244596  2771 leader_election.cc:304] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.242296  2556 catalog_manager.cc:5697] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.249908  2878 raft_consensus.cc:2804] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.250411  2878 raft_consensus.cc:493] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.250746  2878 raft_consensus.cc:3060] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.252499  2981 raft_consensus.cc:2804] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.253079  2981 raft_consensus.cc:493] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.253690  2981 raft_consensus.cc:3060] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.257056  2553 catalog_manager.cc:5697] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.259136  2958 tablet_bootstrap.cc:492] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782: No bootstrap required, opened a new log
I20260709 13:13:26.259833  2958 ts_tablet_manager.cc:1403] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent bootstrapping tablet: real 0.090s	user 0.003s	sys 0.029s
I20260709 13:13:26.262879  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d6dc8bff1a4bd2a2d9eb4810cbc875" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
W20260709 13:13:26.264462  2770 leader_election.cc:343] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.270918  2958 raft_consensus.cc:359] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.271708  2958 raft_consensus.cc:385] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.272006  2958 raft_consensus.cc:740] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.276365  2878 raft_consensus.cc:515] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.261512  2982 leader_election.cc:290] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:26.278165  2973 raft_consensus.cc:493] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.281281  2958 consensus_queue.cc:260] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.287179  2973 raft_consensus.cc:515] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.288058  2959 ts_tablet_manager.cc:1434] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:13:26.296624  2973 leader_election.cc:290] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.301700  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c352675a934ec892c7c2578da74be1" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:26.302628  2733 raft_consensus.cc:2468] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 0.
I20260709 13:13:26.304572  2621 leader_election.cc:304] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:26.308574  2973 raft_consensus.cc:2804] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.279593  2922 raft_consensus.cc:515] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.311695  2922 leader_election.cc:290] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.309170  2973 raft_consensus.cc:493] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.312829  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae7e22bd2694e9482a46822255bee03" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:26.312690  2984 raft_consensus.cc:515] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.318568  2958 ts_tablet_manager.cc:1434] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.005s
I20260709 13:13:26.316037  2973 raft_consensus.cc:3060] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.317806  2733 raft_consensus.cc:3060] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:26.319068  2624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.195:39637, user_credentials={real_user=slave}} blocked reactor thread for 121968us
I20260709 13:13:26.324397  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:26.324937  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c352675a934ec892c7c2578da74be1" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:26.325670  2806 raft_consensus.cc:2468] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 0.
I20260709 13:13:26.325913  2805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae7e22bd2694e9482a46822255bee03" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:26.326560  2805 raft_consensus.cc:3060] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:26.327116  2624 leader_election.cc:343] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.327628  2624 leader_election.cc:304] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:26.328533  2997 raft_consensus.cc:2749] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:26.329125  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:26.329723  2658 raft_consensus.cc:3060] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.330749  2973 raft_consensus.cc:515] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.322155  2732 raft_consensus.cc:2393] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d77a93f08ec4c1f95c8ef636803a782 in current term 1: Already voted for candidate 099250c2ee47447f849c9aecd7afe5e2 in this term.
I20260709 13:13:26.333757  2731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c352675a934ec892c7c2578da74be1" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:26.334379  2731 raft_consensus.cc:3060] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.325210  2807 raft_consensus.cc:2393] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 099250c2ee47447f849c9aecd7afe5e2 in current term 1: Already voted for candidate 8d77a93f08ec4c1f95c8ef636803a782 in this term.
I20260709 13:13:26.337577  2658 raft_consensus.cc:2468] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:26.323287  2984 leader_election.cc:290] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.339506  2697 leader_election.cc:304] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:26.340636  2984 raft_consensus.cc:2804] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.341085  2984 raft_consensus.cc:697] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:26.341668  2986 raft_consensus.cc:493] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.341887  2984 consensus_queue.cc:237] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.342198  2986 raft_consensus.cc:515] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.346045  2733 raft_consensus.cc:2468] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 1.
I20260709 13:13:26.347301  2986 leader_election.cc:290] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.347767  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbb647f54ad48fb835aa4b4853762de" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:26.348306  2973 leader_election.cc:290] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.348412  2807 raft_consensus.cc:2468] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:26.348634  2878 leader_election.cc:290] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:26.343129  2805 raft_consensus.cc:2468] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 1.
I20260709 13:13:26.349871  2699 leader_election.cc:304] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.350569  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:26.350886  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c352675a934ec892c7c2578da74be1" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:26.351184  2986 raft_consensus.cc:2804] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.351603  2986 raft_consensus.cc:493] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.352172  2986 raft_consensus.cc:3060] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.351584  2806 raft_consensus.cc:3060] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.356240  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:26.358136  2658 raft_consensus.cc:2393] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d77a93f08ec4c1f95c8ef636803a782 in current term 1: Already voted for candidate 099250c2ee47447f849c9aecd7afe5e2 in this term.
I20260709 13:13:26.359901  2621 leader_election.cc:304] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:26.361960  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbb647f54ad48fb835aa4b4853762de" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:26.362705  2657 raft_consensus.cc:2468] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:26.363988  2771 leader_election.cc:304] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d77a93f08ec4c1f95c8ef636803a782; no voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:26.364713  2997 raft_consensus.cc:2804] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.365263  2997 raft_consensus.cc:697] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:26.365761  2878 raft_consensus.cc:2749] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:26.276381  2981 raft_consensus.cc:515] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.366195  2997 consensus_queue.cc:237] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.368110  2981 leader_election.cc:290] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:26.370359  2731 raft_consensus.cc:2468] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 1.
I20260709 13:13:26.374624  2621 leader_election.cc:304] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:26.375761  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d6dc8bff1a4bd2a2d9eb4810cbc875" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:26.375825  2960 tablet_bootstrap.cc:492] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:26.376818  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d6dc8bff1a4bd2a2d9eb4810cbc875" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:26.373634  2806 raft_consensus.cc:2468] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 1.
W20260709 13:13:26.377398  2770 leader_election.cc:343] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.377599  2657 raft_consensus.cc:3060] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.381963  2960 ts_tablet_manager.cc:1403] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.203s	user 0.055s	sys 0.059s
I20260709 13:13:26.376685  2995 raft_consensus.cc:2804] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.383576  2995 raft_consensus.cc:697] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:26.384413  2995 consensus_queue.cc:237] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.385895  2960 raft_consensus.cc:359] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.386286  2657 raft_consensus.cc:2468] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 1.
I20260709 13:13:26.386701  2960 raft_consensus.cc:385] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.387059  2960 raft_consensus.cc:740] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.387463  2771 leader_election.cc:304] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 099250c2ee47447f849c9aecd7afe5e2
I20260709 13:13:26.387784  2960 consensus_queue.cc:260] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.389227  2981 raft_consensus.cc:2804] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.389739  2981 raft_consensus.cc:697] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Becoming Leader. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:26.390442  2960 ts_tablet_manager.cc:1434] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:26.390552  2981 consensus_queue.cc:237] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.391566  2960 tablet_bootstrap.cc:492] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:26.390769  2986 raft_consensus.cc:515] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.393760  2986 leader_election.cc:290] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.395527  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbb647f54ad48fb835aa4b4853762de" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:26.396373  2806 raft_consensus.cc:3060] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.398155  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbb647f54ad48fb835aa4b4853762de" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:26.398972  2657 raft_consensus.cc:3060] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.399536  2960 tablet_bootstrap.cc:654] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.405843  2555 catalog_manager.cc:5697] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 1 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.414197  2806 raft_consensus.cc:2468] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:26.418572  2699 leader_election.cc:304] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.420778  2984 raft_consensus.cc:2804] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.421236  2984 raft_consensus.cc:697] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:26.422019  2984 consensus_queue.cc:237] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.428133  2657 raft_consensus.cc:2468] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:26.431352  2989 raft_consensus.cc:493] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.432214  2989 raft_consensus.cc:515] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.434636  2989 leader_election.cc:290] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.435717  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19f2fd2513452d8e706d417b782a93" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:26.436538  2657 raft_consensus.cc:2468] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:26.435906  2556 catalog_manager.cc:5697] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195). New cstate: current_term: 1 leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.438074  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19f2fd2513452d8e706d417b782a93" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:26.436225  2555 catalog_manager.cc:5697] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 1 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.438175  2697 leader_election.cc:304] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:26.438710  2806 raft_consensus.cc:2468] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 0.
I20260709 13:13:26.439435  2989 raft_consensus.cc:2804] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.440001  2989 raft_consensus.cc:493] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.440529  2989 raft_consensus.cc:3060] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.451949  2960 tablet_bootstrap.cc:492] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:26.452487  2960 ts_tablet_manager.cc:1403] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.061s	user 0.031s	sys 0.023s
I20260709 13:13:26.454728  2960 raft_consensus.cc:359] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.455456  2960 raft_consensus.cc:385] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.455749  2960 raft_consensus.cc:740] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.455238  2553 catalog_manager.cc:5697] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.456408  2960 consensus_queue.cc:260] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.456558  2989 raft_consensus.cc:515] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.458570  2960 ts_tablet_manager.cc:1434] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:26.458958  2989 leader_election.cc:290] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.459533  2960 tablet_bootstrap.cc:492] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2: Bootstrap starting.
I20260709 13:13:26.459790  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19f2fd2513452d8e706d417b782a93" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:26.460379  2657 raft_consensus.cc:3060] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.465878  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19f2fd2513452d8e706d417b782a93" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:26.466565  2806 raft_consensus.cc:3060] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.466862  2960 tablet_bootstrap.cc:654] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.472349  2657 raft_consensus.cc:2468] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:26.473170  2806 raft_consensus.cc:2468] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 1.
I20260709 13:13:26.473621  2697 leader_election.cc:304] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:26.474483  2960 tablet_bootstrap.cc:492] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2: No bootstrap required, opened a new log
I20260709 13:13:26.474421  2989 raft_consensus.cc:2804] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.475072  2960 ts_tablet_manager.cc:1403] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 13:13:26.475070  2989 raft_consensus.cc:697] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:26.476215  2989 consensus_queue.cc:237] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.478076  2960 raft_consensus.cc:359] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.478807  2960 raft_consensus.cc:385] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.479074  2960 raft_consensus.cc:740] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.479774  2960 consensus_queue.cc:260] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.479826  2553 catalog_manager.cc:5697] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.482028  2960 ts_tablet_manager.cc:1434] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:26.494874  2553 catalog_manager.cc:5697] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 1 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:26.510241  2604 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:26.539225  2981 consensus_queue.cc:1048] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:26.541252  2995 raft_consensus.cc:493] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.541833  2995 raft_consensus.cc:515] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.545321  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a696a2b606d1443e8f83946d9be27938" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2" is_pre_election: true
I20260709 13:13:26.545990  2995 leader_election.cc:290] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.546129  2733 raft_consensus.cc:2468] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 0.
I20260709 13:13:26.545754  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a696a2b606d1443e8f83946d9be27938" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:26.547227  2806 raft_consensus.cc:2468] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 0.
I20260709 13:13:26.547675  2621 leader_election.cc:304] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:26.548533  2995 raft_consensus.cc:2804] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.548930  2995 raft_consensus.cc:493] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.549309  2995 raft_consensus.cc:3060] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.560156  2995 raft_consensus.cc:515] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.562567  2995 leader_election.cc:290] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.563795  2878 consensus_queue.cc:1048] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:26.564079  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a696a2b606d1443e8f83946d9be27938" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:26.564795  2806 raft_consensus.cc:3060] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.567063  2731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a696a2b606d1443e8f83946d9be27938" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:26.567749  2731 raft_consensus.cc:3060] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.573714  2806 raft_consensus.cc:2468] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 1.
I20260709 13:13:26.575127  2624 leader_election.cc:304] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.576011  2995 raft_consensus.cc:2804] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.577490  2995 raft_consensus.cc:697] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:26.578584  2995 consensus_queue.cc:237] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.579723  2731 raft_consensus.cc:2468] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 1.
I20260709 13:13:26.589241  2553 catalog_manager.cc:5697] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 1 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.608523  2989 raft_consensus.cc:493] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.609025  2989 raft_consensus.cc:515] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.610826  2989 leader_election.cc:290] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.611656  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d6dc8bff1a4bd2a2d9eb4810cbc875" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" is_pre_election: true
I20260709 13:13:26.611850  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d6dc8bff1a4bd2a2d9eb4810cbc875" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782" is_pre_election: true
I20260709 13:13:26.612499  2657 raft_consensus.cc:2393] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 099250c2ee47447f849c9aecd7afe5e2 in current term 1: Already voted for candidate 8d77a93f08ec4c1f95c8ef636803a782 in this term.
I20260709 13:13:26.613716  2697 leader_election.cc:304] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2; no voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:26.614332  2989 raft_consensus.cc:3060] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.619258  2989 raft_consensus.cc:2749] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:26.633363  2989 consensus_queue.cc:1048] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.645424  2989 consensus_queue.cc:1048] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.674361  2731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
mode: GRACEFUL
new_leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:49976
I20260709 13:13:26.674914  2731 raft_consensus.cc:606] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Received request to transfer leadership to TS 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:26.680848  2731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
mode: GRACEFUL
new_leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:49976
I20260709 13:13:26.681676  2731 raft_consensus.cc:606] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Received request to transfer leadership to TS 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:26.688217  2806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb61f680ab7540fea3cb10de29f9fe02"
dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
mode: GRACEFUL
new_leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:44706
I20260709 13:13:26.688839  2806 raft_consensus.cc:606] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Received request to transfer leadership to TS 85b848fbd4cd4bcd867ce8474e7cdf3a
I20260709 13:13:26.694491  2657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09c352675a934ec892c7c2578da74be1"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
mode: GRACEFUL
new_leader_uuid: "099250c2ee47447f849c9aecd7afe5e2"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:13:26.695086  2657 raft_consensus.cc:606] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Received request to transfer leadership to TS 099250c2ee47447f849c9aecd7afe5e2
I20260709 13:13:26.703799  2806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1d6dc8bff1a4bd2a2d9eb4810cbc875"
dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
mode: GRACEFUL
new_leader_uuid: "099250c2ee47447f849c9aecd7afe5e2"
 from {username='slave'} at 127.0.0.1:44706
I20260709 13:13:26.704432  2806 raft_consensus.cc:606] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Received request to transfer leadership to TS 099250c2ee47447f849c9aecd7afe5e2
I20260709 13:13:26.712366  2657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a696a2b606d1443e8f83946d9be27938"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
mode: GRACEFUL
new_leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:13:26.712976  2657 raft_consensus.cc:606] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Received request to transfer leadership to TS 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:26.773115  2995 consensus_queue.cc:1048] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.781538  2973 raft_consensus.cc:993] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a: : Instructing follower 099250c2ee47447f849c9aecd7afe5e2 to start an election
I20260709 13:13:26.782070  2997 raft_consensus.cc:1081] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Signalling peer 099250c2ee47447f849c9aecd7afe5e2 to start an election
I20260709 13:13:26.783977  2733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09c352675a934ec892c7c2578da74be1"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
 from {username='slave'} at 127.0.0.1:58958
I20260709 13:13:26.786866  2733 raft_consensus.cc:493] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:26.787273  2733 raft_consensus.cc:3060] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.787561  2973 consensus_queue.cc:1048] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.799363  2998 consensus_queue.cc:1048] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.799455  2733 raft_consensus.cc:515] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.804236  2658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c352675a934ec892c7c2578da74be1" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:26.804844  2658 raft_consensus.cc:3055] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:26.805158  2658 raft_consensus.cc:740] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:26.806001  2658 consensus_queue.cc:260] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.807168  2658 raft_consensus.cc:3060] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.809150  2995 consensus_queue.cc:1048] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:26.811576  2733 leader_election.cc:290] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 2 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.815104  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c352675a934ec892c7c2578da74be1" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:26.815712  2806 raft_consensus.cc:3060] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.818231  2658 raft_consensus.cc:2468] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 2.
I20260709 13:13:26.819290  2697 leader_election.cc:304] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:26.820163  2986 raft_consensus.cc:2804] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.820734  2986 raft_consensus.cc:697] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:26.823679  2986 consensus_queue.cc:237] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.824146  2806 raft_consensus.cc:2468] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 2.
I20260709 13:13:26.828387  2986 consensus_queue.cc:1048] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.831960  2556 catalog_manager.cc:5697] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 1 to 2, leader changed from 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193) to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.835629  2981 consensus_queue.cc:1048] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.842757  2986 consensus_queue.cc:1048] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:26.845029  2995 consensus_queue.cc:1048] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:13:26.856679  2878 raft_consensus.cc:993] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782: : Instructing follower 099250c2ee47447f849c9aecd7afe5e2 to start an election
I20260709 13:13:26.857208  2878 raft_consensus.cc:1081] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Signalling peer 099250c2ee47447f849c9aecd7afe5e2 to start an election
I20260709 13:13:26.858722  2987 raft_consensus.cc:993] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2: : Instructing follower 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:26.859835  2986 raft_consensus.cc:1081] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Signalling peer 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:26.860679  2733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1d6dc8bff1a4bd2a2d9eb4810cbc875"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
 from {username='slave'} at 127.0.0.1:49968
I20260709 13:13:26.861281  2733 raft_consensus.cc:493] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:26.861694  2733 raft_consensus.cc:3060] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.864773  2989 consensus_queue.cc:1048] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.872473  2733 raft_consensus.cc:515] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.875552  2989 consensus_queue.cc:1048] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.875808  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d6dc8bff1a4bd2a2d9eb4810cbc875" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:26.876394  2807 raft_consensus.cc:3055] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:26.876690  2807 raft_consensus.cc:740] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:26.877398  2807 consensus_queue.cc:260] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.878436  2807 raft_consensus.cc:3060] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.878773  2733 leader_election.cc:290] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 2 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.888303  2987 consensus_queue.cc:1048] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:26.891381  2807 raft_consensus.cc:2468] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 2.
I20260709 13:13:26.894354  2699 leader_election.cc:304] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:26.895412  2987 raft_consensus.cc:2804] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.895954  2987 raft_consensus.cc:697] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 LEADER]: Becoming Leader. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:26.897063  2987 consensus_queue.cc:237] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.901592  2656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d6dc8bff1a4bd2a2d9eb4810cbc875" candidate_uuid: "099250c2ee47447f849c9aecd7afe5e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:26.902913  2656 raft_consensus.cc:3060] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.907275  2657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:35950
I20260709 13:13:26.908246  2657 raft_consensus.cc:493] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:26.908800  2657 raft_consensus.cc:3060] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.935114  2984 consensus_queue.cc:1048] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.934788  2555 catalog_manager.cc:5697] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 reported cstate change: term changed from 1 to 2, leader changed from 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195) to 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194). New cstate: current_term: 2 leader_uuid: "099250c2ee47447f849c9aecd7afe5e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.942210  2657 raft_consensus.cc:515] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.945595  2656 raft_consensus.cc:2468] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099250c2ee47447f849c9aecd7afe5e2 in term 2.
I20260709 13:13:26.946537  2658 raft_consensus.cc:1240] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Rejecting Update request from peer 099250c2ee47447f849c9aecd7afe5e2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.949936  2731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:26.950591  2731 raft_consensus.cc:3055] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:26.950958  2731 raft_consensus.cc:740] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:26.951993  2731 consensus_queue.cc:260] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.953210  2731 raft_consensus.cc:3060] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.962119  2657 leader_election.cc:290] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:26.965304  2805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:26.965818  2731 raft_consensus.cc:2468] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:26.966166  2805 raft_consensus.cc:3060] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.967176  2621 leader_election.cc:304] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 85b848fbd4cd4bcd867ce8474e7cdf3a; no voters: 
I20260709 13:13:26.967944  2973 raft_consensus.cc:2804] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.968364  2973 raft_consensus.cc:697] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:26.969141  2973 consensus_queue.cc:237] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:26.975960  2555 catalog_manager.cc:5697] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 1 to 2, leader changed from 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194) to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 2 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.977941  2805 raft_consensus.cc:2468] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:27.008632  2998 raft_consensus.cc:993] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782: : Instructing follower 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:27.009119  2981 raft_consensus.cc:1081] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Signalling peer 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:27.011534  2657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb61f680ab7540fea3cb10de29f9fe02"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:35962
I20260709 13:13:27.012180  2657 raft_consensus.cc:493] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.012650  2657 raft_consensus.cc:3060] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.013229  2973 consensus_queue.cc:1048] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:27.020769  2657 raft_consensus.cc:515] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:27.024207  2657 leader_election.cc:290] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:27.025694  2731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb61f680ab7540fea3cb10de29f9fe02" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:27.028149  2731 raft_consensus.cc:3060] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.028314  2805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb61f680ab7540fea3cb10de29f9fe02" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:27.028952  2805 raft_consensus.cc:3055] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.029268  2805 raft_consensus.cc:740] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:27.030125  2805 consensus_queue.cc:260] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:27.030448  2997 consensus_queue.cc:1048] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:27.031409  2805 raft_consensus.cc:3060] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.039140  2731 raft_consensus.cc:2468] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:27.039140  2805 raft_consensus.cc:2468] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:27.040715  2624 leader_election.cc:304] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:27.041859  2922 raft_consensus.cc:2804] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.042336  2922 raft_consensus.cc:697] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:27.043464  2922 consensus_queue.cc:237] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:27.047689  2973 raft_consensus.cc:993] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a: : Instructing follower 8d77a93f08ec4c1f95c8ef636803a782 to start an election
I20260709 13:13:27.048485  2995 raft_consensus.cc:1081] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Signalling peer 8d77a93f08ec4c1f95c8ef636803a782 to start an election
I20260709 13:13:27.050127  2807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a696a2b606d1443e8f83946d9be27938"
dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:13:27.050642  2807 raft_consensus.cc:493] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.050980  2807 raft_consensus.cc:3060] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.055133  2556 catalog_manager.cc:5697] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 1 to 2, leader changed from 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195) to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 2 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.056121  2807 raft_consensus.cc:515] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:27.058660  2657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a696a2b606d1443e8f83946d9be27938" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:27.059233  2657 raft_consensus.cc:3055] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.059262  2807 leader_election.cc:290] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 2 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:27.059645  2657 raft_consensus.cc:740] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:27.060391  2731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a696a2b606d1443e8f83946d9be27938" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:27.060990  2731 raft_consensus.cc:3060] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.060534  2657 consensus_queue.cc:260] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:27.061841  2657 raft_consensus.cc:3060] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.067569  2731 raft_consensus.cc:2468] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 2.
I20260709 13:13:27.068619  2657 raft_consensus.cc:2468] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 2.
I20260709 13:13:27.068717  2770 leader_election.cc:304] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:27.069706  2981 raft_consensus.cc:2804] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.070156  2981 raft_consensus.cc:697] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 LEADER]: Becoming Leader. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:27.070883  2981 consensus_queue.cc:237] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:27.077198  2556 catalog_manager.cc:5697] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 reported cstate change: term changed from 1 to 2, leader changed from 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193) to 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.214268  3026 raft_consensus.cc:993] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2: : Instructing follower 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:27.214811  2987 raft_consensus.cc:1081] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Signalling peer 85b848fbd4cd4bcd867ce8474e7cdf3a to start an election
I20260709 13:13:27.216638  2657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
 from {username='slave'} at 127.0.0.1:35950
I20260709 13:13:27.217095  2657 raft_consensus.cc:493] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.217347  2657 raft_consensus.cc:3060] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.222317  2657 raft_consensus.cc:515] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:27.223932  2657 leader_election.cc:290] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Requested vote from peers 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897), 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195:39637)
I20260709 13:13:27.225025  2807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
I20260709 13:13:27.225049  2731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56b85638d144799e2533a4acf7018f" candidate_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:27.225663  2807 raft_consensus.cc:3060] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.225852  2731 raft_consensus.cc:3055] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.226244  2731 raft_consensus.cc:740] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:27.227054  2731 consensus_queue.cc:260] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:27.228135  2731 raft_consensus.cc:3060] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.230322  2807 raft_consensus.cc:2468] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:27.231478  2624 leader_election.cc:304] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:27.232339  2922 raft_consensus.cc:2804] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.232797  2922 raft_consensus.cc:697] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Becoming Leader. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:27.233764  2731 raft_consensus.cc:2468] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b848fbd4cd4bcd867ce8474e7cdf3a in term 2.
I20260709 13:13:27.233613  2922 consensus_queue.cc:237] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:27.241015  2556 catalog_manager.cc:5697] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a reported cstate change: term changed from 1 to 2, leader changed from 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194) to 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193). New cstate: current_term: 2 leader_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.272069  2657 raft_consensus.cc:1275] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Refusing update from remote peer 099250c2ee47447f849c9aecd7afe5e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.273531  2987 consensus_queue.cc:1048] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.283658  2807 raft_consensus.cc:1275] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 099250c2ee47447f849c9aecd7afe5e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.285107  3026 consensus_queue.cc:1048] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.338356  2804 raft_consensus.cc:1275] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 099250c2ee47447f849c9aecd7afe5e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.339705  2987 consensus_queue.cc:1048] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.348327  2657 raft_consensus.cc:1275] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Refusing update from remote peer 099250c2ee47447f849c9aecd7afe5e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.351723  3025 consensus_queue.cc:1048] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:27.462294  2657 raft_consensus.cc:1275] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Refusing update from remote peer 8d77a93f08ec4c1f95c8ef636803a782: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.463621  2998 consensus_queue.cc:1048] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.471472  2731 raft_consensus.cc:1275] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Refusing update from remote peer 8d77a93f08ec4c1f95c8ef636803a782: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.472916  2981 consensus_queue.cc:1048] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.553117  2731 raft_consensus.cc:1275] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.554445  2922 consensus_queue.cc:1048] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.559036  2804 raft_consensus.cc:1275] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.561646  2973 consensus_queue.cc:1048] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.603856  2804 raft_consensus.cc:1275] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.605334  2731 raft_consensus.cc:1275] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.605405  2973 consensus_queue.cc:1048] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:27.606876  2922 consensus_queue.cc:1048] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.686286  2804 raft_consensus.cc:1275] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.687649  3037 consensus_queue.cc:1048] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.696445  2731 raft_consensus.cc:1275] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Refusing update from remote peer 85b848fbd4cd4bcd867ce8474e7cdf3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.699793  3037 consensus_queue.cc:1048] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.717309  2555 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57322:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:29.749043  2555 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57322:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:29.877166 25395 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:29.907186  3078 tablet.cc:1724] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.070426  3091 tablet.cc:1724] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:30.094955  3085 log.cc:927] Time spent T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:13:30.108862  3099 tablet.cc:1724] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:30.118593  2684 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:1ae7e22bd2694e9482a46822255bee03)
I20260709 13:13:30.115670  3098 tablet.cc:1724] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:30.126263  2684 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:1ae7e22bd2694e9482a46822255bee03)
W20260709 13:13:30.136615  2684 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:1ae7e22bd2694e9482a46822255bee03)
I20260709 13:13:30.121423  3089 tablet.cc:1724] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:30.141868  2624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:39637, user_credentials={real_user=slave}} blocked reactor thread for 87553.3us
I20260709 13:13:30.143028  3103 tablet.cc:1724] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:30.145108  3087 log.cc:927] Time spent T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:13:30.255311  3109 tablet.cc:1724] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.258881  3110 tablet.cc:1724] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.263159  3111 tablet.cc:1724] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.282881  3108 tablet.cc:1724] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.283974  3078 tablet.cc:1724] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.284830  3107 tablet.cc:1724] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.308648  3089 tablet.cc:1724] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.326953  3109 tablet.cc:1724] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.327446  2653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
mode: GRACEFUL
new_leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
 from {username='slave'} at 127.0.0.1:35982
I20260709 13:13:30.328624  2653 raft_consensus.cc:606] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Received request to transfer leadership to TS 8d77a93f08ec4c1f95c8ef636803a782
W20260709 13:13:30.344411  3105 log.cc:927] Time spent T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 13:13:30.353668  3112 tablet.cc:1724] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:30.361021  2699 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:39637, user_credentials={real_user=slave}} blocked reactor thread for 71358.4us
I20260709 13:13:30.367218  3107 tablet.cc:1724] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.374051  3091 tablet.cc:1724] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.377028  3108 tablet.cc:1724] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.365624  3099 tablet.cc:1724] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.399088  3107 tablet.cc:1724] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.399592  3110 tablet.cc:1724] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.401747  3089 tablet.cc:1724] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.404778  3078 tablet.cc:1724] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.397377  3103 tablet.cc:1724] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.420993  3098 tablet.cc:1724] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.446836  3112 tablet.cc:1724] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.450026  3089 tablet.cc:1724] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:30.481699  2732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a19f2fd2513452d8e706d417b782a93"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
mode: GRACEFUL
new_leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
 from {username='slave'} at 127.0.0.1:49990
I20260709 13:13:30.482371  2732 raft_consensus.cc:606] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Received request to transfer leadership to TS 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:30.483662 25395 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:13:30.484227 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:30.492811  2652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d"
dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
mode: GRACEFUL
new_leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
 from {username='slave'} at 127.0.0.1:35982
I20260709 13:13:30.493453  2652 raft_consensus.cc:606] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Received request to transfer leadership to TS 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:30.496305  2732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c522f3392ecf413b9300903402274585"
dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
mode: GRACEFUL
new_leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
 from {username='slave'} at 127.0.0.1:49990
I20260709 13:13:30.496845  2732 raft_consensus.cc:606] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Received request to transfer leadership to TS 8d77a93f08ec4c1f95c8ef636803a782
I20260709 13:13:30.498018 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:30.498559 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:30.502115  2555 catalog_manager.cc:6242] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6: soft_deleted_table [id=20dc48344eab4167aa7cefb8c71faf92] alter complete (version 1)
I20260709 13:13:30.563761  3113 raft_consensus.cc:993] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2: : Instructing follower 8d77a93f08ec4c1f95c8ef636803a782 to start an election
I20260709 13:13:30.564363  3115 raft_consensus.cc:1081] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Signalling peer 8d77a93f08ec4c1f95c8ef636803a782 to start an election
I20260709 13:13:30.566296  2802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c522f3392ecf413b9300903402274585"
dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
 from {username='slave'} at 127.0.0.1:44700
I20260709 13:13:30.567018  2802 raft_consensus.cc:493] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.567358  2802 raft_consensus.cc:3060] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.573764  2802 raft_consensus.cc:515] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.575970  3115 raft_consensus.cc:993] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2: : Instructing follower 8d77a93f08ec4c1f95c8ef636803a782 to start an election
I20260709 13:13:30.576249  2802 leader_election.cc:290] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 2 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:30.576731  3082 raft_consensus.cc:1081] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Signalling peer 8d77a93f08ec4c1f95c8ef636803a782 to start an election
I20260709 13:13:30.576658  2652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522f3392ecf413b9300903402274585" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:30.577838  2652 raft_consensus.cc:3060] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.578547  2732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c522f3392ecf413b9300903402274585" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:30.579121  2732 raft_consensus.cc:3055] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.579409  2732 raft_consensus.cc:740] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:30.580251  2732 consensus_queue.cc:260] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.580919  2802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a19f2fd2513452d8e706d417b782a93"
dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
 from {username='slave'} at 127.0.0.1:44700
I20260709 13:13:30.581895  2802 raft_consensus.cc:493] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.582448  2802 raft_consensus.cc:3060] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.583316  2732 raft_consensus.cc:3060] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.588322  2652 raft_consensus.cc:2468] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 2.
I20260709 13:13:30.589963  2771 leader_election.cc:304] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:30.590909  3041 raft_consensus.cc:2804] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.590468  2732 raft_consensus.cc:2468] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 2.
I20260709 13:13:30.591461  3041 raft_consensus.cc:697] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 LEADER]: Becoming Leader. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:30.591698  2802 raft_consensus.cc:515] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.592589  3041 consensus_queue.cc:237] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.594571  2802 leader_election.cc:290] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 2 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:30.597748  2652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19f2fd2513452d8e706d417b782a93" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:30.598454  2652 raft_consensus.cc:3060] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.601473  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19f2fd2513452d8e706d417b782a93" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:30.602298  2733 raft_consensus.cc:3055] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.602646  2733 raft_consensus.cc:740] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 099250c2ee47447f849c9aecd7afe5e2, State: Running, Role: LEADER
I20260709 13:13:30.603636  2733 consensus_queue.cc:260] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.605449  2733 raft_consensus.cc:3060] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.608071  2652 raft_consensus.cc:2468] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 2.
I20260709 13:13:30.609411  2771 leader_election.cc:304] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b848fbd4cd4bcd867ce8474e7cdf3a, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:30.610357  3041 raft_consensus.cc:2804] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.611183  3041 raft_consensus.cc:697] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 LEADER]: Becoming Leader. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:30.612375  3041 consensus_queue.cc:237] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.613019  2555 catalog_manager.cc:5697] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 reported cstate change: term changed from 1 to 2, leader changed from 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194) to 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.615885  2733 raft_consensus.cc:2468] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 2.
I20260709 13:13:30.623935  3095 raft_consensus.cc:993] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a: : Instructing follower 8d77a93f08ec4c1f95c8ef636803a782 to start an election
I20260709 13:13:30.624665  3102 raft_consensus.cc:1081] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Signalling peer 8d77a93f08ec4c1f95c8ef636803a782 to start an election
I20260709 13:13:30.626149  2802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c"
dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:13:30.626670  2802 raft_consensus.cc:493] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.627007  2802 raft_consensus.cc:3060] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.627544  2555 catalog_manager.cc:5697] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 reported cstate change: term changed from 1 to 2, leader changed from 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194) to 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195). New cstate: current_term: 2 leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.634030  2802 raft_consensus.cc:515] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.637053  2802 leader_election.cc:290] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 3 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:30.637161  2652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:30.637923  2652 raft_consensus.cc:3055] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:30.638159  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267a1bc0d7e74e1f84f8cfe00b491b9c" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:30.638319  2652 raft_consensus.cc:740] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:30.638958  2733 raft_consensus.cc:3060] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.639498  2652 consensus_queue.cc:260] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.641039  2652 raft_consensus.cc:3060] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.647138  2733 raft_consensus.cc:2468] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 3.
I20260709 13:13:30.648968  2652 raft_consensus.cc:2468] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 3.
I20260709 13:13:30.649819  2770 leader_election.cc:304] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:30.650732  3041 raft_consensus.cc:2804] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:30.651271  3041 raft_consensus.cc:697] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 3 LEADER]: Becoming Leader. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:30.652132  3041 consensus_queue.cc:237] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.658526  2555 catalog_manager.cc:5697] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 reported cstate change: term changed from 2 to 3, leader changed from 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193) to 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.754662  3095 raft_consensus.cc:993] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a: : Instructing follower 8d77a93f08ec4c1f95c8ef636803a782 to start an election
I20260709 13:13:30.755157  3102 raft_consensus.cc:1081] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Signalling peer 8d77a93f08ec4c1f95c8ef636803a782 to start an election
I20260709 13:13:30.756704  2802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d"
dest_uuid: "8d77a93f08ec4c1f95c8ef636803a782"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:13:30.757270  2802 raft_consensus.cc:493] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.757665  2802 raft_consensus.cc:3060] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.763424  2802 raft_consensus.cc:515] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.765237  2802 leader_election.cc:290] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 3 election: Requested vote from peers 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941), 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897)
I20260709 13:13:30.766031  2652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a"
I20260709 13:13:30.766606  2733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8619ca8ad1ee465784515254d7fd756d" candidate_uuid: "8d77a93f08ec4c1f95c8ef636803a782" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "099250c2ee47447f849c9aecd7afe5e2"
I20260709 13:13:30.766856  2652 raft_consensus.cc:3055] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:30.767238  2733 raft_consensus.cc:3060] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.767292  2652 raft_consensus.cc:740] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85b848fbd4cd4bcd867ce8474e7cdf3a, State: Running, Role: LEADER
I20260709 13:13:30.768183  2652 consensus_queue.cc:260] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.769246  2652 raft_consensus.cc:3060] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.772605  2733 raft_consensus.cc:2468] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 3.
I20260709 13:13:30.774196  2770 leader_election.cc:304] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 099250c2ee47447f849c9aecd7afe5e2, 8d77a93f08ec4c1f95c8ef636803a782; no voters: 
I20260709 13:13:30.774590  2652 raft_consensus.cc:2468] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d77a93f08ec4c1f95c8ef636803a782 in term 3.
I20260709 13:13:30.775056  3041 raft_consensus.cc:2804] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:30.775609  3041 raft_consensus.cc:697] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 3 LEADER]: Becoming Leader. State: Replica: 8d77a93f08ec4c1f95c8ef636803a782, State: Running, Role: LEADER
I20260709 13:13:30.776845  3041 consensus_queue.cc:237] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } }
I20260709 13:13:30.786173  2555 catalog_manager.cc:5697] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 reported cstate change: term changed from 2 to 3, leader changed from 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193) to 8d77a93f08ec4c1f95c8ef636803a782 (127.24.204.195). New cstate: current_term: 3 leader_uuid: "8d77a93f08ec4c1f95c8ef636803a782" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d77a93f08ec4c1f95c8ef636803a782" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 39637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.974099  2733 raft_consensus.cc:1275] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Refusing update from remote peer 8d77a93f08ec4c1f95c8ef636803a782: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.975482  3041 consensus_queue.cc:1048] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:30.986680  2652 raft_consensus.cc:1275] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Refusing update from remote peer 8d77a93f08ec4c1f95c8ef636803a782: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.989881  3041 consensus_queue.cc:1048] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.087666  2652 raft_consensus.cc:1275] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Refusing update from remote peer 8d77a93f08ec4c1f95c8ef636803a782: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:31.089001  3124 consensus_queue.cc:1048] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:31.097393  2733 raft_consensus.cc:1275] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Refusing update from remote peer 8d77a93f08ec4c1f95c8ef636803a782: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:31.100427  3041 consensus_queue.cc:1048] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:31.111701  2733 raft_consensus.cc:1275] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 3 FOLLOWER]: Refusing update from remote peer 8d77a93f08ec4c1f95c8ef636803a782: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:31.112864  3124 consensus_queue.cc:1048] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:31.125212  2652 raft_consensus.cc:1275] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 3 FOLLOWER]: Refusing update from remote peer 8d77a93f08ec4c1f95c8ef636803a782: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:31.127049  3041 consensus_queue.cc:1048] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:31.196674  2652 raft_consensus.cc:1275] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 3 FOLLOWER]: Refusing update from remote peer 8d77a93f08ec4c1f95c8ef636803a782: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:31.198158  3124 consensus_queue.cc:1048] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b848fbd4cd4bcd867ce8474e7cdf3a" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:31.208885  2733 raft_consensus.cc:1275] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 3 FOLLOWER]: Refusing update from remote peer 8d77a93f08ec4c1f95c8ef636803a782: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:31.210403  3041 consensus_queue.cc:1048] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [LEADER]: Connected to new peer: Peer: permanent_uuid: "099250c2ee47447f849c9aecd7afe5e2" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 41897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:31.564626 25395 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:31.570024 25395 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:13:31.570546 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:31.575376 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:13:31.575856 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:32.611646 25395 tablet_server.cc:179] TabletServer@127.24.204.193:0 shutting down...
W20260709 13:13:32.638376  2697 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:13:32.646863  2697 consensus_peers.cc:597] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 -> Peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Couldn't send request to peer 85b848fbd4cd4bcd867ce8474e7cdf3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:32.649013  2771 consensus_peers.cc:597] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 -> Peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Couldn't send request to peer 85b848fbd4cd4bcd867ce8474e7cdf3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.654448 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:32.655619 25395 tablet_replica.cc:333] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.656710 25395 raft_consensus.cc:2243] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.657619 25395 raft_consensus.cc:2272] T 3a19f2fd2513452d8e706d417b782a93 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.661399 25395 tablet_replica.cc:333] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.662243 25395 raft_consensus.cc:2243] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.662796 25395 raft_consensus.cc:2272] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.665272 25395 tablet_replica.cc:333] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.666198 25395 raft_consensus.cc:2243] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.667310 25395 raft_consensus.cc:2272] T 3b56b85638d144799e2533a4acf7018f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.670540 25395 tablet_replica.cc:333] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.671455 25395 raft_consensus.cc:2243] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:32.672140  2771 consensus_peers.cc:597] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 -> Peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Couldn't send request to peer 85b848fbd4cd4bcd867ce8474e7cdf3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.672694 25395 raft_consensus.cc:2272] T 1ae7e22bd2694e9482a46822255bee03 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.675602 25395 tablet_replica.cc:333] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.676200 25395 raft_consensus.cc:2243] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.677162 25395 raft_consensus.cc:2272] T fb61f680ab7540fea3cb10de29f9fe02 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.679633 25395 tablet_replica.cc:333] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.680224 25395 raft_consensus.cc:2243] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.680688 25395 raft_consensus.cc:2272] T c56336482a8e4c1db94c7eeeba0a3fab P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.683096 25395 tablet_replica.cc:333] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.683697 25395 raft_consensus.cc:2243] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.684177 25395 raft_consensus.cc:2272] T 58abab3ac23a474286cfa01dbd7a0b1b P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.686784 25395 tablet_replica.cc:333] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.687446 25395 raft_consensus.cc:2243] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.688333 25395 raft_consensus.cc:2272] T 685c5dad375049e8ae64318ca8ab173a P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.690981 25395 tablet_replica.cc:333] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.691567 25395 raft_consensus.cc:2243] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.691999 25395 raft_consensus.cc:2272] T d402ce9601b14df8a47ced4dbcbf59c6 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.694288 25395 tablet_replica.cc:333] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.694852 25395 raft_consensus.cc:2243] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.695258 25395 raft_consensus.cc:2272] T ab68d90fa54d47ce83ddf5520d54389f P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.697382 25395 tablet_replica.cc:333] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.697973 25395 raft_consensus.cc:2243] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.698413 25395 raft_consensus.cc:2272] T a696a2b606d1443e8f83946d9be27938 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.700589 25395 tablet_replica.cc:333] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.701102 25395 raft_consensus.cc:2243] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.701661 25395 raft_consensus.cc:2272] T 09c352675a934ec892c7c2578da74be1 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.703846 25395 tablet_replica.cc:333] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.704380 25395 raft_consensus.cc:2243] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.704766 25395 raft_consensus.cc:2272] T c522f3392ecf413b9300903402274585 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.706918 25395 tablet_replica.cc:333] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.707423 25395 raft_consensus.cc:2243] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.707998 25395 raft_consensus.cc:2272] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.710129 25395 tablet_replica.cc:333] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.710633 25395 raft_consensus.cc:2243] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.711467 25395 raft_consensus.cc:2272] T a0eb8caca99640d7a0d64ebf3353bace P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.713768 25395 tablet_replica.cc:333] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.714313 25395 raft_consensus.cc:2243] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.714771 25395 raft_consensus.cc:2272] T 3dbb647f54ad48fb835aa4b4853762de P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.716913 25395 tablet_replica.cc:333] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.717388 25395 raft_consensus.cc:2243] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.717860 25395 raft_consensus.cc:2272] T 8619ca8ad1ee465784515254d7fd756d P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.720674 25395 tablet_replica.cc:333] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a: stopping tablet replica
I20260709 13:13:32.721239 25395 raft_consensus.cc:2243] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.722340 25395 raft_consensus.cc:2272] T 1c553a5e178647d2b4fa86590d962129 P 85b848fbd4cd4bcd867ce8474e7cdf3a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:32.722468  2697 consensus_peers.cc:597] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 -> Peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Couldn't send request to peer 85b848fbd4cd4bcd867ce8474e7cdf3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.772533 25395 tablet_server.cc:196] TabletServer@127.24.204.193:0 shutdown complete.
W20260709 13:13:32.811518  2697 consensus_peers.cc:597] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 -> Peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Couldn't send request to peer 85b848fbd4cd4bcd867ce8474e7cdf3a. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:41941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:32.814139  2697 consensus_peers.cc:597] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 -> Peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Couldn't send request to peer 85b848fbd4cd4bcd867ce8474e7cdf3a. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:41941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.820804 25395 tablet_server.cc:179] TabletServer@127.24.204.194:0 shutting down...
W20260709 13:13:32.829048  2770 consensus_peers.cc:597] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 -> Peer 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897): Couldn't send request to peer 099250c2ee47447f849c9aecd7afe5e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.859731 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:32.860931 25395 tablet_replica.cc:333] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.861670 25395 raft_consensus.cc:2243] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.862591 25395 raft_consensus.cc:2272] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.864714 25395 tablet_replica.cc:333] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.865734 25395 raft_consensus.cc:2243] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.866200 25395 raft_consensus.cc:2272] T 3a19f2fd2513452d8e706d417b782a93 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.868829 25395 tablet_replica.cc:333] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.869825 25395 raft_consensus.cc:2243] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:32.870260  2697 consensus_peers.cc:597] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 -> Peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Couldn't send request to peer 85b848fbd4cd4bcd867ce8474e7cdf3a. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:41941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.870322 25395 raft_consensus.cc:2272] T 1ae7e22bd2694e9482a46822255bee03 P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.872802 25395 tablet_replica.cc:333] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.873356 25395 raft_consensus.cc:2243] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.873853 25395 raft_consensus.cc:2272] T 3b56b85638d144799e2533a4acf7018f P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.876077 25395 tablet_replica.cc:333] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.876799 25395 raft_consensus.cc:2243] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.877687 25395 raft_consensus.cc:2272] T d402ce9601b14df8a47ced4dbcbf59c6 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.879838 25395 tablet_replica.cc:333] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.880461 25395 raft_consensus.cc:2243] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.880941 25395 raft_consensus.cc:2272] T ab68d90fa54d47ce83ddf5520d54389f P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.883167 25395 tablet_replica.cc:333] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.883736 25395 raft_consensus.cc:2243] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.884182 25395 raft_consensus.cc:2272] T a696a2b606d1443e8f83946d9be27938 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.886363 25395 tablet_replica.cc:333] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.887104 25395 raft_consensus.cc:2243] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.887930 25395 raft_consensus.cc:2272] T 09c352675a934ec892c7c2578da74be1 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.890205 25395 tablet_replica.cc:333] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.890712 25395 raft_consensus.cc:2243] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.891146 25395 raft_consensus.cc:2272] T c522f3392ecf413b9300903402274585 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.893134 25395 tablet_replica.cc:333] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.893761 25395 raft_consensus.cc:2243] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.894611 25395 raft_consensus.cc:2272] T c56336482a8e4c1db94c7eeeba0a3fab P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.896790 25395 tablet_replica.cc:333] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.897369 25395 raft_consensus.cc:2243] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.897863 25395 raft_consensus.cc:2272] T fb61f680ab7540fea3cb10de29f9fe02 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.900239 25395 tablet_replica.cc:333] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.901079 25395 raft_consensus.cc:2243] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.902065 25395 raft_consensus.cc:2272] T 58abab3ac23a474286cfa01dbd7a0b1b P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.904346 25395 tablet_replica.cc:333] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.904894 25395 raft_consensus.cc:2243] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.905522 25395 raft_consensus.cc:2272] T 685c5dad375049e8ae64318ca8ab173a P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.907550 25395 tablet_replica.cc:333] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.908125 25395 raft_consensus.cc:2243] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.908599 25395 raft_consensus.cc:2272] T 1c553a5e178647d2b4fa86590d962129 P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.910578 25395 tablet_replica.cc:333] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.911106 25395 raft_consensus.cc:2243] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.911597 25395 raft_consensus.cc:2272] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 099250c2ee47447f849c9aecd7afe5e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.913484 25395 tablet_replica.cc:333] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.914014 25395 raft_consensus.cc:2243] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.914455 25395 raft_consensus.cc:2272] T a0eb8caca99640d7a0d64ebf3353bace P 099250c2ee47447f849c9aecd7afe5e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.916383 25395 tablet_replica.cc:333] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.916872 25395 raft_consensus.cc:2243] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.917717 25395 raft_consensus.cc:2272] T 3dbb647f54ad48fb835aa4b4853762de P 099250c2ee47447f849c9aecd7afe5e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.919703 25395 tablet_replica.cc:333] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2: stopping tablet replica
I20260709 13:13:32.920202 25395 raft_consensus.cc:2243] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.920639 25395 raft_consensus.cc:2272] T 8619ca8ad1ee465784515254d7fd756d P 099250c2ee47447f849c9aecd7afe5e2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:32.963925  2771 consensus_peers.cc:597] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 -> Peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Couldn't send request to peer 85b848fbd4cd4bcd867ce8474e7cdf3a. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:41941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.965451 25395 tablet_server.cc:196] TabletServer@127.24.204.194:0 shutdown complete.
W20260709 13:13:32.966338  2770 consensus_peers.cc:597] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 -> Peer 099250c2ee47447f849c9aecd7afe5e2 (127.24.204.194:41897): Couldn't send request to peer 099250c2ee47447f849c9aecd7afe5e2. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:41897: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:32.969512  2771 consensus_peers.cc:597] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 -> Peer 85b848fbd4cd4bcd867ce8474e7cdf3a (127.24.204.193:41941): Couldn't send request to peer 85b848fbd4cd4bcd867ce8474e7cdf3a. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:41941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.003649 25395 tablet_server.cc:179] TabletServer@127.24.204.195:0 shutting down...
I20260709 13:13:33.042121 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:33.043004 25395 tablet_replica.cc:333] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.044217 25395 raft_consensus.cc:2243] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:33.045042 25395 raft_consensus.cc:2272] T 3a19f2fd2513452d8e706d417b782a93 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.047576 25395 tablet_replica.cc:333] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.048177 25395 raft_consensus.cc:2243] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.048615 25395 raft_consensus.cc:2272] T a1d6dc8bff1a4bd2a2d9eb4810cbc875 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.050587 25395 tablet_replica.cc:333] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.051100 25395 raft_consensus.cc:2243] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.051522 25395 raft_consensus.cc:2272] T 3b56b85638d144799e2533a4acf7018f P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.053339 25395 tablet_replica.cc:333] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.053944 25395 raft_consensus.cc:2243] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.054327 25395 raft_consensus.cc:2272] T 1ae7e22bd2694e9482a46822255bee03 P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.056157 25395 tablet_replica.cc:333] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.056656 25395 raft_consensus.cc:2243] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.057032 25395 raft_consensus.cc:2272] T a0eb8caca99640d7a0d64ebf3353bace P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.059026 25395 tablet_replica.cc:333] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.059516 25395 raft_consensus.cc:2243] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:33.060230 25395 raft_consensus.cc:2272] T 267a1bc0d7e74e1f84f8cfe00b491b9c P 8d77a93f08ec4c1f95c8ef636803a782 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.062547 25395 tablet_replica.cc:333] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.063117 25395 raft_consensus.cc:2243] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:33.064086 25395 raft_consensus.cc:2272] T a696a2b606d1443e8f83946d9be27938 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.066185 25395 tablet_replica.cc:333] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.066718 25395 raft_consensus.cc:2243] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.067129 25395 raft_consensus.cc:2272] T 09c352675a934ec892c7c2578da74be1 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.069160 25395 tablet_replica.cc:333] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.069855 25395 raft_consensus.cc:2243] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:33.070631 25395 raft_consensus.cc:2272] T c522f3392ecf413b9300903402274585 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.072726 25395 tablet_replica.cc:333] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.073529 25395 raft_consensus.cc:2243] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:33.074455 25395 raft_consensus.cc:2272] T ab68d90fa54d47ce83ddf5520d54389f P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.076534 25395 tablet_replica.cc:333] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.077127 25395 raft_consensus.cc:2243] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.077682 25395 raft_consensus.cc:2272] T d402ce9601b14df8a47ced4dbcbf59c6 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.079825 25395 tablet_replica.cc:333] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.080479 25395 raft_consensus.cc:2243] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.080911 25395 raft_consensus.cc:2272] T 3dbb647f54ad48fb835aa4b4853762de P 8d77a93f08ec4c1f95c8ef636803a782 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.082803 25395 tablet_replica.cc:333] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.083329 25395 raft_consensus.cc:2243] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:33.084084 25395 raft_consensus.cc:2272] T 8619ca8ad1ee465784515254d7fd756d P 8d77a93f08ec4c1f95c8ef636803a782 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.086135 25395 tablet_replica.cc:333] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.086653 25395 raft_consensus.cc:2243] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.087123 25395 raft_consensus.cc:2272] T 1c553a5e178647d2b4fa86590d962129 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.089243 25395 tablet_replica.cc:333] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.089768 25395 raft_consensus.cc:2243] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.090204 25395 raft_consensus.cc:2272] T c56336482a8e4c1db94c7eeeba0a3fab P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.092867 25395 tablet_replica.cc:333] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.093464 25395 raft_consensus.cc:2243] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.093978 25395 raft_consensus.cc:2272] T fb61f680ab7540fea3cb10de29f9fe02 P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.096000 25395 tablet_replica.cc:333] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.096474 25395 raft_consensus.cc:2243] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.096879 25395 raft_consensus.cc:2272] T 58abab3ac23a474286cfa01dbd7a0b1b P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.099020 25395 tablet_replica.cc:333] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782: stopping tablet replica
I20260709 13:13:33.099526 25395 raft_consensus.cc:2243] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:33.099972 25395 raft_consensus.cc:2272] T 685c5dad375049e8ae64318ca8ab173a P 8d77a93f08ec4c1f95c8ef636803a782 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.144277 25395 tablet_server.cc:196] TabletServer@127.24.204.195:0 shutdown complete.
I20260709 13:13:33.178118 25395 master.cc:562] Master@127.24.204.254:33555 shutting down...
I20260709 13:13:33.203531 25395 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:33.204182 25395 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.204562 25395 tablet_replica.cc:333] T 00000000000000000000000000000000 P cc1ac08932574049a668eba12f65d4c6: stopping tablet replica
I20260709 13:13:33.225821 25395 master.cc:584] Master@127.24.204.254:33555 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12971 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:13:33.281497 25395 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.204.254:45225
I20260709 13:13:33.282809 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:33.289465  3141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.289737  3140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.289882  3143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:33.290565 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:33.291553 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:33.291726 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:33.291926 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602813291893 us; error 0 us; skew 500 ppm
I20260709 13:13:33.292505 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:33.295174 25395 webserver.cc:533] Webserver started at http://127.24.204.254:46767/ using document root <none> and password file <none>
I20260709 13:13:33.295691 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:33.295876 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:33.296164 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:33.297230 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/master-0-root/instance:
uuid: "873ae9ef01fe4d6091c805fb9a293932"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-qv7r"
I20260709 13:13:33.302182 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:13:33.306011  3148 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.306931 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:13:33.307189 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/master-0-root
uuid: "873ae9ef01fe4d6091c805fb9a293932"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-qv7r"
I20260709 13:13:33.307430 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:33.342253 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:33.343621 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:33.387491 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.254:45225
I20260709 13:13:33.387625  3199 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.254:45225 every 8 connection(s)
I20260709 13:13:33.391400  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.402599  3200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932: Bootstrap starting.
I20260709 13:13:33.407809  3200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.413220  3200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932: No bootstrap required, opened a new log
I20260709 13:13:33.415580  3200 raft_consensus.cc:359] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "873ae9ef01fe4d6091c805fb9a293932" member_type: VOTER }
I20260709 13:13:33.415966  3200 raft_consensus.cc:385] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.416213  3200 raft_consensus.cc:740] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873ae9ef01fe4d6091c805fb9a293932, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.416865  3200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "873ae9ef01fe4d6091c805fb9a293932" member_type: VOTER }
I20260709 13:13:33.417335  3200 raft_consensus.cc:399] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:33.417547  3200 raft_consensus.cc:493] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:33.417900  3200 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.422901  3200 raft_consensus.cc:515] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "873ae9ef01fe4d6091c805fb9a293932" member_type: VOTER }
I20260709 13:13:33.423470  3200 leader_election.cc:304] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 873ae9ef01fe4d6091c805fb9a293932; no voters: 
I20260709 13:13:33.424791  3200 leader_election.cc:290] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:33.425170  3203 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.426604  3203 raft_consensus.cc:697] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 1 LEADER]: Becoming Leader. State: Replica: 873ae9ef01fe4d6091c805fb9a293932, State: Running, Role: LEADER
I20260709 13:13:33.427326  3203 consensus_queue.cc:237] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "873ae9ef01fe4d6091c805fb9a293932" member_type: VOTER }
I20260709 13:13:33.427841  3200 sys_catalog.cc:565] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:33.432154  3205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 873ae9ef01fe4d6091c805fb9a293932. Latest consensus state: current_term: 1 leader_uuid: "873ae9ef01fe4d6091c805fb9a293932" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "873ae9ef01fe4d6091c805fb9a293932" member_type: VOTER } }
I20260709 13:13:33.432121  3204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "873ae9ef01fe4d6091c805fb9a293932" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "873ae9ef01fe4d6091c805fb9a293932" member_type: VOTER } }
I20260709 13:13:33.439438  3205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:33.439581  3204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:33.449369  3211 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:33.456875  3211 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:33.458092 25395 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:33.466328  3211 catalog_manager.cc:1383] Generated new cluster ID: 1e2b7af415ef46f19eb675616564c907
I20260709 13:13:33.466666  3211 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:33.487068  3211 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:33.488466  3211 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:33.500689  3211 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932: Generated new TSK 0
I20260709 13:13:33.501317  3211 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:33.525245 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:33.531793  3221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.532786  3222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.536631  3224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:33.536890 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:33.537892 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:33.538134 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:33.538304 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602813538282 us; error 0 us; skew 500 ppm
I20260709 13:13:33.538892 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:33.541299 25395 webserver.cc:533] Webserver started at http://127.24.204.193:37497/ using document root <none> and password file <none>
I20260709 13:13:33.541836 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:33.542038 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:33.542306 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:33.543377 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-0-root/instance:
uuid: "d893b01f407546b7a63ec8903aa53760"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-qv7r"
I20260709 13:13:33.548084 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:33.551717  3229 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.552564 25395 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:33.552893 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-0-root
uuid: "d893b01f407546b7a63ec8903aa53760"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-qv7r"
I20260709 13:13:33.553218 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:33.572675 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:33.573993 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:33.575479 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:33.577839 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:33.578081 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.578323 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:33.578531 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.621953 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.193:46033
I20260709 13:13:33.622079  3291 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.193:46033 every 8 connection(s)
I20260709 13:13:33.627116 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:33.634825  3296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.636811  3297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.640187  3299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:33.641352 25395 server_base.cc:1061] running on GCE node
I20260709 13:13:33.641495  3292 heartbeater.cc:344] Connected to a master server at 127.24.204.254:45225
I20260709 13:13:33.642024  3292 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:33.643117  3292 heartbeater.cc:507] Master 127.24.204.254:45225 requested a full tablet report, sending...
I20260709 13:13:33.643384 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:33.643747 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:33.644102 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602813644075 us; error 0 us; skew 500 ppm
I20260709 13:13:33.645008 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:33.646003  3165 ts_manager.cc:194] Registered new tserver with Master: d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033)
I20260709 13:13:33.648248  3165 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51952
I20260709 13:13:33.648463 25395 webserver.cc:533] Webserver started at http://127.24.204.194:42403/ using document root <none> and password file <none>
I20260709 13:13:33.649171 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:33.649432 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:33.649796 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:33.651502 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-1-root/instance:
uuid: "4d5d81a6b8734b759a4450ecb507163a"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-qv7r"
I20260709 13:13:33.656731 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:13:33.660480  3304 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.661463 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:13:33.661890 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-1-root
uuid: "4d5d81a6b8734b759a4450ecb507163a"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-qv7r"
I20260709 13:13:33.662384 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:33.691820 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:33.693053 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:33.694936 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:33.697311 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:33.697525 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.697793 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:33.697947 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.743423 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.194:45899
I20260709 13:13:33.743551  3366 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.194:45899 every 8 connection(s)
I20260709 13:13:33.748413 25395 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:33.758119  3370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.758188  3371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:33.762363  3367 heartbeater.cc:344] Connected to a master server at 127.24.204.254:45225
I20260709 13:13:33.763038  3367 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:33.765292  3367 heartbeater.cc:507] Master 127.24.204.254:45225 requested a full tablet report, sending...
I20260709 13:13:33.766183 25395 server_base.cc:1061] running on GCE node
W20260709 13:13:33.766938  3373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:33.768113 25395 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:33.768375 25395 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:33.768586 25395 hybrid_clock.cc:648] HybridClock initialized: now 1783602813768566 us; error 0 us; skew 500 ppm
I20260709 13:13:33.768534  3165 ts_manager.cc:194] Registered new tserver with Master: 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:33.769641 25395 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:33.770646  3165 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51958
I20260709 13:13:33.772558 25395 webserver.cc:533] Webserver started at http://127.24.204.195:36521/ using document root <none> and password file <none>
I20260709 13:13:33.773288 25395 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:33.773526 25395 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:33.773840 25395 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:33.774923 25395 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-2-root/instance:
uuid: "2b9ef9fe180849ed8d71508135af43fa"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-qv7r"
I20260709 13:13:33.779567 25395 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:33.783569  3378 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.784581 25395 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:13:33.784874 25395 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-2-root
uuid: "2b9ef9fe180849ed8d71508135af43fa"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-qv7r"
I20260709 13:13:33.785152 25395 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvXBnLd/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602508284650-25395-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:33.812671 25395 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:33.813941 25395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:33.815191 25395 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:33.817360 25395 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:33.817543 25395 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.817849 25395 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:33.818010 25395 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.864607 25395 rpc_server.cc:307] RPC server started. Bound to: 127.24.204.195:45557
I20260709 13:13:33.864702  3440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.204.195:45557 every 8 connection(s)
I20260709 13:13:33.880565  3441 heartbeater.cc:344] Connected to a master server at 127.24.204.254:45225
I20260709 13:13:33.881069  3441 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:33.881893  3441 heartbeater.cc:507] Master 127.24.204.254:45225 requested a full tablet report, sending...
I20260709 13:13:33.884078  3165 ts_manager.cc:194] Registered new tserver with Master: 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:33.884627 25395 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016597555s
I20260709 13:13:33.885514  3165 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51974
I20260709 13:13:33.911698  3165 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51984:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:33.914566  3165 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:33.990795  3257 tablet_service.cc:1511] Processing CreateTablet for tablet dfcad048e01a4c24b6092842d09c8c2f (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:33.992386  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfcad048e01a4c24b6092842d09c8c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.994745  3256 tablet_service.cc:1511] Processing CreateTablet for tablet 37c0daf5154f4bb299b8302704829e6c (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:33.996307  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c0daf5154f4bb299b8302704829e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.998031  3329 tablet_service.cc:1511] Processing CreateTablet for tablet 1511623245434b6a8652d7409d0b36b6 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:33.998693  3252 tablet_service.cc:1511] Processing CreateTablet for tablet 19cdf59bd2984a86bc3a86f8bbe8bb59 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:33.999554  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1511623245434b6a8652d7409d0b36b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.000387  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19cdf59bd2984a86bc3a86f8bbe8bb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.002808  3332 tablet_service.cc:1511] Processing CreateTablet for tablet dfcad048e01a4c24b6092842d09c8c2f (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:34.004035  3255 tablet_service.cc:1511] Processing CreateTablet for tablet 643c45d63e6f414b85118745f851c6f4 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:34.004226  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfcad048e01a4c24b6092842d09c8c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.013465  3327 tablet_service.cc:1511] Processing CreateTablet for tablet 19cdf59bd2984a86bc3a86f8bbe8bb59 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:34.022178  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 643c45d63e6f414b85118745f851c6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.023181  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19cdf59bd2984a86bc3a86f8bbe8bb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.017848  3324 tablet_service.cc:1511] Processing CreateTablet for tablet 313faa5edb7a49aabbca4f28b29d5155 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:34.005923  3254 tablet_service.cc:1511] Processing CreateTablet for tablet 1511623245434b6a8652d7409d0b36b6 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:34.026839  3324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313faa5edb7a49aabbca4f28b29d5155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.027335  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1511623245434b6a8652d7409d0b36b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.007705  3328 tablet_service.cc:1511] Processing CreateTablet for tablet fbbcf82a63da4313b6ff24cd81c1ecd2 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:34.008198  3331 tablet_service.cc:1511] Processing CreateTablet for tablet 37c0daf5154f4bb299b8302704829e6c (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:34.006641  3330 tablet_service.cc:1511] Processing CreateTablet for tablet 643c45d63e6f414b85118745f851c6f4 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:34.013921  3251 tablet_service.cc:1511] Processing CreateTablet for tablet 616b48eafd31410b858fe2084bfa8924 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:34.033579  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616b48eafd31410b858fe2084bfa8924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.012634  3325 tablet_service.cc:1511] Processing CreateTablet for tablet 4f326f07112440e4bb7d30dae0a46bd4 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:34.002843  3253 tablet_service.cc:1511] Processing CreateTablet for tablet fbbcf82a63da4313b6ff24cd81c1ecd2 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:34.040508  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbcf82a63da4313b6ff24cd81c1ecd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.030709  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbcf82a63da4313b6ff24cd81c1ecd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.010978  3326 tablet_service.cc:1511] Processing CreateTablet for tablet 616b48eafd31410b858fe2084bfa8924 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:34.043362  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616b48eafd31410b858fe2084bfa8924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.016829  3249 tablet_service.cc:1511] Processing CreateTablet for tablet 313faa5edb7a49aabbca4f28b29d5155 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:34.047223  3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313faa5edb7a49aabbca4f28b29d5155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.015514  3250 tablet_service.cc:1511] Processing CreateTablet for tablet 4f326f07112440e4bb7d30dae0a46bd4 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:34.052836  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f326f07112440e4bb7d30dae0a46bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.053411  3405 tablet_service.cc:1511] Processing CreateTablet for tablet 37c0daf5154f4bb299b8302704829e6c (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:34.055009  3405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c0daf5154f4bb299b8302704829e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.054829  3403 tablet_service.cc:1511] Processing CreateTablet for tablet 1511623245434b6a8652d7409d0b36b6 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:34.056210  3403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1511623245434b6a8652d7409d0b36b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.058665  3402 tablet_service.cc:1511] Processing CreateTablet for tablet fbbcf82a63da4313b6ff24cd81c1ecd2 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:34.060118  3402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbcf82a63da4313b6ff24cd81c1ecd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.058764  3404 tablet_service.cc:1511] Processing CreateTablet for tablet 643c45d63e6f414b85118745f851c6f4 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:34.062433  3406 tablet_service.cc:1511] Processing CreateTablet for tablet dfcad048e01a4c24b6092842d09c8c2f (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:34.063213  3404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 643c45d63e6f414b85118745f851c6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.064881  3406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfcad048e01a4c24b6092842d09c8c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.066789  3401 tablet_service.cc:1511] Processing CreateTablet for tablet 19cdf59bd2984a86bc3a86f8bbe8bb59 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:34.068269  3401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19cdf59bd2984a86bc3a86f8bbe8bb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.069800  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f326f07112440e4bb7d30dae0a46bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.072201  3400 tablet_service.cc:1511] Processing CreateTablet for tablet 616b48eafd31410b858fe2084bfa8924 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:34.074928  3399 tablet_service.cc:1511] Processing CreateTablet for tablet 4f326f07112440e4bb7d30dae0a46bd4 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:34.077328  3398 tablet_service.cc:1511] Processing CreateTablet for tablet 313faa5edb7a49aabbca4f28b29d5155 (DEFAULT_TABLE table=test-workload [id=92763e0627004504a15ac4cb15f0b17d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:34.081918  3400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616b48eafd31410b858fe2084bfa8924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.086059  3398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313faa5edb7a49aabbca4f28b29d5155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.089944  3399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f326f07112440e4bb7d30dae0a46bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.098491  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 643c45d63e6f414b85118745f851c6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.099835  3456 tablet_bootstrap.cc:492] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:34.114630  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c0daf5154f4bb299b8302704829e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.149852  3456 tablet_bootstrap.cc:654] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.177376  3457 tablet_bootstrap.cc:492] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:34.185498  3458 tablet_bootstrap.cc:492] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:34.193825  3458 tablet_bootstrap.cc:654] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.201393  3457 tablet_bootstrap.cc:654] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.210531  3456 tablet_bootstrap.cc:492] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:34.211037  3456 ts_tablet_manager.cc:1403] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.112s	user 0.018s	sys 0.000s
I20260709 13:13:34.214187  3456 raft_consensus.cc:359] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.214931  3456 raft_consensus.cc:385] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.215229  3456 raft_consensus.cc:740] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.216117  3456 consensus_queue.cc:260] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.220072  3457 tablet_bootstrap.cc:492] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:34.220679  3457 ts_tablet_manager.cc:1403] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.000s
I20260709 13:13:34.221632  3367 heartbeater.cc:499] Master 127.24.204.254:45225 was elected leader, sending a full tablet report...
I20260709 13:13:34.222082  3456 ts_tablet_manager.cc:1434] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:13:34.223052  3458 tablet_bootstrap.cc:492] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:34.223129  3456 tablet_bootstrap.cc:492] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:34.223839  3458 ts_tablet_manager.cc:1403] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.020s
I20260709 13:13:34.223827  3457 raft_consensus.cc:359] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.224804  3457 raft_consensus.cc:385] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.227372  3458 raft_consensus.cc:359] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.228196  3458 raft_consensus.cc:385] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.228504  3458 raft_consensus.cc:740] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.228713  3456 tablet_bootstrap.cc:654] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.229295  3458 consensus_queue.cc:260] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.232188  3441 heartbeater.cc:499] Master 127.24.204.254:45225 was elected leader, sending a full tablet report...
I20260709 13:13:34.232544  3458 ts_tablet_manager.cc:1434] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:34.233755  3458 tablet_bootstrap.cc:492] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:34.225147  3457 raft_consensus.cc:740] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.238379  3457 consensus_queue.cc:260] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.240478  3458 tablet_bootstrap.cc:654] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.257956  3457 ts_tablet_manager.cc:1434] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.006s
I20260709 13:13:34.259202  3292 heartbeater.cc:499] Master 127.24.204.254:45225 was elected leader, sending a full tablet report...
I20260709 13:13:34.274204  3456 tablet_bootstrap.cc:492] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:34.274570  3457 tablet_bootstrap.cc:492] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:34.274823  3456 ts_tablet_manager.cc:1403] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.028s
I20260709 13:13:34.278143  3456 raft_consensus.cc:359] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.278898  3456 raft_consensus.cc:385] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.279328  3456 raft_consensus.cc:740] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.280290  3456 consensus_queue.cc:260] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.284258  3457 tablet_bootstrap.cc:654] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.284307  3458 tablet_bootstrap.cc:492] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:34.285053  3458 ts_tablet_manager.cc:1403] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.052s	user 0.031s	sys 0.019s
I20260709 13:13:34.286643  3456 ts_tablet_manager.cc:1434] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:34.287802  3456 tablet_bootstrap.cc:492] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:34.288625  3458 raft_consensus.cc:359] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.289712  3458 raft_consensus.cc:385] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.290091  3458 raft_consensus.cc:740] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.291570  3458 consensus_queue.cc:260] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.295256  3456 tablet_bootstrap.cc:654] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.296772  3457 tablet_bootstrap.cc:492] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:34.297394  3457 ts_tablet_manager.cc:1403] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 13:13:34.299976  3458 ts_tablet_manager.cc:1434] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:13:34.301453  3458 tablet_bootstrap.cc:492] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:34.304307  3457 raft_consensus.cc:359] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.305080  3457 raft_consensus.cc:385] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.305380  3457 raft_consensus.cc:740] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.306344  3457 consensus_queue.cc:260] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.308888  3457 ts_tablet_manager.cc:1434] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:34.310014  3457 tablet_bootstrap.cc:492] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:34.310645  3458 tablet_bootstrap.cc:654] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.316800  3456 tablet_bootstrap.cc:492] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:34.317480  3456 ts_tablet_manager.cc:1403] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.014s
I20260709 13:13:34.317674  3457 tablet_bootstrap.cc:654] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.321537  3456 raft_consensus.cc:359] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.322342  3456 raft_consensus.cc:385] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.322649  3456 raft_consensus.cc:740] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.323405  3458 tablet_bootstrap.cc:492] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:34.323518  3456 consensus_queue.cc:260] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.324088  3458 ts_tablet_manager.cc:1403] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 13:13:34.324855  3457 tablet_bootstrap.cc:492] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:34.325443  3457 ts_tablet_manager.cc:1403] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 13:13:34.325942  3456 ts_tablet_manager.cc:1434] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:34.327117  3456 tablet_bootstrap.cc:492] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:34.327492  3458 raft_consensus.cc:359] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.328265  3458 raft_consensus.cc:385] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.328202  3457 raft_consensus.cc:359] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.328747  3458 raft_consensus.cc:740] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.329152  3457 raft_consensus.cc:385] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.329484  3457 raft_consensus.cc:740] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.330001  3458 consensus_queue.cc:260] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.330459  3457 consensus_queue.cc:260] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.332731  3457 ts_tablet_manager.cc:1434] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:34.334343  3456 tablet_bootstrap.cc:654] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.335176  3458 ts_tablet_manager.cc:1434] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:13:34.335835  3457 tablet_bootstrap.cc:492] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:34.336468  3458 tablet_bootstrap.cc:492] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:34.342995  3457 tablet_bootstrap.cc:654] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.343217  3458 tablet_bootstrap.cc:654] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.349229  3456 tablet_bootstrap.cc:492] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:34.353287  3456 ts_tablet_manager.cc:1403] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.001s
I20260709 13:13:34.356606  3456 raft_consensus.cc:359] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.357185  3458 tablet_bootstrap.cc:492] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:34.357506  3457 tablet_bootstrap.cc:492] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:34.357340  3456 raft_consensus.cc:385] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.358152  3458 ts_tablet_manager.cc:1403] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.009s
I20260709 13:13:34.358287  3457 ts_tablet_manager.cc:1403] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 13:13:34.358183  3456 raft_consensus.cc:740] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.359694  3456 consensus_queue.cc:260] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.361585  3457 raft_consensus.cc:359] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.361801  3458 raft_consensus.cc:359] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.362419  3457 raft_consensus.cc:385] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.362520  3458 raft_consensus.cc:385] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.362779  3457 raft_consensus.cc:740] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.362918  3458 raft_consensus.cc:740] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.363672  3458 consensus_queue.cc:260] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.363763  3457 consensus_queue.cc:260] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.365013  3456 ts_tablet_manager.cc:1434] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:34.366238  3456 tablet_bootstrap.cc:492] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:34.366344  3458 ts_tablet_manager.cc:1434] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:34.367455  3458 tablet_bootstrap.cc:492] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:34.373804  3458 tablet_bootstrap.cc:654] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.374117  3456 tablet_bootstrap.cc:654] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.375142  3457 ts_tablet_manager.cc:1434] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:13:34.379549  3457 tablet_bootstrap.cc:492] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:34.388665  3457 tablet_bootstrap.cc:654] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.393271  3456 tablet_bootstrap.cc:492] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:34.393718  3458 tablet_bootstrap.cc:492] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:34.393862  3456 ts_tablet_manager.cc:1403] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.007s
I20260709 13:13:34.394595  3458 ts_tablet_manager.cc:1403] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.015s
I20260709 13:13:34.397475  3456 raft_consensus.cc:359] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.398404  3456 raft_consensus.cc:385] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.398727  3456 raft_consensus.cc:740] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.398636  3458 raft_consensus.cc:359] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.399612  3458 raft_consensus.cc:385] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.399935  3458 raft_consensus.cc:740] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.399961  3456 consensus_queue.cc:260] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.400938  3458 consensus_queue.cc:260] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.401473  3457 tablet_bootstrap.cc:492] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:34.402051  3457 ts_tablet_manager.cc:1403] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:13:34.402971  3456 ts_tablet_manager.cc:1434] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:13:34.404234  3456 tablet_bootstrap.cc:492] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:34.404978  3463 raft_consensus.cc:493] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.405545  3463 raft_consensus.cc:515] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.406167  3458 ts_tablet_manager.cc:1434] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:13:34.405609  3457 raft_consensus.cc:359] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.406603  3457 raft_consensus.cc:385] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.406912  3457 raft_consensus.cc:740] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.407305  3458 tablet_bootstrap.cc:492] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:34.407778  3457 consensus_queue.cc:260] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.410926  3463 leader_election.cc:290] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.413542  3457 ts_tablet_manager.cc:1434] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:34.414331  3458 tablet_bootstrap.cc:654] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.414768  3457 tablet_bootstrap.cc:492] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:34.423801  3457 tablet_bootstrap.cc:654] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.431689  3463 raft_consensus.cc:493] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.432354  3463 raft_consensus.cc:515] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.433287  3480 raft_consensus.cc:493] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.434993  3463 leader_election.cc:290] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.435279  3480 raft_consensus.cc:515] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.437353  3480 leader_election.cc:290] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.437425  3458 tablet_bootstrap.cc:492] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:34.438042  3458 ts_tablet_manager.cc:1403] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.031s	user 0.026s	sys 0.001s
I20260709 13:13:34.442090  3456 tablet_bootstrap.cc:654] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:34.444931  3213 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:34.445592  3458 raft_consensus.cc:359] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.446386  3458 raft_consensus.cc:385] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.446674  3458 raft_consensus.cc:740] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.447439  3458 consensus_queue.cc:260] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.449579  3458 ts_tablet_manager.cc:1434] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 13:13:34.450533  3458 tablet_bootstrap.cc:492] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:34.453940  3462 raft_consensus.cc:493] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.454084  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cdf59bd2984a86bc3a86f8bbe8bb59" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:34.454859  3267 raft_consensus.cc:2468] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:34.454604  3462 raft_consensus.cc:515] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.456293  3457 tablet_bootstrap.cc:492] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:34.456152  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616b48eafd31410b858fe2084bfa8924" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:34.456893  3457 ts_tablet_manager.cc:1403] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.014s
I20260709 13:13:34.457012  3266 raft_consensus.cc:2468] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:34.459975  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:34.460660  3267 raft_consensus.cc:2468] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:34.461056  3457 raft_consensus.cc:359] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.461897  3457 raft_consensus.cc:385] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.465947  3457 raft_consensus.cc:740] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.458962  3379 leader_election.cc:304] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:34.467032  3463 raft_consensus.cc:2804] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.466907  3457 consensus_queue.cc:260] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.467567  3456 tablet_bootstrap.cc:492] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:34.467422  3463 raft_consensus.cc:493] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.468223  3463 raft_consensus.cc:3060] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.468376  3456 ts_tablet_manager.cc:1403] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.003s
I20260709 13:13:34.471985  3456 raft_consensus.cc:359] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.472786  3456 raft_consensus.cc:385] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.462219  3462 leader_election.cc:290] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.473131  3456 raft_consensus.cc:740] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.467337  3379 leader_election.cc:304] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:34.474169  3456 consensus_queue.cc:260] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.479216  3456 ts_tablet_manager.cc:1434] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:13:34.483886  3480 raft_consensus.cc:2804] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.487797  3457 ts_tablet_manager.cc:1434] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.005s
I20260709 13:13:34.497830  3379 leader_election.cc:304] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:34.486441  3480 raft_consensus.cc:493] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.499181  3456 tablet_bootstrap.cc:492] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:34.499873  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cdf59bd2984a86bc3a86f8bbe8bb59" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:34.501996  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616b48eafd31410b858fe2084bfa8924" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:34.502197  3463 raft_consensus.cc:515] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.502609  3342 raft_consensus.cc:2468] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:34.498929  3480 raft_consensus.cc:3060] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.504446  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:34.505333  3342 raft_consensus.cc:2468] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:34.505533  3456 tablet_bootstrap.cc:654] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.506417  3457 tablet_bootstrap.cc:492] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:34.507597  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cdf59bd2984a86bc3a86f8bbe8bb59" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.508213  3267 raft_consensus.cc:3060] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.510161  3458 tablet_bootstrap.cc:654] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:34.514559  3379 leader_election.cc:343] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.517234  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cdf59bd2984a86bc3a86f8bbe8bb59" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:34.518180  3480 raft_consensus.cc:515] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.518424  3267 raft_consensus.cc:2468] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
W20260709 13:13:34.518855  3379 leader_election.cc:343] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.514343  3485 raft_consensus.cc:2804] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.504433  3463 leader_election.cc:290] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.520040  3485 raft_consensus.cc:493] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.521842  3485 raft_consensus.cc:3060] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.521798  3379 leader_election.cc:304] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:34.526445  3458 tablet_bootstrap.cc:492] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:34.527056  3458 ts_tablet_manager.cc:1403] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.003s
I20260709 13:13:34.527473  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616b48eafd31410b858fe2084bfa8924" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.528211  3267 raft_consensus.cc:3060] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.529608  3456 tablet_bootstrap.cc:492] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:34.534202  3456 ts_tablet_manager.cc:1403] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.004s
I20260709 13:13:34.535815  3267 raft_consensus.cc:2468] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:34.536432  3458 raft_consensus.cc:359] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.537117  3379 leader_election.cc:304] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:34.537403  3458 raft_consensus.cc:385] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.537864  3458 raft_consensus.cc:740] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.542670  3457 tablet_bootstrap.cc:654] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.543241  3480 leader_election.cc:290] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.538328  3463 raft_consensus.cc:2804] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.542088  3458 consensus_queue.cc:260] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.545964  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:34.543890  3480 raft_consensus.cc:493] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.556562  3480 raft_consensus.cc:515] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.560956  3458 ts_tablet_manager.cc:1434] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:13:34.562685  3480 leader_election.cc:290] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.564879  3480 raft_consensus.cc:2804] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.562723  3458 tablet_bootstrap.cc:492] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:34.566565  3485 raft_consensus.cc:515] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.568513  3416 raft_consensus.cc:2393] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d5d81a6b8734b759a4450ecb507163a in current term 1: Already voted for candidate 2b9ef9fe180849ed8d71508135af43fa in this term.
I20260709 13:13:34.574752  3485 leader_election.cc:290] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.580184  3480 raft_consensus.cc:697] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:34.581405  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:34.581712  3480 consensus_queue.cc:237] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.582566  3267 raft_consensus.cc:2468] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:34.584875  3305 leader_election.cc:304] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 2b9ef9fe180849ed8d71508135af43fa
I20260709 13:13:34.587599  3462 raft_consensus.cc:2804] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.588119  3462 raft_consensus.cc:493] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.588371  3457 tablet_bootstrap.cc:492] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:34.588645  3462 raft_consensus.cc:3060] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.589763  3457 ts_tablet_manager.cc:1403] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.100s	user 0.022s	sys 0.002s
I20260709 13:13:34.595196  3463 raft_consensus.cc:697] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
W20260709 13:13:34.595237  3379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.204.193:46033, user_credentials={real_user=slave}} blocked reactor thread for 58216us
I20260709 13:13:34.597787  3463 consensus_queue.cc:237] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.600301  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616b48eafd31410b858fe2084bfa8924" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:34.601053  3342 raft_consensus.cc:3060] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.602342  3458 tablet_bootstrap.cc:654] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.603518  3456 raft_consensus.cc:359] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.604367  3456 raft_consensus.cc:385] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.606257  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c45d63e6f414b85118745f851c6f4" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:34.606022  3457 raft_consensus.cc:359] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.606982  3457 raft_consensus.cc:385] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.607025  3267 raft_consensus.cc:2468] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:34.607515  3457 raft_consensus.cc:740] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.608042  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.608525  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c45d63e6f414b85118745f851c6f4" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:34.608717  3266 raft_consensus.cc:3060] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.608531  3457 consensus_queue.cc:260] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.609598  3341 raft_consensus.cc:2468] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:34.611148  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:34.604696  3456 raft_consensus.cc:740] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.612803  3456 consensus_queue.cc:260] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.611369  3379 leader_election.cc:304] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:34.616488  3457 ts_tablet_manager.cc:1434] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:13:34.618991  3480 raft_consensus.cc:2804] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.619544  3480 raft_consensus.cc:493] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.620085  3480 raft_consensus.cc:3060] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.629834  3480 raft_consensus.cc:515] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.630918  3342 raft_consensus.cc:2468] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:34.619294  3266 raft_consensus.cc:2468] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:34.633946  3457 tablet_bootstrap.cc:492] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:34.633245  3462 raft_consensus.cc:515] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.634473  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c45d63e6f414b85118745f851c6f4" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.635244  3266 raft_consensus.cc:3060] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.635851  3341 raft_consensus.cc:2393] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b9ef9fe180849ed8d71508135af43fa in current term 1: Already voted for candidate 4d5d81a6b8734b759a4450ecb507163a in this term.
I20260709 13:13:34.640976  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.642230  3267 raft_consensus.cc:2393] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d5d81a6b8734b759a4450ecb507163a in current term 1: Already voted for candidate 2b9ef9fe180849ed8d71508135af43fa in this term.
I20260709 13:13:34.643133  3379 leader_election.cc:304] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:34.644686  3489 raft_consensus.cc:2804] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.645412  3489 raft_consensus.cc:697] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:34.646713  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:34.641070  3457 tablet_bootstrap.cc:654] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.648965  3308 leader_election.cc:304] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a; no voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760
I20260709 13:13:34.650238  3266 raft_consensus.cc:2468] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:34.646719  3489 consensus_queue.cc:237] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:34.651762  3379 leader_election.cc:304] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:34.653350  3488 raft_consensus.cc:2804] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.654050  3488 raft_consensus.cc:697] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:34.654835  3496 raft_consensus.cc:2749] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.655260  3488 consensus_queue.cc:237] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.660162  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c45d63e6f414b85118745f851c6f4" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:34.661067  3342 raft_consensus.cc:3060] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.657284  3462 leader_election.cc:290] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.669945  3456 ts_tablet_manager.cc:1434] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.134s	user 0.016s	sys 0.025s
I20260709 13:13:34.658207  3480 leader_election.cc:290] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.671607  3456 tablet_bootstrap.cc:492] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:34.673810  3495 raft_consensus.cc:493] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.674628  3495 raft_consensus.cc:515] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.675742  3342 raft_consensus.cc:2468] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:34.679087  3163 catalog_manager.cc:5697] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 1 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.681815  3495 leader_election.cc:290] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.681404  3163 catalog_manager.cc:5697] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 1 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.683043  3457 tablet_bootstrap.cc:492] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:34.683544  3457 ts_tablet_manager.cc:1403] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.005s
I20260709 13:13:34.683878  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:34.684440  3456 tablet_bootstrap.cc:654] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.684695  3416 raft_consensus.cc:2468] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:34.686525  3457 raft_consensus.cc:359] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.687247  3457 raft_consensus.cc:385] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.687523  3457 raft_consensus.cc:740] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.688053  3458 tablet_bootstrap.cc:492] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:34.688316  3457 consensus_queue.cc:260] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.688640  3458 ts_tablet_manager.cc:1403] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.012s
I20260709 13:13:34.688722  3308 leader_election.cc:304] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:34.689986  3495 raft_consensus.cc:2804] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.690351  3495 raft_consensus.cc:493] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.690688  3495 raft_consensus.cc:3060] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.692958  3458 raft_consensus.cc:359] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.693807  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:34.694139  3458 raft_consensus.cc:385] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.694631  3458 raft_consensus.cc:740] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.694729  3266 raft_consensus.cc:2468] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:34.695748  3458 consensus_queue.cc:260] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.704326  3457 ts_tablet_manager.cc:1434] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:13:34.704144  3495 raft_consensus.cc:515] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.704984  3458 ts_tablet_manager.cc:1434] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:13:34.705873  3496 raft_consensus.cc:493] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.706369  3496 raft_consensus.cc:515] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.706377  3458 tablet_bootstrap.cc:492] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:34.710565  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:34.711223  3266 raft_consensus.cc:2468] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:34.712522  3488 raft_consensus.cc:493] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.712543  3305 leader_election.cc:304] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:34.713204  3488 raft_consensus.cc:515] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.713754  3462 raft_consensus.cc:2804] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.714143  3462 raft_consensus.cc:493] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.714474  3462 raft_consensus.cc:3060] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.716393  3458 tablet_bootstrap.cc:654] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.716569  3457 tablet_bootstrap.cc:492] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:34.737092  3465 raft_consensus.cc:493] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.737906  3465 raft_consensus.cc:515] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.739962  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:34.741860  3266 raft_consensus.cc:2468] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:34.740579  3496 leader_election.cc:290] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.750073  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:34.751129  3415 raft_consensus.cc:3060] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.753551  3465 leader_election.cc:290] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.754220  3465 raft_consensus.cc:493] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.754720  3465 raft_consensus.cc:515] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.744910  3462 raft_consensus.cc:515] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.769946  3379 leader_election.cc:304] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:34.771396  3463 raft_consensus.cc:2804] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.771975  3463 raft_consensus.cc:493] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.772431  3463 raft_consensus.cc:3060] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.760725  3495 leader_election.cc:290] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.782485  3465 leader_election.cc:290] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.768446  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:34.777931  3488 leader_election.cc:290] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.783841  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.788513  3266 raft_consensus.cc:3060] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.788760  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:34.789654  3342 raft_consensus.cc:2393] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b9ef9fe180849ed8d71508135af43fa in current term 1: Already voted for candidate 4d5d81a6b8734b759a4450ecb507163a in this term.
I20260709 13:13:34.792737  3463 raft_consensus.cc:515] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.794520  3416 raft_consensus.cc:2393] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d5d81a6b8734b759a4450ecb507163a in current term 1: Already voted for candidate 2b9ef9fe180849ed8d71508135af43fa in this term.
I20260709 13:13:34.795987  3463 leader_election.cc:290] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.797606  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:34.798741  3267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.798868  3342 raft_consensus.cc:2393] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b9ef9fe180849ed8d71508135af43fa in current term 1: Already voted for candidate 4d5d81a6b8734b759a4450ecb507163a in this term.
I20260709 13:13:34.799470  3267 raft_consensus.cc:3060] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.801353  3463 raft_consensus.cc:493] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.802420  3266 raft_consensus.cc:2468] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 1.
I20260709 13:13:34.802109  3463 raft_consensus.cc:515] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.803681  3305 leader_election.cc:304] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:34.804738  3495 raft_consensus.cc:2804] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.805259  3495 raft_consensus.cc:697] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:34.806028  3463 leader_election.cc:290] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.806327  3495 consensus_queue.cc:237] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.812067  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511623245434b6a8652d7409d0b36b6" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:34.812613  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511623245434b6a8652d7409d0b36b6" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:34.813004  3266 raft_consensus.cc:2468] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:34.816215  3379 leader_election.cc:304] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:34.817209  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
W20260709 13:13:34.817639  3379 leader_election.cc:343] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.818020  3267 raft_consensus.cc:2468] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:34.818246  3416 raft_consensus.cc:2393] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d5d81a6b8734b759a4450ecb507163a in current term 1: Already voted for candidate 2b9ef9fe180849ed8d71508135af43fa in this term.
I20260709 13:13:34.819342  3379 leader_election.cc:304] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:34.821166  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.821733  3462 leader_election.cc:290] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.823243  3265 raft_consensus.cc:2393] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d5d81a6b8734b759a4450ecb507163a in current term 1: Already voted for candidate 2b9ef9fe180849ed8d71508135af43fa in this term.
I20260709 13:13:34.824187  3488 raft_consensus.cc:2804] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.827301  3488 raft_consensus.cc:493] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.828210  3488 raft_consensus.cc:3060] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.829666  3456 tablet_bootstrap.cc:492] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:34.830190  3456 ts_tablet_manager.cc:1403] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.159s	user 0.040s	sys 0.065s
I20260709 13:13:34.831890  3458 tablet_bootstrap.cc:492] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:34.832454  3458 ts_tablet_manager.cc:1403] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.126s	user 0.022s	sys 0.029s
I20260709 13:13:34.833882  3305 leader_election.cc:304] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a; no voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760
I20260709 13:13:34.834167  3416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313faa5edb7a49aabbca4f28b29d5155" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:34.834630  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511623245434b6a8652d7409d0b36b6" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:34.833123  3456 raft_consensus.cc:359] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.835479  3456 raft_consensus.cc:385] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.835352  3458 raft_consensus.cc:359] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.835760  3495 raft_consensus.cc:2749] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:13:34.835908  3233 leader_election.cc:343] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.836501  3415 raft_consensus.cc:2468] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 1.
I20260709 13:13:34.835927  3456 raft_consensus.cc:740] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.838042  3456 consensus_queue.cc:260] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.840078  3456 ts_tablet_manager.cc:1434] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:34.840381  3457 tablet_bootstrap.cc:654] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.841058  3456 tablet_bootstrap.cc:492] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:34.842061  3488 raft_consensus.cc:515] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.843283  3414 raft_consensus.cc:2393] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d893b01f407546b7a63ec8903aa53760 in current term 1: Already voted for candidate 2b9ef9fe180849ed8d71508135af43fa in this term.
I20260709 13:13:34.824262  3463 raft_consensus.cc:2804] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.843868  3463 raft_consensus.cc:697] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:34.844915  3463 consensus_queue.cc:237] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.836104  3458 raft_consensus.cc:385] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.846446  3458 raft_consensus.cc:740] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.847337  3458 consensus_queue.cc:260] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.850018  3458 ts_tablet_manager.cc:1434] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:13:34.852308  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313faa5edb7a49aabbca4f28b29d5155" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:34.852802  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511623245434b6a8652d7409d0b36b6" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.853242  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511623245434b6a8652d7409d0b36b6" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:34.853390  3488 leader_election.cc:290] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.853458  3265 raft_consensus.cc:3060] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.854115  3341 raft_consensus.cc:2468] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 0.
I20260709 13:13:34.855721  3230 leader_election.cc:304] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 2b9ef9fe180849ed8d71508135af43fa
I20260709 13:13:34.858213  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511623245434b6a8652d7409d0b36b6" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:34.858906  3341 raft_consensus.cc:3060] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:34.863487  3230 leader_election.cc:343] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.863988  3230 leader_election.cc:304] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d893b01f407546b7a63ec8903aa53760; no voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:34.865103  3504 raft_consensus.cc:2749] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.870272  3341 raft_consensus.cc:2468] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:34.871604  3379 leader_election.cc:304] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:34.872118  3265 raft_consensus.cc:2468] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:34.872545  3488 raft_consensus.cc:2804] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.872937  3465 raft_consensus.cc:2764] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:13:34.873147  3488 raft_consensus.cc:697] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:34.874125  3488 consensus_queue.cc:237] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.882747  3163 catalog_manager.cc:5697] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 1 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.886843  3456 tablet_bootstrap.cc:654] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.887223  3495 raft_consensus.cc:493] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.887889  3495 raft_consensus.cc:515] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.894665  3457 tablet_bootstrap.cc:492] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:34.895243  3457 ts_tablet_manager.cc:1403] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.179s	user 0.015s	sys 0.019s
I20260709 13:13:34.895311  3495 leader_election.cc:290] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.896196  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f326f07112440e4bb7d30dae0a46bd4" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
W20260709 13:13:34.897810  3305 leader_election.cc:343] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.898073  3457 raft_consensus.cc:359] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.898456  3463 raft_consensus.cc:493] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.898865  3457 raft_consensus.cc:385] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.899190  3457 raft_consensus.cc:740] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.899029  3463 raft_consensus.cc:515] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.900334  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f326f07112440e4bb7d30dae0a46bd4" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:34.900936  3414 raft_consensus.cc:2468] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:34.901398  3463 leader_election.cc:290] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.902200  3308 leader_election.cc:304] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: d893b01f407546b7a63ec8903aa53760
I20260709 13:13:34.903259  3495 raft_consensus.cc:2804] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.903620  3495 raft_consensus.cc:493] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.903925  3495 raft_consensus.cc:3060] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.904141  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313faa5edb7a49aabbca4f28b29d5155" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:34.904490  3456 tablet_bootstrap.cc:492] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:34.904973  3456 ts_tablet_manager.cc:1403] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 13:13:34.905207  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313faa5edb7a49aabbca4f28b29d5155" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
W20260709 13:13:34.905344  3379 leader_election.cc:343] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.905988  3265 raft_consensus.cc:2468] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:34.899376  3161 catalog_manager.cc:5697] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 1 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.907279  3379 leader_election.cc:304] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:34.907605  3456 raft_consensus.cc:359] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.910075  3456 raft_consensus.cc:385] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.907562  3161 catalog_manager.cc:5697] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 1 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.910413  3456 raft_consensus.cc:740] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.911257  3456 consensus_queue.cc:260] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.911351  3161 catalog_manager.cc:5697] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 1 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.913340  3456 ts_tablet_manager.cc:1434] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:13:34.907938  3463 raft_consensus.cc:2804] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.913990  3463 raft_consensus.cc:493] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.913986  3495 raft_consensus.cc:515] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.914615  3463 raft_consensus.cc:3060] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.900115  3457 consensus_queue.cc:260] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.916402  3495 leader_election.cc:290] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.916775  3457 ts_tablet_manager.cc:1434] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:13:34.920555  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f326f07112440e4bb7d30dae0a46bd4" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.920781  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f326f07112440e4bb7d30dae0a46bd4" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:34.921257  3265 raft_consensus.cc:3060] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.921373  3414 raft_consensus.cc:3060] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.922694  3463 raft_consensus.cc:515] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.925621  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313faa5edb7a49aabbca4f28b29d5155" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:34.926232  3266 raft_consensus.cc:3060] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.926568  3463 leader_election.cc:290] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:34.926774  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313faa5edb7a49aabbca4f28b29d5155" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:34.927449  3341 raft_consensus.cc:3060] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.929788  3265 raft_consensus.cc:2468] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 1.
I20260709 13:13:34.931126  3305 leader_election.cc:304] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:34.931962  3495 raft_consensus.cc:2804] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.932452  3495 raft_consensus.cc:697] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:34.933264  3495 consensus_queue.cc:237] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.935585  3341 raft_consensus.cc:2468] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:34.937311  3379 leader_election.cc:304] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:34.938211  3463 raft_consensus.cc:2804] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.938915  3463 raft_consensus.cc:697] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:34.939779  3463 consensus_queue.cc:237] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.942672  3165 catalog_manager.cc:5697] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 1 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.945314  3266 raft_consensus.cc:2468] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:34.948418  3414 raft_consensus.cc:2468] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 1.
I20260709 13:13:34.961808  3165 catalog_manager.cc:5697] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 1 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.970829  3163 catalog_manager.cc:5697] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 1 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.979982  3463 consensus_queue.cc:1048] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.980679  3495 raft_consensus.cc:493] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.981168  3495 raft_consensus.cc:515] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:34.983537  3495 leader_election.cc:290] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:34.983804  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cdf59bd2984a86bc3a86f8bbe8bb59" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:34.984690  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cdf59bd2984a86bc3a86f8bbe8bb59" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:34.986253  3308 leader_election.cc:304] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a; no voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760
I20260709 13:13:34.987479  3495 raft_consensus.cc:2749] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.990572  3341 raft_consensus.cc:3060] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.992661  3463 consensus_queue.cc:1048] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.004717  3463 consensus_queue.cc:1048] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.013942  3480 consensus_queue.cc:1048] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.084457  3480 consensus_queue.cc:1048] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.097923  3485 consensus_queue.cc:1048] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.100226  3414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f"
dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
mode: GRACEFUL
new_leader_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:33450
I20260709 13:13:35.100778  3414 raft_consensus.cc:606] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Received request to transfer leadership to TS d893b01f407546b7a63ec8903aa53760
I20260709 13:13:35.112007  3485 consensus_queue.cc:1048] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.115036  3463 raft_consensus.cc:993] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa: : Instructing follower d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:35.115507  3485 raft_consensus.cc:1081] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Signalling peer d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:35.117254  3265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f"
dest_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:13:35.119820  3342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
mode: GRACEFUL
new_leader_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:43562
I20260709 13:13:35.120640  3342 raft_consensus.cc:606] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Received request to transfer leadership to TS d893b01f407546b7a63ec8903aa53760
I20260709 13:13:35.121169  3265 raft_consensus.cc:493] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.121703  3265 raft_consensus.cc:3060] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.129104  3485 consensus_queue.cc:1048] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:35.138265  3414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "643c45d63e6f414b85118745f851c6f4"
dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
mode: GRACEFUL
new_leader_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:33450
I20260709 13:13:35.139078  3414 raft_consensus.cc:606] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Received request to transfer leadership to TS d893b01f407546b7a63ec8903aa53760
I20260709 13:13:35.141191  3265 raft_consensus.cc:515] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:35.146097  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:35.146174  3265 leader_election.cc:290] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Requested vote from peers 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:35.147362  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcad048e01a4c24b6092842d09c8c2f" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:35.148088  3341 raft_consensus.cc:3060] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.146839  3414 raft_consensus.cc:3055] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.153893  3414 raft_consensus.cc:740] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:35.155012  3414 consensus_queue.cc:260] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:35.156131  3414 raft_consensus.cc:3060] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.162387  3415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1511623245434b6a8652d7409d0b36b6"
dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
mode: GRACEFUL
new_leader_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:33450
I20260709 13:13:35.162818  3341 raft_consensus.cc:2468] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:35.163249  3415 raft_consensus.cc:606] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Received request to transfer leadership to TS d893b01f407546b7a63ec8903aa53760
I20260709 13:13:35.164441  3230 leader_election.cc:304] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:35.165441  3465 raft_consensus.cc:2804] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.166002  3465 raft_consensus.cc:697] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:35.166816  3414 raft_consensus.cc:2468] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:35.166893  3465 consensus_queue.cc:237] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } }
I20260709 13:13:35.170296  3414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2"
dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
mode: GRACEFUL
new_leader_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:33450
I20260709 13:13:35.170972  3414 raft_consensus.cc:606] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Received request to transfer leadership to TS 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:35.175388  3161 catalog_manager.cc:5697] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 1 to 2, leader changed from 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195) to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.176962  3414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19cdf59bd2984a86bc3a86f8bbe8bb59"
dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
mode: GRACEFUL
new_leader_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:33450
I20260709 13:13:35.177680  3414 raft_consensus.cc:606] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Received request to transfer leadership to TS 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:35.185838  3414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "616b48eafd31410b858fe2084bfa8924"
dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
mode: GRACEFUL
new_leader_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:33450
I20260709 13:13:35.186468  3414 raft_consensus.cc:606] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Received request to transfer leadership to TS 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:35.256278  3480 consensus_queue.cc:1048] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.263710  3485 raft_consensus.cc:993] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa: : Instructing follower d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:35.264222  3488 raft_consensus.cc:1081] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Signalling peer d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:35.267719  3266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1511623245434b6a8652d7409d0b36b6"
dest_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:13:35.268437  3266 raft_consensus.cc:493] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.268869  3266 raft_consensus.cc:3060] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.270016  3488 consensus_queue.cc:1048] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.275754  3266 raft_consensus.cc:515] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.276957  3265 raft_consensus.cc:1240] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Rejecting Update request from peer 2b9ef9fe180849ed8d71508135af43fa for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:35.278820  3266 leader_election.cc:290] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:35.280661  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511623245434b6a8652d7409d0b36b6" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:35.281473  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511623245434b6a8652d7409d0b36b6" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:35.282238  3414 raft_consensus.cc:3055] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.282593  3414 raft_consensus.cc:740] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:35.283869  3414 consensus_queue.cc:260] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.284799  3488 consensus_queue.cc:1059] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.286067  3414 raft_consensus.cc:3060] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.292546  3414 raft_consensus.cc:2468] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:35.294008  3233 leader_election.cc:304] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:35.294800  3465 raft_consensus.cc:2804] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.295320  3465 raft_consensus.cc:697] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:35.296291  3465 consensus_queue.cc:237] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.303369  3161 catalog_manager.cc:5697] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 1 to 2, leader changed from 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195) to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.329052  3495 consensus_queue.cc:1048] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.341715  3495 consensus_queue.cc:1048] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.351127  3495 raft_consensus.cc:993] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a: : Instructing follower d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:35.351649  3531 raft_consensus.cc:1081] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Signalling peer d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:35.353509  3265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c"
dest_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:53430
I20260709 13:13:35.354159  3265 raft_consensus.cc:493] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.354524  3265 raft_consensus.cc:3060] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.360636  3265 raft_consensus.cc:515] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.362921  3265 leader_election.cc:290] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:35.364089  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:35.364825  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:35.364859  3414 raft_consensus.cc:3060] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.365514  3342 raft_consensus.cc:3055] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.365875  3342 raft_consensus.cc:740] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:35.366632  3342 consensus_queue.cc:260] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.367630  3342 raft_consensus.cc:3060] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.371476  3414 raft_consensus.cc:2468] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:35.372648  3233 leader_election.cc:304] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:35.373684  3465 raft_consensus.cc:2804] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.373533  3342 raft_consensus.cc:2468] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:35.374282  3465 raft_consensus.cc:697] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:35.375137  3465 consensus_queue.cc:237] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.381227  3165 catalog_manager.cc:5697] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 1 to 2, leader changed from 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194) to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.387501  3488 consensus_queue.cc:1048] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.390374  3488 consensus_queue.cc:1048] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.396034  3480 raft_consensus.cc:993] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa: : Instructing follower 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:35.396546  3485 raft_consensus.cc:1081] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Signalling peer 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:35.401351  3341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:43552
I20260709 13:13:35.402683  3341 raft_consensus.cc:493] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.403095  3341 raft_consensus.cc:3060] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.405325  3480 consensus_queue.cc:1048] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.411134  3341 raft_consensus.cc:515] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.413281  3341 leader_election.cc:290] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:35.415242  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:35.415469  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:35.416119  3414 raft_consensus.cc:3055] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.416430  3414 raft_consensus.cc:740] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:35.417244  3414 consensus_queue.cc:260] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.419046  3414 raft_consensus.cc:3060] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.421026  3463 consensus_queue.cc:1048] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.426827  3414 raft_consensus.cc:2468] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:35.428300  3308 leader_election.cc:304] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: d893b01f407546b7a63ec8903aa53760
I20260709 13:13:35.429472  3531 raft_consensus.cc:2804] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.430001  3531 raft_consensus.cc:697] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:35.430810  3531 consensus_queue.cc:237] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.439324  3161 catalog_manager.cc:5697] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 1 to 2, leader changed from 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195) to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 2 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.441987  3495 consensus_queue.cc:1048] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.454366  3531 consensus_queue.cc:1048] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.494846  3463 raft_consensus.cc:993] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa: : Instructing follower 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:35.495316  3485 raft_consensus.cc:1081] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Signalling peer 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:35.496907  3341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19cdf59bd2984a86bc3a86f8bbe8bb59"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:43552
I20260709 13:13:35.497488  3341 raft_consensus.cc:493] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.498178  3341 raft_consensus.cc:3060] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.507064  3341 raft_consensus.cc:515] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.510377  3341 leader_election.cc:290] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:35.510542  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cdf59bd2984a86bc3a86f8bbe8bb59" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:35.511276  3265 raft_consensus.cc:3060] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.511538  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19cdf59bd2984a86bc3a86f8bbe8bb59" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:35.512504  3414 raft_consensus.cc:3055] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.512964  3414 raft_consensus.cc:740] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:35.514173  3414 consensus_queue.cc:260] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.515767  3414 raft_consensus.cc:3060] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.518823  3265 raft_consensus.cc:2468] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:35.520532  3305 leader_election.cc:304] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:35.521533  3531 raft_consensus.cc:2804] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.522094  3531 raft_consensus.cc:697] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:35.523041  3531 consensus_queue.cc:237] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.525668  3414 raft_consensus.cc:2468] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:35.532011  3165 catalog_manager.cc:5697] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 1 to 2, leader changed from 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195) to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 2 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.570701  3463 raft_consensus.cc:993] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa: : Instructing follower d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:35.571182  3463 raft_consensus.cc:1081] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Signalling peer d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:35.572772  3265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "643c45d63e6f414b85118745f851c6f4"
dest_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:13:35.573278  3265 raft_consensus.cc:493] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.573704  3265 raft_consensus.cc:3060] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.577944  3485 raft_consensus.cc:993] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa: : Instructing follower 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:35.578495  3463 raft_consensus.cc:1081] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Signalling peer 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:35.579814  3265 raft_consensus.cc:515] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.580441  3341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "616b48eafd31410b858fe2084bfa8924"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:43552
I20260709 13:13:35.581099  3341 raft_consensus.cc:493] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.581498  3341 raft_consensus.cc:3060] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.581713  3265 leader_election.cc:290] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:35.582605  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c45d63e6f414b85118745f851c6f4" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:35.582770  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643c45d63e6f414b85118745f851c6f4" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:35.583300  3342 raft_consensus.cc:3060] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.583403  3414 raft_consensus.cc:3055] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.583846  3414 raft_consensus.cc:740] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:35.584602  3414 consensus_queue.cc:260] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.585800  3414 raft_consensus.cc:3060] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.589991  3341 raft_consensus.cc:515] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.591558  3414 raft_consensus.cc:2468] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:35.591653  3342 raft_consensus.cc:2468] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:35.593106  3230 leader_election.cc:304] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:35.593506  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616b48eafd31410b858fe2084bfa8924" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:35.593725  3341 leader_election.cc:290] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:35.593926  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616b48eafd31410b858fe2084bfa8924" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:35.594136  3465 raft_consensus.cc:2804] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.594296  3265 raft_consensus.cc:3060] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.595227  3414 raft_consensus.cc:3055] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.595305  3465 raft_consensus.cc:697] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:35.595651  3414 raft_consensus.cc:740] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:35.596323  3465 consensus_queue.cc:237] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.596519  3414 consensus_queue.cc:260] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.597890  3414 raft_consensus.cc:3060] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.603046  3265 raft_consensus.cc:2468] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:35.604239  3305 leader_election.cc:304] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:35.604946  3531 raft_consensus.cc:2804] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.605319  3414 raft_consensus.cc:2468] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:35.605489  3531 raft_consensus.cc:697] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:35.604799  3165 catalog_manager.cc:5697] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 1 to 2, leader changed from 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195) to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.607137  3531 consensus_queue.cc:237] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:35.615870  3161 catalog_manager.cc:5697] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 1 to 2, leader changed from 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195) to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 2 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.638113  3414 raft_consensus.cc:1275] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.639616  3465 consensus_queue.cc:1048] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.639891  3341 raft_consensus.cc:1275] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.641376  3465 consensus_queue.cc:1048] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.792171  3414 raft_consensus.cc:1275] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.793776  3504 consensus_queue.cc:1048] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.805514  3341 raft_consensus.cc:1275] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.806944  3539 consensus_queue.cc:1048] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.820429  3414 raft_consensus.cc:1275] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.821874  3539 consensus_queue.cc:1048] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.831874  3341 raft_consensus.cc:3060] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.839187  3341 raft_consensus.cc:1275] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.840672  3504 consensus_queue.cc:1048] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.944265  3414 raft_consensus.cc:1275] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.945801  3531 consensus_queue.cc:1048] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.953948  3265 raft_consensus.cc:3060] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.962355  3265 raft_consensus.cc:1275] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.963798  3531 consensus_queue.cc:1048] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:36.039165  3265 raft_consensus.cc:1275] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:36.040617  3531 consensus_queue.cc:1048] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:36.050465  3414 raft_consensus.cc:1275] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:36.051950  3462 consensus_queue.cc:1048] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:36.117749  3265 raft_consensus.cc:1275] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:36.119081  3462 consensus_queue.cc:1048] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:36.128664  3414 raft_consensus.cc:1275] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:36.130155  3531 consensus_queue.cc:1048] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:36.211530  3414 raft_consensus.cc:1275] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:36.211603  3341 raft_consensus.cc:1275] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:36.213090  3504 consensus_queue.cc:1048] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:36.213838  3465 consensus_queue.cc:1048] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.268256  3161 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51992:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:38.273427  3161 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:38.339222  3250 tablet_service.cc:1511] Processing CreateTablet for tablet a8023a4ddf414535a7356be4e18f5828 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:38.340610  3324 tablet_service.cc:1511] Processing CreateTablet for tablet a8023a4ddf414535a7356be4e18f5828 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:38.341429  3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8023a4ddf414535a7356be4e18f5828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.342463  3324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8023a4ddf414535a7356be4e18f5828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.342258  3398 tablet_service.cc:1511] Processing CreateTablet for tablet a8023a4ddf414535a7356be4e18f5828 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:38.344058  3398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8023a4ddf414535a7356be4e18f5828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.347177  3331 tablet_service.cc:1511] Processing CreateTablet for tablet 506d161e43234d97b22230cecfaf22c2 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:38.347193  3399 tablet_service.cc:1511] Processing CreateTablet for tablet 506d161e43234d97b22230cecfaf22c2 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:38.348858  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506d161e43234d97b22230cecfaf22c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.348858  3399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506d161e43234d97b22230cecfaf22c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.351472  3403 tablet_service.cc:1511] Processing CreateTablet for tablet 5f93892cb51040f2885d4ae618a2f995 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:38.351727  3256 tablet_service.cc:1511] Processing CreateTablet for tablet 506d161e43234d97b22230cecfaf22c2 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:38.352988  3403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f93892cb51040f2885d4ae618a2f995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.353241  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506d161e43234d97b22230cecfaf22c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.355415  3327 tablet_service.cc:1511] Processing CreateTablet for tablet 5f93892cb51040f2885d4ae618a2f995 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:38.357180  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f93892cb51040f2885d4ae618a2f995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.359701  3404 tablet_service.cc:1511] Processing CreateTablet for tablet e1d75a11886c4d14b92e8917c62447fd (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:38.361217  3404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d75a11886c4d14b92e8917c62447fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.360796  3253 tablet_service.cc:1511] Processing CreateTablet for tablet 5f93892cb51040f2885d4ae618a2f995 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:38.362416  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f93892cb51040f2885d4ae618a2f995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.365818  3249 tablet_service.cc:1511] Processing CreateTablet for tablet e1d75a11886c4d14b92e8917c62447fd (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:38.367367  3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d75a11886c4d14b92e8917c62447fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.367194  3401 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4282a060864a6fa758440a82abf506 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:38.368805  3401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4282a060864a6fa758440a82abf506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.368294  3329 tablet_service.cc:1511] Processing CreateTablet for tablet e1d75a11886c4d14b92e8917c62447fd (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:38.370985  3405 tablet_service.cc:1511] Processing CreateTablet for tablet ccc5dbcd31ec4cd79a8c43bfbd25217e (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:38.372530  3405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc5dbcd31ec4cd79a8c43bfbd25217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.372385  3330 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd638cd50a9482191f44d56695e9630 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:38.374084  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d75a11886c4d14b92e8917c62447fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.375011  3326 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4282a060864a6fa758440a82abf506 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:38.377969  3406 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd638cd50a9482191f44d56695e9630 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:38.378371  3402 tablet_service.cc:1511] Processing CreateTablet for tablet 45ae922587c34526829cbd2f693e4257 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:38.376461  3326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4282a060864a6fa758440a82abf506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.380883  3400 tablet_service.cc:1511] Processing CreateTablet for tablet ee9736b0800747b989cbdef8a02ac25a (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:38.370980  3325 tablet_service.cc:1511] Processing CreateTablet for tablet ccc5dbcd31ec4cd79a8c43bfbd25217e (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:38.382635  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd638cd50a9482191f44d56695e9630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.383467  3325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc5dbcd31ec4cd79a8c43bfbd25217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.385669  3254 tablet_service.cc:1511] Processing CreateTablet for tablet ccc5dbcd31ec4cd79a8c43bfbd25217e (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:38.387241  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccc5dbcd31ec4cd79a8c43bfbd25217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.389932  3406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd638cd50a9482191f44d56695e9630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.391564  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4282a060864a6fa758440a82abf506 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:38.393339  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4282a060864a6fa758440a82abf506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.395989  3402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ae922587c34526829cbd2f693e4257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.400039  3400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9736b0800747b989cbdef8a02ac25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.407464  3251 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd638cd50a9482191f44d56695e9630 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:38.409006  3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd638cd50a9482191f44d56695e9630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.428612  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 45ae922587c34526829cbd2f693e4257 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:38.430462  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ae922587c34526829cbd2f693e4257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.435747  3332 tablet_service.cc:1511] Processing CreateTablet for tablet ee9736b0800747b989cbdef8a02ac25a (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:38.437546  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9736b0800747b989cbdef8a02ac25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.447177  3255 tablet_service.cc:1511] Processing CreateTablet for tablet 45ae922587c34526829cbd2f693e4257 (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:38.448696  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ae922587c34526829cbd2f693e4257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.455366  3252 tablet_service.cc:1511] Processing CreateTablet for tablet ee9736b0800747b989cbdef8a02ac25a (DEFAULT_TABLE table=soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:38.456842  3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9736b0800747b989cbdef8a02ac25a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:38.498369  3213 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:38.562639  3559 tablet_bootstrap.cc:492] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:38.584880  3559 tablet_bootstrap.cc:654] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.610349  3562 tablet_bootstrap.cc:492] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:38.629982  3563 tablet_bootstrap.cc:492] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
W20260709 13:13:38.635164  3230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:45899, user_credentials={real_user=slave}} blocked reactor thread for 56935.9us
I20260709 13:13:38.638608  3562 tablet_bootstrap.cc:654] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.640151  3563 tablet_bootstrap.cc:654] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.643611  3559 tablet_bootstrap.cc:492] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:38.644279  3559 ts_tablet_manager.cc:1403] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.015s
I20260709 13:13:38.644899  3562 tablet_bootstrap.cc:492] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:38.645483  3562 ts_tablet_manager.cc:1403] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.006s
I20260709 13:13:38.646247  3563 tablet_bootstrap.cc:492] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:38.646873  3563 ts_tablet_manager.cc:1403] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:13:38.647450  3559 raft_consensus.cc:359] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.648248  3559 raft_consensus.cc:385] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.648514  3559 raft_consensus.cc:740] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.648694  3562 raft_consensus.cc:359] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.649533  3562 raft_consensus.cc:385] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.649245  3559 consensus_queue.cc:260] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.649899  3562 raft_consensus.cc:740] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.650050  3563 raft_consensus.cc:359] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.650821  3563 raft_consensus.cc:385] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.651297  3563 raft_consensus.cc:740] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.650866  3562 consensus_queue.cc:260] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.652029  3559 ts_tablet_manager.cc:1434] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:38.652141  3563 consensus_queue.cc:260] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.653229  3559 tablet_bootstrap.cc:492] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:38.654165  3562 ts_tablet_manager.cc:1434] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:38.655346  3562 tablet_bootstrap.cc:492] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:38.658109  3563 ts_tablet_manager.cc:1434] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:13:38.660465  3563 tablet_bootstrap.cc:492] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:38.660993  3559 tablet_bootstrap.cc:654] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.663736  3562 tablet_bootstrap.cc:654] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.667686  3563 tablet_bootstrap.cc:654] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.676996  3562 tablet_bootstrap.cc:492] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:38.677820  3562 ts_tablet_manager.cc:1403] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.001s
I20260709 13:13:38.682016  3562 raft_consensus.cc:359] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.683019  3562 raft_consensus.cc:385] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.683419  3562 raft_consensus.cc:740] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.684341  3562 consensus_queue.cc:260] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
W20260709 13:13:38.688576  3442 tablet.cc:2406] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:38.688700  3563 tablet_bootstrap.cc:492] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:38.689103  3562 ts_tablet_manager.cc:1434] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:13:38.689579  3563 ts_tablet_manager.cc:1403] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.012s
I20260709 13:13:38.690163  3562 tablet_bootstrap.cc:492] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:38.692744  3563 raft_consensus.cc:359] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.693492  3563 raft_consensus.cc:385] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.693835  3563 raft_consensus.cc:740] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.694635  3563 consensus_queue.cc:260] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.697360  3562 tablet_bootstrap.cc:654] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.701989  3563 ts_tablet_manager.cc:1434] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:13:38.707090  3563 tablet_bootstrap.cc:492] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:38.716625  3563 tablet_bootstrap.cc:654] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.720209  3562 tablet_bootstrap.cc:492] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:38.720788  3562 ts_tablet_manager.cc:1403] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.012s
I20260709 13:13:38.724819  3562 raft_consensus.cc:359] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.725878  3562 raft_consensus.cc:385] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.726588  3539 raft_consensus.cc:493] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.727172  3539 raft_consensus.cc:515] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.730594  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9736b0800747b989cbdef8a02ac25a" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:38.731223  3539 leader_election.cc:290] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:38.726255  3562 raft_consensus.cc:740] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
W20260709 13:13:38.732343  3230 leader_election.cc:343] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.730754  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9736b0800747b989cbdef8a02ac25a" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
W20260709 13:13:38.734354  3233 leader_election.cc:343] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.734848  3233 leader_election.cc:304] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d893b01f407546b7a63ec8903aa53760; no voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:38.736158  3561 raft_consensus.cc:2749] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.733036  3562 consensus_queue.cc:260] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.737052  3563 tablet_bootstrap.cc:492] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:38.737609  3563 ts_tablet_manager.cc:1403] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 13:13:38.741052  3562 ts_tablet_manager.cc:1434] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:13:38.740720  3563 raft_consensus.cc:359] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.741590  3563 raft_consensus.cc:385] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.741914  3563 raft_consensus.cc:740] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.742152  3562 tablet_bootstrap.cc:492] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:38.742796  3563 consensus_queue.cc:260] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.745419  3563 ts_tablet_manager.cc:1434] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:38.746541  3563 tablet_bootstrap.cc:492] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:38.750109  3562 tablet_bootstrap.cc:654] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.753427  3563 tablet_bootstrap.cc:654] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.766412  3562 tablet_bootstrap.cc:492] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:38.766990  3562 ts_tablet_manager.cc:1403] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:13:38.768905  3563 tablet_bootstrap.cc:492] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:38.769487  3563 ts_tablet_manager.cc:1403] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:13:38.770231  3562 raft_consensus.cc:359] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.771085  3562 raft_consensus.cc:385] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.771420  3562 raft_consensus.cc:740] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.772766  3562 consensus_queue.cc:260] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.773283  3563 raft_consensus.cc:359] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.774102  3563 raft_consensus.cc:385] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.774411  3563 raft_consensus.cc:740] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.775466  3563 consensus_queue.cc:260] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.775283  3562 ts_tablet_manager.cc:1434] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:38.777544  3562 tablet_bootstrap.cc:492] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:38.777992  3563 ts_tablet_manager.cc:1434] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:13:38.778527  3539 raft_consensus.cc:493] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.779232  3563 tablet_bootstrap.cc:492] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:38.779165  3539 raft_consensus.cc:515] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.782269  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4282a060864a6fa758440a82abf506" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
W20260709 13:13:38.783572  3230 leader_election.cc:343] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.791078  3562 tablet_bootstrap.cc:654] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.800256  3539 leader_election.cc:290] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:38.800508  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4282a060864a6fa758440a82abf506" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:38.801324  3414 raft_consensus.cc:2468] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 0.
I20260709 13:13:38.802881  3233 leader_election.cc:304] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:38.803790  3539 raft_consensus.cc:2804] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.804184  3539 raft_consensus.cc:493] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.804539  3539 raft_consensus.cc:3060] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.804682  3563 tablet_bootstrap.cc:654] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.805886  3559 tablet_bootstrap.cc:492] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:38.806499  3559 ts_tablet_manager.cc:1403] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.153s	user 0.049s	sys 0.079s
I20260709 13:13:38.810022  3559 raft_consensus.cc:359] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.810822  3559 raft_consensus.cc:385] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.811158  3559 raft_consensus.cc:740] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.812068  3559 consensus_queue.cc:260] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.814754  3559 ts_tablet_manager.cc:1434] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:13:38.815832  3559 tablet_bootstrap.cc:492] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:38.816085  3539 raft_consensus.cc:515] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.821164  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4282a060864a6fa758440a82abf506" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
W20260709 13:13:38.823187  3230 leader_election.cc:343] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.825754  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4282a060864a6fa758440a82abf506" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:38.826555  3414 raft_consensus.cc:3060] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.829825  3563 tablet_bootstrap.cc:492] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:38.830176  3562 tablet_bootstrap.cc:492] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:38.830721  3562 ts_tablet_manager.cc:1403] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.010s
I20260709 13:13:38.830734  3563 ts_tablet_manager.cc:1403] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.016s
I20260709 13:13:38.834800  3563 raft_consensus.cc:359] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.834995  3562 raft_consensus.cc:359] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.835724  3563 raft_consensus.cc:385] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.835733  3562 raft_consensus.cc:385] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.836388  3563 raft_consensus.cc:740] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.836406  3562 raft_consensus.cc:740] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.837500  3562 consensus_queue.cc:260] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.837608  3563 consensus_queue.cc:260] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.835237  3414 raft_consensus.cc:2468] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 1.
I20260709 13:13:38.840513  3563 ts_tablet_manager.cc:1434] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:38.840473  3233 leader_election.cc:304] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:38.841354  3562 ts_tablet_manager.cc:1434] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:38.841907  3563 tablet_bootstrap.cc:492] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:38.842473  3562 tablet_bootstrap.cc:492] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:38.843392  3559 tablet_bootstrap.cc:654] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.844281  3561 raft_consensus.cc:2804] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.825780  3539 leader_election.cc:290] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:38.849264  3561 raft_consensus.cc:697] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:38.850112  3562 tablet_bootstrap.cc:654] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.850900  3563 tablet_bootstrap.cc:654] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.850737  3561 consensus_queue.cc:237] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.858443  3559 tablet_bootstrap.cc:492] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:38.859229  3559 ts_tablet_manager.cc:1403] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.003s
I20260709 13:13:38.862169  3562 tablet_bootstrap.cc:492] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:38.862810  3562 ts_tablet_manager.cc:1403] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:13:38.862865  3559 raft_consensus.cc:359] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.863751  3559 raft_consensus.cc:385] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.864063  3559 raft_consensus.cc:740] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.864886  3559 consensus_queue.cc:260] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.866436  3562 raft_consensus.cc:359] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.867571  3562 raft_consensus.cc:385] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.867918  3562 raft_consensus.cc:740] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.869207  3559 ts_tablet_manager.cc:1434] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:38.868793  3562 consensus_queue.cc:260] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.869742  3563 tablet_bootstrap.cc:492] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:38.870373  3559 tablet_bootstrap.cc:492] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:38.870798  3563 ts_tablet_manager.cc:1403] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.003s
I20260709 13:13:38.872740  3562 ts_tablet_manager.cc:1434] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:13:38.873972  3562 tablet_bootstrap.cc:492] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:38.874761  3563 raft_consensus.cc:359] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.875623  3563 raft_consensus.cc:385] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.875972  3563 raft_consensus.cc:740] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.876793  3563 consensus_queue.cc:260] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.878077  3559 tablet_bootstrap.cc:654] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.879909  3563 ts_tablet_manager.cc:1434] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:13:38.881101  3563 tablet_bootstrap.cc:492] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:38.882616  3562 tablet_bootstrap.cc:654] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.884836  3560 raft_consensus.cc:493] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.885411  3560 raft_consensus.cc:515] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.888110  3560 leader_election.cc:290] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:38.889099  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5dbcd31ec4cd79a8c43bfbd25217e" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:38.890838  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5dbcd31ec4cd79a8c43bfbd25217e" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:38.892011  3539 raft_consensus.cc:493] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:38.892549  3308 leader_election.cc:343] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:38.893313  3305 leader_election.cc:343] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.894027  3305 leader_election.cc:304] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a; no voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760
I20260709 13:13:38.892576  3539 raft_consensus.cc:515] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.897086  3539 leader_election.cc:290] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:38.898520  3560 raft_consensus.cc:2749] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.901834  3563 tablet_bootstrap.cc:654] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.922827  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
W20260709 13:13:38.924777  3230 leader_election.cc:343] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.925269  3559 tablet_bootstrap.cc:492] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:38.926097  3559 ts_tablet_manager.cc:1403] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.056s	user 0.025s	sys 0.029s
I20260709 13:13:38.928200  3560 raft_consensus.cc:493] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.928738  3560 raft_consensus.cc:515] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.931380  3560 leader_election.cc:290] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:38.932307  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd638cd50a9482191f44d56695e9630" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:38.933672  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd638cd50a9482191f44d56695e9630" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
W20260709 13:13:38.933939  3305 leader_election.cc:343] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.934465  3559 raft_consensus.cc:359] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
W20260709 13:13:38.935232  3308 leader_election.cc:343] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.935582  3559 raft_consensus.cc:385] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.936065  3559 raft_consensus.cc:740] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.936252  3563 tablet_bootstrap.cc:492] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:38.936941  3563 ts_tablet_manager.cc:1403] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.013s
I20260709 13:13:38.935885  3308 leader_election.cc:304] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a; no voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760
I20260709 13:13:38.937367  3559 consensus_queue.cc:260] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.938905  3560 raft_consensus.cc:2749] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.940902  3563 raft_consensus.cc:359] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.941615  3559 ts_tablet_manager.cc:1434] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:13:38.941707  3563 raft_consensus.cc:385] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.941862  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:38.942587  3563 raft_consensus.cc:740] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.943562  3559 tablet_bootstrap.cc:492] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:38.944397  3414 raft_consensus.cc:2468] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 0.
I20260709 13:13:38.945194  3485 raft_consensus.cc:493] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.945878  3485 raft_consensus.cc:515] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.948763  3485 leader_election.cc:290] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:38.950217  3233 leader_election.cc:304] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:38.950599  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:38.951896  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
W20260709 13:13:38.952159  3379 leader_election.cc:343] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.952626  3266 raft_consensus.cc:2468] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:38.954561  3562 tablet_bootstrap.cc:492] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:38.954656  3379 leader_election.cc:304] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:38.955216  3562 ts_tablet_manager.cc:1403] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.081s	user 0.040s	sys 0.035s
I20260709 13:13:38.957118  3485 raft_consensus.cc:2804] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.957595  3485 raft_consensus.cc:493] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.957980  3485 raft_consensus.cc:3060] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.958560  3562 raft_consensus.cc:359] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.959360  3562 raft_consensus.cc:385] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.959663  3562 raft_consensus.cc:740] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.959741  3561 raft_consensus.cc:2804] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.960587  3562 consensus_queue.cc:260] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.963158  3562 ts_tablet_manager.cc:1434] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:38.963070  3561 raft_consensus.cc:493] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.963804  3563 consensus_queue.cc:260] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.963667  3161 catalog_manager.cc:5697] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 0 to 1, leader changed from <none> to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.964568  3562 tablet_bootstrap.cc:492] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:38.964561  3561 raft_consensus.cc:3060] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.967607  3485 raft_consensus.cc:515] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.972949  3562 tablet_bootstrap.cc:654] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.971689  3563 ts_tablet_manager.cc:1434] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:13:38.974668  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:38.975004  3563 tablet_bootstrap.cc:492] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:38.975406  3485 leader_election.cc:290] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:38.975579  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:38.976629  3559 tablet_bootstrap.cc:654] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:38.977038  3379 leader_election.cc:343] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.978345  3561 raft_consensus.cc:515] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.979916  3266 raft_consensus.cc:2393] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b9ef9fe180849ed8d71508135af43fa in current term 1: Already voted for candidate d893b01f407546b7a63ec8903aa53760 in this term.
I20260709 13:13:38.983295  3379 leader_election.cc:304] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa; no voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760
I20260709 13:13:38.984814  3485 raft_consensus.cc:2749] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.987505  3562 tablet_bootstrap.cc:492] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:38.988332  3562 ts_tablet_manager.cc:1403] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:13:38.989950  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
W20260709 13:13:38.992548  3230 leader_election.cc:343] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.993371  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:38.994179  3414 raft_consensus.cc:2393] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d893b01f407546b7a63ec8903aa53760 in current term 1: Already voted for candidate 2b9ef9fe180849ed8d71508135af43fa in this term.
I20260709 13:13:38.995162  3233 leader_election.cc:304] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d893b01f407546b7a63ec8903aa53760; no voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:38.995997  3539 raft_consensus.cc:2749] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.998227  3562 raft_consensus.cc:359] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:38.999199  3562 raft_consensus.cc:385] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.999565  3561 leader_election.cc:290] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:38.999622  3562 raft_consensus.cc:740] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.001121  3562 consensus_queue.cc:260] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.001660  3563 tablet_bootstrap.cc:654] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.003232  3562 ts_tablet_manager.cc:1434] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:13:39.004220  3562 tablet_bootstrap.cc:492] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760: Bootstrap starting.
I20260709 13:13:39.006136  3559 tablet_bootstrap.cc:492] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:39.006753  3559 ts_tablet_manager.cc:1403] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.019s
I20260709 13:13:39.009935  3559 raft_consensus.cc:359] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.010466  3562 tablet_bootstrap.cc:654] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.010797  3559 raft_consensus.cc:385] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.011190  3559 raft_consensus.cc:740] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.012125  3559 consensus_queue.cc:260] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.015002  3559 ts_tablet_manager.cc:1434] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:13:39.016456  3559 tablet_bootstrap.cc:492] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:39.022089  3559 tablet_bootstrap.cc:654] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.031936  3560 raft_consensus.cc:493] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.032793  3560 raft_consensus.cc:515] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.035784  3560 leader_election.cc:290] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.036844  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8023a4ddf414535a7356be4e18f5828" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:39.037555  3414 raft_consensus.cc:2468] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:39.038841  3308 leader_election.cc:304] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:39.051790  3562 tablet_bootstrap.cc:492] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760: No bootstrap required, opened a new log
I20260709 13:13:39.052441  3562 ts_tablet_manager.cc:1403] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.005s
I20260709 13:13:39.052263  3593 raft_consensus.cc:2804] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.052886  3593 raft_consensus.cc:493] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.053313  3593 raft_consensus.cc:3060] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.055559  3562 raft_consensus.cc:359] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.056337  3562 raft_consensus.cc:385] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.056615  3562 raft_consensus.cc:740] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.058292  3562 consensus_queue.cc:260] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.059621  3559 tablet_bootstrap.cc:492] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:39.060144  3559 ts_tablet_manager.cc:1403] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 13:13:39.060644  3562 ts_tablet_manager.cc:1434] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:13:39.065836  3559 raft_consensus.cc:359] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.066704  3559 raft_consensus.cc:385] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.067065  3559 raft_consensus.cc:740] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.068001  3559 consensus_queue.cc:260] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.067086  3593 raft_consensus.cc:515] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.069775  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8023a4ddf414535a7356be4e18f5828" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:39.070426  3593 leader_election.cc:290] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.071535  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8023a4ddf414535a7356be4e18f5828" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:39.072126  3414 raft_consensus.cc:3060] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.072429  3563 tablet_bootstrap.cc:492] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:39.072955  3563 ts_tablet_manager.cc:1403] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.098s	user 0.024s	sys 0.042s
I20260709 13:13:39.070472  3266 raft_consensus.cc:2468] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:39.076115  3563 raft_consensus.cc:359] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.076849  3563 raft_consensus.cc:385] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.077106  3563 raft_consensus.cc:740] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.077975  3563 consensus_queue.cc:260] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.078651  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8023a4ddf414535a7356be4e18f5828" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:39.079427  3266 raft_consensus.cc:3060] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.080372  3414 raft_consensus.cc:2468] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 1.
I20260709 13:13:39.080482  3563 ts_tablet_manager.cc:1434] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:39.081802  3308 leader_election.cc:304] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:39.082085  3563 tablet_bootstrap.cc:492] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a: Bootstrap starting.
I20260709 13:13:39.082837  3592 raft_consensus.cc:2804] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.083588  3559 ts_tablet_manager.cc:1434] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:13:39.085943  3559 tablet_bootstrap.cc:492] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:39.084117  3592 raft_consensus.cc:697] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:39.087263  3592 consensus_queue.cc:237] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.088387  3563 tablet_bootstrap.cc:654] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.095036  3559 tablet_bootstrap.cc:654] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.096565  3266 raft_consensus.cc:2468] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 1.
I20260709 13:13:39.108505  3563 tablet_bootstrap.cc:492] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a: No bootstrap required, opened a new log
I20260709 13:13:39.108595  3559 tablet_bootstrap.cc:492] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:39.109613  3563 ts_tablet_manager.cc:1403] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.015s
I20260709 13:13:39.110018  3559 ts_tablet_manager.cc:1403] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:13:39.112563  3563 raft_consensus.cc:359] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.113384  3563 raft_consensus.cc:385] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.113058  3559 raft_consensus.cc:359] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.113704  3563 raft_consensus.cc:740] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.113976  3559 raft_consensus.cc:385] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.114337  3559 raft_consensus.cc:740] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.114462  3563 consensus_queue.cc:260] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.115190  3559 consensus_queue.cc:260] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.116644  3563 ts_tablet_manager.cc:1434] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:39.116472  3165 catalog_manager.cc:5697] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 1 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.118573  3561 raft_consensus.cc:493] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.119102  3559 ts_tablet_manager.cc:1434] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:13:39.119108  3561 raft_consensus.cc:515] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.120385  3559 tablet_bootstrap.cc:492] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:39.121541  3561 leader_election.cc:290] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.123656  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93892cb51040f2885d4ae618a2f995" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:39.124053  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93892cb51040f2885d4ae618a2f995" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:39.124356  3341 raft_consensus.cc:2468] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 0.
I20260709 13:13:39.124671  3414 raft_consensus.cc:2468] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 0.
I20260709 13:13:39.125872  3233 leader_election.cc:304] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:39.126794  3561 raft_consensus.cc:2804] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.127192  3561 raft_consensus.cc:493] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.127458  3559 tablet_bootstrap.cc:654] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.127557  3561 raft_consensus.cc:3060] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.134902  3561 raft_consensus.cc:515] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.137419  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93892cb51040f2885d4ae618a2f995" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:39.138055  3341 raft_consensus.cc:3060] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.138742  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f93892cb51040f2885d4ae618a2f995" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:39.139334  3414 raft_consensus.cc:3060] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.145973  3341 raft_consensus.cc:2468] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 1.
I20260709 13:13:39.146330  3414 raft_consensus.cc:2468] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 1.
I20260709 13:13:39.147344  3230 leader_election.cc:304] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:39.148450  3576 raft_consensus.cc:2804] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.149315  3559 tablet_bootstrap.cc:492] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:39.149627  3576 raft_consensus.cc:697] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:39.149936  3559 ts_tablet_manager.cc:1403] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.019s
I20260709 13:13:39.150573  3576 consensus_queue.cc:237] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.152987  3559 raft_consensus.cc:359] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.147725  3561 leader_election.cc:290] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.153841  3559 raft_consensus.cc:385] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.154467  3559 raft_consensus.cc:740] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.155263  3559 consensus_queue.cc:260] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.157320  3559 ts_tablet_manager.cc:1434] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:39.158717  3559 tablet_bootstrap.cc:492] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa: Bootstrap starting.
I20260709 13:13:39.161295  3161 catalog_manager.cc:5697] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 0 to 1, leader changed from <none> to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.162839  3592 raft_consensus.cc:493] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.163398  3592 raft_consensus.cc:515] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.165261  3559 tablet_bootstrap.cc:654] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.166304  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:39.167140  3266 raft_consensus.cc:2393] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d5d81a6b8734b759a4450ecb507163a in current term 1: Already voted for candidate d893b01f407546b7a63ec8903aa53760 in this term.
I20260709 13:13:39.168928  3592 leader_election.cc:290] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.170364  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:39.171198  3414 raft_consensus.cc:2393] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d5d81a6b8734b759a4450ecb507163a in current term 1: Already voted for candidate 2b9ef9fe180849ed8d71508135af43fa in this term.
I20260709 13:13:39.171857  3559 tablet_bootstrap.cc:492] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa: No bootstrap required, opened a new log
I20260709 13:13:39.172235  3308 leader_election.cc:304] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a; no voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760
I20260709 13:13:39.172582  3559 ts_tablet_manager.cc:1403] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:13:39.173602  3592 raft_consensus.cc:3060] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.175148  3559 raft_consensus.cc:359] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.175769  3559 raft_consensus.cc:385] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.176005  3559 raft_consensus.cc:740] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.176666  3559 consensus_queue.cc:260] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.178673  3559 ts_tablet_manager.cc:1434] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:39.181056  3592 raft_consensus.cc:2749] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.205436  3592 raft_consensus.cc:493] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.205853  3560 raft_consensus.cc:493] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.206136  3592 raft_consensus.cc:515] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.206557  3560 raft_consensus.cc:515] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.208487  3560 leader_election.cc:290] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.209733  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506d161e43234d97b22230cecfaf22c2" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:39.210198  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4282a060864a6fa758440a82abf506" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:39.210386  3414 raft_consensus.cc:2468] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:39.211024  3415 raft_consensus.cc:2393] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d5d81a6b8734b759a4450ecb507163a in current term 1: Already voted for candidate d893b01f407546b7a63ec8903aa53760 in this term.
I20260709 13:13:39.211159  3265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4282a060864a6fa758440a82abf506" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:39.209136  3592 leader_election.cc:290] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.210269  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506d161e43234d97b22230cecfaf22c2" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:39.211826  3308 leader_election.cc:304] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:39.212458  3266 raft_consensus.cc:2468] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:39.213155  3561 raft_consensus.cc:493] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.213284  3308 leader_election.cc:304] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a; no voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760
I20260709 13:13:39.213641  3592 raft_consensus.cc:2804] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.214059  3592 raft_consensus.cc:493] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.213755  3561 raft_consensus.cc:515] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.214447  3592 raft_consensus.cc:3060] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.214787  3560 raft_consensus.cc:3060] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.216149  3561 leader_election.cc:290] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.217653  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae922587c34526829cbd2f693e4257" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:39.218269  3341 raft_consensus.cc:2468] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 0.
I20260709 13:13:39.218448  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae922587c34526829cbd2f693e4257" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:39.219125  3414 raft_consensus.cc:2468] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 0.
I20260709 13:13:39.219847  3230 leader_election.cc:304] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:39.220774  3561 raft_consensus.cc:2804] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.221169  3561 raft_consensus.cc:493] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.221514  3561 raft_consensus.cc:3060] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.223953  3560 raft_consensus.cc:2749] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.223655  3592 raft_consensus.cc:515] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.226457  3592 leader_election.cc:290] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.226643  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506d161e43234d97b22230cecfaf22c2" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:39.227344  3266 raft_consensus.cc:3060] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.227927  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506d161e43234d97b22230cecfaf22c2" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:39.228507  3414 raft_consensus.cc:3060] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.228729  3561 raft_consensus.cc:515] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.230831  3561 leader_election.cc:290] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.231511  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae922587c34526829cbd2f693e4257" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:39.232026  3341 raft_consensus.cc:3060] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.234584  3266 raft_consensus.cc:2468] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 1.
I20260709 13:13:39.235157  3414 raft_consensus.cc:2468] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 1.
I20260709 13:13:39.236397  3305 leader_election.cc:304] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:39.236253  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae922587c34526829cbd2f693e4257" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:39.237202  3341 raft_consensus.cc:2468] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 1.
I20260709 13:13:39.237464  3415 raft_consensus.cc:3060] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.237507  3592 raft_consensus.cc:2804] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.238251  3592 raft_consensus.cc:697] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:39.238395  3230 leader_election.cc:304] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:39.239168  3592 consensus_queue.cc:237] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.239319  3561 raft_consensus.cc:2804] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.242848  3561 raft_consensus.cc:697] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:39.244231  3561 consensus_queue.cc:237] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.247452  3415 raft_consensus.cc:2468] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 1.
I20260709 13:13:39.253119  3592 raft_consensus.cc:493] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.253834  3592 raft_consensus.cc:515] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.253489  3165 catalog_manager.cc:5697] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 1 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.255708  3161 catalog_manager.cc:5697] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 0 to 1, leader changed from <none> to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.257186  3592 leader_election.cc:290] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.257268  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9736b0800747b989cbdef8a02ac25a" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:39.258232  3266 raft_consensus.cc:2468] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:39.258736  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9736b0800747b989cbdef8a02ac25a" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:39.259269  3305 leader_election.cc:304] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:39.259413  3415 raft_consensus.cc:2468] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 0.
I20260709 13:13:39.260107  3592 raft_consensus.cc:2804] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.260476  3592 raft_consensus.cc:493] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.261405  3592 raft_consensus.cc:3060] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.268575  3592 raft_consensus.cc:515] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.270346  3592 leader_election.cc:290] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.271338  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9736b0800747b989cbdef8a02ac25a" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:39.271400  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9736b0800747b989cbdef8a02ac25a" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:39.272006  3266 raft_consensus.cc:3060] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.272256  3415 raft_consensus.cc:3060] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.277360  3415 raft_consensus.cc:2468] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 1.
I20260709 13:13:39.277621  3266 raft_consensus.cc:2468] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 1.
I20260709 13:13:39.278493  3308 leader_election.cc:304] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:39.279361  3592 raft_consensus.cc:2804] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.279918  3592 raft_consensus.cc:697] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:39.280716  3592 consensus_queue.cc:237] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.289021  3161 catalog_manager.cc:5697] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 1 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.344630  3561 consensus_queue.cc:1048] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.352877  3485 raft_consensus.cc:493] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.353616  3485 raft_consensus.cc:515] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.356722  3485 leader_election.cc:290] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:39.357825  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd638cd50a9482191f44d56695e9630" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760" is_pre_election: true
I20260709 13:13:39.358641  3266 raft_consensus.cc:2468] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:39.359941  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd638cd50a9482191f44d56695e9630" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:39.360623  3341 raft_consensus.cc:2468] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 0.
I20260709 13:13:39.361631  3379 leader_election.cc:304] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:39.363516  3485 raft_consensus.cc:2804] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.363881  3485 raft_consensus.cc:493] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.364220  3485 raft_consensus.cc:3060] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.368135  3561 consensus_queue.cc:1048] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.371605  3485 raft_consensus.cc:515] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.374221  3485 leader_election.cc:290] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:39.374820  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd638cd50a9482191f44d56695e9630" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:39.375461  3266 raft_consensus.cc:3060] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.378248  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd638cd50a9482191f44d56695e9630" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:39.382361  3342 raft_consensus.cc:3060] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.383374  3266 raft_consensus.cc:2468] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:39.384652  3379 leader_election.cc:304] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:39.385619  3485 raft_consensus.cc:2804] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.389853  3485 raft_consensus.cc:697] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:39.390972  3342 raft_consensus.cc:2468] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 1.
I20260709 13:13:39.390767  3485 consensus_queue.cc:237] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.397809  3561 raft_consensus.cc:493] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.398622  3561 raft_consensus.cc:515] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.400885  3561 leader_election.cc:290] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.401640  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5dbcd31ec4cd79a8c43bfbd25217e" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:39.400753  3162 catalog_manager.cc:5697] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 1 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.402017  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5dbcd31ec4cd79a8c43bfbd25217e" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:39.402318  3342 raft_consensus.cc:2468] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 0.
I20260709 13:13:39.402725  3415 raft_consensus.cc:2468] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 0.
I20260709 13:13:39.403478  3230 leader_election.cc:304] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:39.404259  3561 raft_consensus.cc:2804] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.404644  3561 raft_consensus.cc:493] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.404940  3561 raft_consensus.cc:3060] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.411845  3561 raft_consensus.cc:515] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.413609  3561 leader_election.cc:290] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:39.414443  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5dbcd31ec4cd79a8c43bfbd25217e" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:39.414665  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5dbcd31ec4cd79a8c43bfbd25217e" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:39.415089  3342 raft_consensus.cc:3060] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.415292  3415 raft_consensus.cc:3060] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.420639  3342 raft_consensus.cc:2468] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 1.
I20260709 13:13:39.421203  3415 raft_consensus.cc:2468] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 1.
I20260709 13:13:39.421829  3230 leader_election.cc:304] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:39.422691  3561 raft_consensus.cc:2804] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.423187  3561 raft_consensus.cc:697] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:39.423923  3561 consensus_queue.cc:237] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:39.432533  3162 catalog_manager.cc:5697] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 0 to 1, leader changed from <none> to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 1 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:39.502508  3213 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:39.519270  3592 consensus_queue.cc:1048] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.531752  3593 consensus_queue.cc:1048] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.590896  3561 consensus_queue.cc:1048] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.602113  3561 consensus_queue.cc:1048] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.629609  3593 consensus_queue.cc:1048] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.640995  3560 consensus_queue.cc:1048] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.682487  3561 consensus_queue.cc:1048] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.695097  3598 consensus_queue.cc:1048] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.775205  3560 consensus_queue.cc:1048] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.778398  3485 consensus_queue.cc:1048] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.778927  3560 consensus_queue.cc:1048] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.793143  3609 consensus_queue.cc:1048] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.813939  3561 consensus_queue.cc:1048] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.826323  3598 consensus_queue.cc:1048] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:40.506829  3213 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:40.796583  3561 raft_consensus.cc:493] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.797335  3561 raft_consensus.cc:515] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:40.799233  3561 leader_election.cc:290] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:40.800019  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a" is_pre_election: true
I20260709 13:13:40.800465  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa" is_pre_election: true
I20260709 13:13:40.800827  3341 raft_consensus.cc:2468] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 1.
I20260709 13:13:40.801244  3414 raft_consensus.cc:2468] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 1.
I20260709 13:13:40.802004  3230 leader_election.cc:304] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:40.802717  3561 raft_consensus.cc:2804] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:40.803105  3561 raft_consensus.cc:493] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.803380  3561 raft_consensus.cc:3060] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.808439  3561 raft_consensus.cc:515] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:40.810231  3561 leader_election.cc:290] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:40.810987  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:40.811214  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d75a11886c4d14b92e8917c62447fd" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:40.811512  3341 raft_consensus.cc:3060] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.811874  3414 raft_consensus.cc:3060] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.815972  3341 raft_consensus.cc:2468] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:40.816234  3414 raft_consensus.cc:2468] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:40.817211  3230 leader_election.cc:304] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:40.818082  3561 raft_consensus.cc:2804] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.818454  3561 raft_consensus.cc:697] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:40.819172  3561 consensus_queue.cc:237] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:40.828558  3162 catalog_manager.cc:5697] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 0 to 2, leader changed from <none> to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.129901  3341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8023a4ddf414535a7356be4e18f5828"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
mode: GRACEFUL
new_leader_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:43562
I20260709 13:13:41.130541  3341 raft_consensus.cc:606] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Received request to transfer leadership to TS d893b01f407546b7a63ec8903aa53760
I20260709 13:13:41.136157  3341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "506d161e43234d97b22230cecfaf22c2"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
mode: GRACEFUL
new_leader_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:43562
I20260709 13:13:41.136727  3341 raft_consensus.cc:606] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Received request to transfer leadership to TS d893b01f407546b7a63ec8903aa53760
I20260709 13:13:41.155352  3636 raft_consensus.cc:993] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a: : Instructing follower d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:41.155943  3592 raft_consensus.cc:1081] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Signalling peer d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:41.157974  3266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8023a4ddf414535a7356be4e18f5828"
dest_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:53430
I20260709 13:13:41.158692  3266 raft_consensus.cc:493] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.159152  3266 raft_consensus.cc:3060] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.164541  3266 raft_consensus.cc:515] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.166888  3265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccc5dbcd31ec4cd79a8c43bfbd25217e"
dest_uuid: "d893b01f407546b7a63ec8903aa53760"
mode: GRACEFUL
new_leader_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:53438
I20260709 13:13:41.167574  3265 raft_consensus.cc:606] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Received request to transfer leadership to TS 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:41.167492  3341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8023a4ddf414535a7356be4e18f5828" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:41.167280  3266 leader_election.cc:290] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:41.167867  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8023a4ddf414535a7356be4e18f5828" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:41.168264  3341 raft_consensus.cc:3055] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.168718  3414 raft_consensus.cc:3060] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.168709  3341 raft_consensus.cc:740] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:41.169884  3341 consensus_queue.cc:260] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.171087  3341 raft_consensus.cc:3060] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.175290  3266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d4282a060864a6fa758440a82abf506"
dest_uuid: "d893b01f407546b7a63ec8903aa53760"
mode: GRACEFUL
new_leader_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:53438
I20260709 13:13:41.175767  3414 raft_consensus.cc:2468] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:41.175988  3266 raft_consensus.cc:606] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Received request to transfer leadership to TS 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:41.177464  3233 leader_election.cc:304] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:41.178357  3539 raft_consensus.cc:2804] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.179315  3341 raft_consensus.cc:2468] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:41.180330  3539 raft_consensus.cc:697] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:41.181334  3539 consensus_queue.cc:237] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.183128  3561 raft_consensus.cc:993] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760: : Instructing follower 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:41.183658  3561 raft_consensus.cc:1081] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Signalling peer 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:41.184333  3415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fd638cd50a9482191f44d56695e9630"
dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
mode: GRACEFUL
new_leader_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:33450
I20260709 13:13:41.184985  3415 raft_consensus.cc:606] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Received request to transfer leadership to TS 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:41.193104  3341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d4282a060864a6fa758440a82abf506"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:43558
I20260709 13:13:41.193795  3341 raft_consensus.cc:493] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.194188  3341 raft_consensus.cc:3060] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.194072  3266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45ae922587c34526829cbd2f693e4257"
dest_uuid: "d893b01f407546b7a63ec8903aa53760"
mode: GRACEFUL
new_leader_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:53438
I20260709 13:13:41.194936  3266 raft_consensus.cc:606] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Received request to transfer leadership to TS 4d5d81a6b8734b759a4450ecb507163a
I20260709 13:13:41.196841  3162 catalog_manager.cc:5697] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 1 to 2, leader changed from 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194) to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.201910  3341 raft_consensus.cc:515] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.202091  3342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee9736b0800747b989cbdef8a02ac25a"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
mode: GRACEFUL
new_leader_uuid: "2b9ef9fe180849ed8d71508135af43fa"
 from {username='slave'} at 127.0.0.1:43562
I20260709 13:13:41.202749  3342 raft_consensus.cc:606] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Received request to transfer leadership to TS 2b9ef9fe180849ed8d71508135af43fa
I20260709 13:13:41.203778  3341 leader_election.cc:290] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:41.205051  3415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4282a060864a6fa758440a82abf506" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:41.205801  3415 raft_consensus.cc:3060] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.206076  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4282a060864a6fa758440a82abf506" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:41.206604  3266 raft_consensus.cc:3055] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.206832  3266 raft_consensus.cc:740] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:41.208155  3266 consensus_queue.cc:260] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.209182  3414 raft_consensus.cc:1275] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:41.209359  3266 raft_consensus.cc:3060] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.210546  3638 consensus_queue.cc:1048] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.213260  3415 raft_consensus.cc:2468] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:41.214511  3308 leader_election.cc:304] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:41.215454  3637 raft_consensus.cc:2804] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.215925  3637 raft_consensus.cc:697] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:41.216631  3266 raft_consensus.cc:2468] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:41.216756  3637 consensus_queue.cc:237] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.228125  3561 raft_consensus.cc:993] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760: : Instructing follower 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:41.228717  3561 raft_consensus.cc:1081] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Signalling peer 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:41.228657  3341 raft_consensus.cc:1275] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:41.231101  3341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45ae922587c34526829cbd2f693e4257"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:43558
I20260709 13:13:41.231571  3341 raft_consensus.cc:493] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.231904  3341 raft_consensus.cc:3060] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.236521  3165 catalog_manager.cc:5697] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 1 to 2, leader changed from d893b01f407546b7a63ec8903aa53760 (127.24.204.193) to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 2 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.238147  3639 consensus_queue.cc:1048] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.238471  3341 raft_consensus.cc:515] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.241205  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae922587c34526829cbd2f693e4257" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:41.241817  3266 raft_consensus.cc:3055] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.242182  3266 raft_consensus.cc:740] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:41.242982  3266 consensus_queue.cc:260] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.244076  3266 raft_consensus.cc:3060] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.250916  3266 raft_consensus.cc:2468] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:41.252174  3341 leader_election.cc:290] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:41.252789  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ae922587c34526829cbd2f693e4257" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:41.253366  3414 raft_consensus.cc:3060] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.257972  3305 leader_election.cc:304] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:41.260198  3414 raft_consensus.cc:2468] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:41.261205  3637 raft_consensus.cc:2804] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.262006  3637 raft_consensus.cc:697] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:41.263262  3637 consensus_queue.cc:237] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.275054  3638 raft_consensus.cc:993] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760: : Instructing follower 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:41.275579  3638 raft_consensus.cc:1081] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Signalling peer 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:41.277333  3342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccc5dbcd31ec4cd79a8c43bfbd25217e"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:43558
I20260709 13:13:41.276904  3162 catalog_manager.cc:5697] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 1 to 2, leader changed from d893b01f407546b7a63ec8903aa53760 (127.24.204.193) to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 2 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.277995  3342 raft_consensus.cc:493] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.278441  3342 raft_consensus.cc:3060] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.285254  3342 raft_consensus.cc:515] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.287655  3342 leader_election.cc:290] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:41.288175  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5dbcd31ec4cd79a8c43bfbd25217e" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:41.288825  3266 raft_consensus.cc:3055] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.288887  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccc5dbcd31ec4cd79a8c43bfbd25217e" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:41.289194  3266 raft_consensus.cc:740] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:41.289672  3414 raft_consensus.cc:3060] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.290226  3266 consensus_queue.cc:260] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.291247  3266 raft_consensus.cc:3060] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.295123  3414 raft_consensus.cc:2468] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:41.295897  3266 raft_consensus.cc:2468] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:41.296259  3308 leader_election.cc:304] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:41.297171  3637 raft_consensus.cc:2804] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.297804  3637 raft_consensus.cc:697] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:41.298593  3637 consensus_queue.cc:237] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.306833  3162 catalog_manager.cc:5697] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 1 to 2, leader changed from d893b01f407546b7a63ec8903aa53760 (127.24.204.193) to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 2 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.502682  3649 raft_consensus.cc:993] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa: : Instructing follower 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:41.503167  3649 raft_consensus.cc:1081] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Signalling peer 4d5d81a6b8734b759a4450ecb507163a to start an election
I20260709 13:13:41.504698  3342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fd638cd50a9482191f44d56695e9630"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
 from {username='slave'} at 127.0.0.1:43552
I20260709 13:13:41.505308  3342 raft_consensus.cc:493] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.505839  3342 raft_consensus.cc:3060] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.513319  3342 raft_consensus.cc:515] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.515417  3342 leader_election.cc:290] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:41.516222  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd638cd50a9482191f44d56695e9630" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:41.516897  3266 raft_consensus.cc:3060] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.518229  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd638cd50a9482191f44d56695e9630" candidate_uuid: "4d5d81a6b8734b759a4450ecb507163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:41.518929  3414 raft_consensus.cc:3055] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.519264  3414 raft_consensus.cc:740] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:41.520053  3414 consensus_queue.cc:260] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.521320  3414 raft_consensus.cc:3060] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.524328  3266 raft_consensus.cc:2468] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:41.525657  3305 leader_election.cc:304] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5d81a6b8734b759a4450ecb507163a, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:41.526546  3637 raft_consensus.cc:2804] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.527057  3637 raft_consensus.cc:697] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Becoming Leader. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:41.528156  3414 raft_consensus.cc:2468] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d5d81a6b8734b759a4450ecb507163a in term 2.
I20260709 13:13:41.527904  3637 consensus_queue.cc:237] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.536772  3162 catalog_manager.cc:5697] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a reported cstate change: term changed from 1 to 2, leader changed from 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195) to 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194). New cstate: current_term: 2 leader_uuid: "4d5d81a6b8734b759a4450ecb507163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.572036  3636 raft_consensus.cc:993] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a: : Instructing follower d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:41.572607  3637 raft_consensus.cc:1081] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Signalling peer d893b01f407546b7a63ec8903aa53760 to start an election
I20260709 13:13:41.574147  3266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "506d161e43234d97b22230cecfaf22c2"
dest_uuid: "d893b01f407546b7a63ec8903aa53760"
 from {username='slave'} at 127.0.0.1:53430
I20260709 13:13:41.574739  3266 raft_consensus.cc:493] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.575039  3266 raft_consensus.cc:3060] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.579636  3266 raft_consensus.cc:515] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.581107  3266 leader_election.cc:290] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Requested vote from peers 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899), 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195:45557)
I20260709 13:13:41.582290  3414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506d161e43234d97b22230cecfaf22c2" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
I20260709 13:13:41.582290  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506d161e43234d97b22230cecfaf22c2" candidate_uuid: "d893b01f407546b7a63ec8903aa53760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:41.583141  3414 raft_consensus.cc:3060] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.583194  3342 raft_consensus.cc:3055] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.583647  3342 raft_consensus.cc:740] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:41.584455  3342 consensus_queue.cc:260] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.585716  3342 raft_consensus.cc:3060] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.590106  3414 raft_consensus.cc:2468] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:41.591524  3233 leader_election.cc:304] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:41.592252  3638 raft_consensus.cc:2804] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.592430  3342 raft_consensus.cc:2468] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d893b01f407546b7a63ec8903aa53760 in term 2.
I20260709 13:13:41.592770  3638 raft_consensus.cc:697] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Becoming Leader. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:41.593655  3638 consensus_queue.cc:237] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.601279  3162 catalog_manager.cc:5697] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 reported cstate change: term changed from 1 to 2, leader changed from 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194) to d893b01f407546b7a63ec8903aa53760 (127.24.204.193). New cstate: current_term: 2 leader_uuid: "d893b01f407546b7a63ec8903aa53760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.668320  3636 raft_consensus.cc:993] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a: : Instructing follower 2b9ef9fe180849ed8d71508135af43fa to start an election
I20260709 13:13:41.668871  3637 raft_consensus.cc:1081] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Signalling peer 2b9ef9fe180849ed8d71508135af43fa to start an election
I20260709 13:13:41.670603  3414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee9736b0800747b989cbdef8a02ac25a"
dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
 from {username='slave'} at 127.0.0.1:33428
I20260709 13:13:41.671115  3414 raft_consensus.cc:493] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.671422  3414 raft_consensus.cc:3060] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.676976  3414 raft_consensus.cc:515] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.678517  3414 leader_election.cc:290] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 2 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:41.679560  3266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9736b0800747b989cbdef8a02ac25a" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:41.680200  3266 raft_consensus.cc:3060] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.679847  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9736b0800747b989cbdef8a02ac25a" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:41.681058  3342 raft_consensus.cc:3055] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.681375  3342 raft_consensus.cc:740] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:41.682238  3342 consensus_queue.cc:260] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.683569  3342 raft_consensus.cc:3060] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.686215  3414 raft_consensus.cc:1275] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.686975  3266 raft_consensus.cc:2468] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 2.
I20260709 13:13:41.687701  3637 consensus_queue.cc:1048] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.688258  3379 leader_election.cc:304] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:41.689205  3649 raft_consensus.cc:2804] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.689746  3649 raft_consensus.cc:697] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 2 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:41.690958  3342 raft_consensus.cc:2468] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 2.
I20260709 13:13:41.690618  3649 consensus_queue.cc:237] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:41.697399  3414 raft_consensus.cc:1275] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.698107  3266 raft_consensus.cc:1275] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.699158  3636 consensus_queue.cc:1048] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.701453  3162 catalog_manager.cc:5697] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 1 to 2, leader changed from 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194) to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 2 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.704006  3636 consensus_queue.cc:1048] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:41.715283  3265 raft_consensus.cc:1275] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.719249  3637 consensus_queue.cc:1048] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.723582  3415 raft_consensus.cc:1275] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.725921  3561 consensus_queue.cc:1048] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.734321  3266 raft_consensus.cc:1275] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.739826  3637 consensus_queue.cc:1048] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.743044  3342 raft_consensus.cc:1275] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.744911  3561 consensus_queue.cc:1048] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.756124  3414 raft_consensus.cc:1275] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.759325  3654 consensus_queue.cc:1048] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.954243  3265 raft_consensus.cc:1275] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.955569  3654 consensus_queue.cc:1048] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.966207  3414 raft_consensus.cc:1275] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer 4d5d81a6b8734b759a4450ecb507163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.967648  3663 consensus_queue.cc:1048] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.078626  3265 raft_consensus.cc:1275] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Refusing update from remote peer 2b9ef9fe180849ed8d71508135af43fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.079986  3627 consensus_queue.cc:1048] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.089668  3342 raft_consensus.cc:1275] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Refusing update from remote peer 2b9ef9fe180849ed8d71508135af43fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.091521  3666 consensus_queue.cc:1048] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:42.180209  3342 raft_consensus.cc:1275] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.181742  3561 consensus_queue.cc:1048] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.193699  3414 raft_consensus.cc:1275] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Refusing update from remote peer d893b01f407546b7a63ec8903aa53760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.195990  3669 consensus_queue.cc:1048] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:44.207581  3162 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51992:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:44.229759  3162 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51992:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:44.271296 25395 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:44.426664  3230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.194:45899, user_credentials={real_user=slave}} blocked reactor thread for 102494us
W20260709 13:13:44.428552  3233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.204.195:45557, user_credentials={real_user=slave}} blocked reactor thread for 47316.3us
W20260709 13:13:44.519500  3695 log.cc:927] Time spent T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:13:44.547982  3722 tablet.cc:1724] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.557153  3267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c"
dest_uuid: "d893b01f407546b7a63ec8903aa53760"
mode: GRACEFUL
new_leader_uuid: "2b9ef9fe180849ed8d71508135af43fa"
 from {username='slave'} at 127.0.0.1:53470
I20260709 13:13:44.557927  3267 raft_consensus.cc:606] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Received request to transfer leadership to TS 2b9ef9fe180849ed8d71508135af43fa
W20260709 13:13:44.572364  3709 log.cc:927] Time spent T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:13:44.637622  3710 log.cc:927] Time spent T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:13:44.532712  3720 tablet.cc:1724] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.571638  3721 tablet.cc:1724] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.599865  3723 tablet.cc:1724] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:44.665091  3718 log.cc:927] Time spent T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa: Append to log took a long time: real 0.133s	user 0.003s	sys 0.000s
I20260709 13:13:44.574242  3714 tablet.cc:1724] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.668161  3728 tablet.cc:1724] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.683810  3734 tablet.cc:1724] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.570223  3726 tablet.cc:1724] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.710099  3731 tablet.cc:1724] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.726169  3735 tablet.cc:1724] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.733271  3720 tablet.cc:1724] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.758596  3740 tablet.cc:1724] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.783423  3723 tablet.cc:1724] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.794147  3739 tablet.cc:1724] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.801080  3728 tablet.cc:1724] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.804456  3339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2"
dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
mode: GRACEFUL
new_leader_uuid: "2b9ef9fe180849ed8d71508135af43fa"
 from {username='slave'} at 127.0.0.1:59370
I20260709 13:13:44.805202  3339 raft_consensus.cc:606] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Received request to transfer leadership to TS 2b9ef9fe180849ed8d71508135af43fa
I20260709 13:13:44.808022 25395 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:44.811718 25395 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:44.784667  3722 tablet.cc:1724] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.812642  3723 tablet.cc:1724] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.821621  3726 tablet.cc:1724] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.825815  3723 tablet.cc:1724] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.826426  3734 tablet.cc:1724] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.828106  3731 tablet.cc:1724] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.834443  3162 catalog_manager.cc:5789] TS 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899) does not have the latest schema for tablet 2d4282a060864a6fa758440a82abf506 (table soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211]). Expected version 1 got 0
I20260709 13:13:44.845713  3740 tablet.cc:1724] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.838771  3739 tablet.cc:1724] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.878931  3716 raft_consensus.cc:993] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760: : Instructing follower 2b9ef9fe180849ed8d71508135af43fa to start an election
I20260709 13:13:44.878638  3740 tablet.cc:1724] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.879573  3716 raft_consensus.cc:1081] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Signalling peer 2b9ef9fe180849ed8d71508135af43fa to start an election
I20260709 13:13:44.881709  3412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c"
dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
 from {username='slave'} at 127.0.0.1:33440
I20260709 13:13:44.882329  3412 raft_consensus.cc:493] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.882751  3412 raft_consensus.cc:3060] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.782094  3714 tablet.cc:1724] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.891629  3412 raft_consensus.cc:515] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:44.907378  3734 tablet.cc:1724] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.908713  3740 tablet.cc:1724] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:44.918378  3412 leader_election.cc:290] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 3 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:44.919265  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:44.919492  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c0daf5154f4bb299b8302704829e6c" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:44.920004  3264 raft_consensus.cc:3055] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:44.920123  3342 raft_consensus.cc:3060] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.920385  3264 raft_consensus.cc:740] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d893b01f407546b7a63ec8903aa53760, State: Running, Role: LEADER
I20260709 13:13:44.921299  3264 consensus_queue.cc:260] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:44.922698  3264 raft_consensus.cc:3060] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.927563  3342 raft_consensus.cc:2468] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 3.
I20260709 13:13:44.929243  3379 leader_election.cc:304] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, 4d5d81a6b8734b759a4450ecb507163a; no voters: 
I20260709 13:13:44.930240  3666 raft_consensus.cc:2804] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:44.930416  3264 raft_consensus.cc:2468] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 3.
I20260709 13:13:44.930615  3666 raft_consensus.cc:697] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 3 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:44.931577  3666 consensus_queue.cc:237] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:44.937999  3165 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932: soft_deleted_table [id=fcab2c673d3f428eb08cf540c08cd211] alter complete (version 1)
I20260709 13:13:44.948750  3162 catalog_manager.cc:5697] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 2 to 3, leader changed from d893b01f407546b7a63ec8903aa53760 (127.24.204.193) to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 3 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.984957  3715 raft_consensus.cc:993] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a: : Instructing follower 2b9ef9fe180849ed8d71508135af43fa to start an election
I20260709 13:13:44.985666  3672 raft_consensus.cc:1081] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Signalling peer 2b9ef9fe180849ed8d71508135af43fa to start an election
I20260709 13:13:44.987627  3412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2"
dest_uuid: "2b9ef9fe180849ed8d71508135af43fa"
 from {username='slave'} at 127.0.0.1:33428
I20260709 13:13:44.988127  3412 raft_consensus.cc:493] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.988418  3412 raft_consensus.cc:3060] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.995326  3412 raft_consensus.cc:515] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:44.997700  3412 leader_election.cc:290] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 3 election: Requested vote from peers d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033), 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899)
I20260709 13:13:44.998317  3264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d893b01f407546b7a63ec8903aa53760"
I20260709 13:13:44.999099  3264 raft_consensus.cc:3060] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.999243  3342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbcf82a63da4313b6ff24cd81c1ecd2" candidate_uuid: "2b9ef9fe180849ed8d71508135af43fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d5d81a6b8734b759a4450ecb507163a"
I20260709 13:13:44.999922  3342 raft_consensus.cc:3055] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:45.000224  3342 raft_consensus.cc:740] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d5d81a6b8734b759a4450ecb507163a, State: Running, Role: LEADER
I20260709 13:13:45.001029  3342 consensus_queue.cc:260] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:45.002355  3342 raft_consensus.cc:3060] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:45.006299  3264 raft_consensus.cc:2468] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 3.
I20260709 13:13:45.007586  3379 leader_election.cc:304] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9ef9fe180849ed8d71508135af43fa, d893b01f407546b7a63ec8903aa53760; no voters: 
I20260709 13:13:45.008303  3666 raft_consensus.cc:2804] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:45.008850  3666 raft_consensus.cc:697] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 3 LEADER]: Becoming Leader. State: Replica: 2b9ef9fe180849ed8d71508135af43fa, State: Running, Role: LEADER
I20260709 13:13:45.009370  3342 raft_consensus.cc:2468] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9ef9fe180849ed8d71508135af43fa in term 3.
I20260709 13:13:45.009836  3666 consensus_queue.cc:237] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } }
I20260709 13:13:45.018810  3161 catalog_manager.cc:5697] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa reported cstate change: term changed from 2 to 3, leader changed from 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194) to 2b9ef9fe180849ed8d71508135af43fa (127.24.204.195). New cstate: current_term: 3 leader_uuid: "2b9ef9fe180849ed8d71508135af43fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9ef9fe180849ed8d71508135af43fa" member_type: VOTER last_known_addr { host: "127.24.204.195" port: 45557 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:45.422617  3342 raft_consensus.cc:1275] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 3 FOLLOWER]: Refusing update from remote peer 2b9ef9fe180849ed8d71508135af43fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:45.423988  3666 consensus_queue.cc:1048] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:45.434413  3264 raft_consensus.cc:1275] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 3 FOLLOWER]: Refusing update from remote peer 2b9ef9fe180849ed8d71508135af43fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:45.436646  3666 consensus_queue.cc:1048] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:45.487977  3342 raft_consensus.cc:1275] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 3 FOLLOWER]: Refusing update from remote peer 2b9ef9fe180849ed8d71508135af43fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:45.489163  3749 consensus_queue.cc:1048] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5d81a6b8734b759a4450ecb507163a" member_type: VOTER last_known_addr { host: "127.24.204.194" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:45.498171  3264 raft_consensus.cc:1275] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 3 FOLLOWER]: Refusing update from remote peer 2b9ef9fe180849ed8d71508135af43fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:45.500029  3694 consensus_queue.cc:1048] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d893b01f407546b7a63ec8903aa53760" member_type: VOTER last_known_addr { host: "127.24.204.193" port: 46033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:45.879403 25395 tablet_server.cc:179] TabletServer@127.24.204.193:0 shutting down...
W20260709 13:13:45.918669  3379 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:13:45.919889 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:45.921053 25395 tablet_replica.cc:333] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.922092 25395 raft_consensus.cc:2243] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.922608 25395 raft_consensus.cc:2272] T ccc5dbcd31ec4cd79a8c43bfbd25217e P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:45.922817  3379 consensus_peers.cc:597] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa -> Peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Couldn't send request to peer d893b01f407546b7a63ec8903aa53760. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:45.925195 25395 tablet_replica.cc:333] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.926167 25395 raft_consensus.cc:2243] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.926738 25395 raft_consensus.cc:2272] T 4fd638cd50a9482191f44d56695e9630 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:45.928594  3305 consensus_peers.cc:597] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a -> Peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Couldn't send request to peer d893b01f407546b7a63ec8903aa53760. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:45.929323 25395 tablet_replica.cc:333] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.930135 25395 raft_consensus.cc:2243] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.930620 25395 raft_consensus.cc:2272] T 2d4282a060864a6fa758440a82abf506 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.932510 25395 tablet_replica.cc:333] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.933350 25395 raft_consensus.cc:2243] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.933858 25395 raft_consensus.cc:2272] T 4f326f07112440e4bb7d30dae0a46bd4 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.936234 25395 tablet_replica.cc:333] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.936741 25395 raft_consensus.cc:2243] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.937446 25395 raft_consensus.cc:2272] T 506d161e43234d97b22230cecfaf22c2 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.939208 25395 tablet_replica.cc:333] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.939695 25395 raft_consensus.cc:2243] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.940058 25395 raft_consensus.cc:2272] T 313faa5edb7a49aabbca4f28b29d5155 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.941958 25395 tablet_replica.cc:333] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.942437 25395 raft_consensus.cc:2243] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.942811 25395 raft_consensus.cc:2272] T 45ae922587c34526829cbd2f693e4257 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.944732 25395 tablet_replica.cc:333] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.945315 25395 raft_consensus.cc:2243] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.945787 25395 raft_consensus.cc:2272] T fbbcf82a63da4313b6ff24cd81c1ecd2 P d893b01f407546b7a63ec8903aa53760 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.948557 25395 tablet_replica.cc:333] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.949365 25395 raft_consensus.cc:2243] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.950327 25395 raft_consensus.cc:2272] T 643c45d63e6f414b85118745f851c6f4 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.952535 25395 tablet_replica.cc:333] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.953109 25395 raft_consensus.cc:2243] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.953946 25395 raft_consensus.cc:2272] T e1d75a11886c4d14b92e8917c62447fd P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.955785 25395 tablet_replica.cc:333] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.956344 25395 raft_consensus.cc:2243] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.956772 25395 raft_consensus.cc:2272] T 616b48eafd31410b858fe2084bfa8924 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.958760 25395 tablet_replica.cc:333] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.959444 25395 raft_consensus.cc:2243] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.960165 25395 raft_consensus.cc:2272] T 5f93892cb51040f2885d4ae618a2f995 P d893b01f407546b7a63ec8903aa53760 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.961942 25395 tablet_replica.cc:333] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.962452 25395 raft_consensus.cc:2243] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.963213 25395 raft_consensus.cc:2272] T a8023a4ddf414535a7356be4e18f5828 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.965023 25395 tablet_replica.cc:333] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.965477 25395 raft_consensus.cc:2243] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.966289 25395 raft_consensus.cc:2272] T dfcad048e01a4c24b6092842d09c8c2f P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.968220 25395 tablet_replica.cc:333] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.968698 25395 raft_consensus.cc:2243] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.969041 25395 raft_consensus.cc:2272] T 37c0daf5154f4bb299b8302704829e6c P d893b01f407546b7a63ec8903aa53760 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.971457 25395 tablet_replica.cc:333] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.972023 25395 raft_consensus.cc:2243] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.972937 25395 raft_consensus.cc:2272] T 1511623245434b6a8652d7409d0b36b6 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.975666 25395 tablet_replica.cc:333] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.976157 25395 raft_consensus.cc:2243] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.976751 25395 raft_consensus.cc:2272] T ee9736b0800747b989cbdef8a02ac25a P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.978698 25395 tablet_replica.cc:333] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760: stopping tablet replica
I20260709 13:13:45.979192 25395 raft_consensus.cc:2243] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.979643 25395 raft_consensus.cc:2272] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P d893b01f407546b7a63ec8903aa53760 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:45.987098  3379 consensus_peers.cc:597] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa -> Peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Couldn't send request to peer d893b01f407546b7a63ec8903aa53760. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:46.000144  3305 consensus_peers.cc:597] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a -> Peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Couldn't send request to peer d893b01f407546b7a63ec8903aa53760. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:46.002548  3305 consensus_peers.cc:597] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a -> Peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Couldn't send request to peer d893b01f407546b7a63ec8903aa53760. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:46.025043 25395 tablet_server.cc:196] TabletServer@127.24.204.193:0 shutdown complete.
W20260709 13:13:46.044379  3305 consensus_peers.cc:597] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a -> Peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Couldn't send request to peer d893b01f407546b7a63ec8903aa53760. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:46033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:46.059861 25395 tablet_server.cc:179] TabletServer@127.24.204.194:0 shutting down...
W20260709 13:13:46.067828  3305 consensus_peers.cc:597] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a -> Peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Couldn't send request to peer d893b01f407546b7a63ec8903aa53760. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:46033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:46.078815  3305 consensus_peers.cc:597] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a -> Peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Couldn't send request to peer d893b01f407546b7a63ec8903aa53760. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:46033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:46.090819  3379 consensus_peers.cc:597] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa -> Peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Couldn't send request to peer 4d5d81a6b8734b759a4450ecb507163a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:46.093408 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:46.094369 25395 tablet_replica.cc:333] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.095016 25395 raft_consensus.cc:2243] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.095453 25395 raft_consensus.cc:2272] T ee9736b0800747b989cbdef8a02ac25a P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.097467 25395 tablet_replica.cc:333] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.098150 25395 raft_consensus.cc:2243] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.098927 25395 raft_consensus.cc:2272] T 2d4282a060864a6fa758440a82abf506 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.100787 25395 tablet_replica.cc:333] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.101364 25395 raft_consensus.cc:2243] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.101858 25395 raft_consensus.cc:2272] T 5f93892cb51040f2885d4ae618a2f995 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.103698 25395 tablet_replica.cc:333] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.104189 25395 raft_consensus.cc:2243] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.104866 25395 raft_consensus.cc:2272] T 4fd638cd50a9482191f44d56695e9630 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.106668 25395 tablet_replica.cc:333] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.107177 25395 raft_consensus.cc:2243] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.107899 25395 raft_consensus.cc:2272] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.109920 25395 tablet_replica.cc:333] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.110404 25395 raft_consensus.cc:2243] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.111117 25395 raft_consensus.cc:2272] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.113039 25395 tablet_replica.cc:333] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.113523 25395 raft_consensus.cc:2243] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.114073 25395 raft_consensus.cc:2272] T 1511623245434b6a8652d7409d0b36b6 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.115914 25395 tablet_replica.cc:333] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.116392 25395 raft_consensus.cc:2243] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.116765 25395 raft_consensus.cc:2272] T 37c0daf5154f4bb299b8302704829e6c P 4d5d81a6b8734b759a4450ecb507163a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.119292 25395 tablet_replica.cc:333] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.119800 25395 raft_consensus.cc:2243] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.120185 25395 raft_consensus.cc:2272] T 506d161e43234d97b22230cecfaf22c2 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.121963 25395 tablet_replica.cc:333] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.122509 25395 raft_consensus.cc:2243] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.122865 25395 raft_consensus.cc:2272] T 313faa5edb7a49aabbca4f28b29d5155 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.124683 25395 tablet_replica.cc:333] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.125138 25395 raft_consensus.cc:2243] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.125936 25395 raft_consensus.cc:2272] T 4f326f07112440e4bb7d30dae0a46bd4 P 4d5d81a6b8734b759a4450ecb507163a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.127847 25395 tablet_replica.cc:333] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.128340 25395 raft_consensus.cc:2243] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.128700 25395 raft_consensus.cc:2272] T 643c45d63e6f414b85118745f851c6f4 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.130661 25395 tablet_replica.cc:333] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.131129 25395 raft_consensus.cc:2243] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.131497 25395 raft_consensus.cc:2272] T e1d75a11886c4d14b92e8917c62447fd P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.133332 25395 tablet_replica.cc:333] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.133869 25395 raft_consensus.cc:2243] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.134774 25395 raft_consensus.cc:2272] T 616b48eafd31410b858fe2084bfa8924 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.137239 25395 tablet_replica.cc:333] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.137769 25395 raft_consensus.cc:2243] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.138455 25395 raft_consensus.cc:2272] T 45ae922587c34526829cbd2f693e4257 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.140672 25395 tablet_replica.cc:333] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.141207 25395 raft_consensus.cc:2243] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.141683 25395 raft_consensus.cc:2272] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 4d5d81a6b8734b759a4450ecb507163a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.144858 25395 tablet_replica.cc:333] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.145361 25395 raft_consensus.cc:2243] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.145825 25395 raft_consensus.cc:2272] T a8023a4ddf414535a7356be4e18f5828 P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.147552 25395 tablet_replica.cc:333] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a: stopping tablet replica
I20260709 13:13:46.148048 25395 raft_consensus.cc:2243] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.148468 25395 raft_consensus.cc:2272] T dfcad048e01a4c24b6092842d09c8c2f P 4d5d81a6b8734b759a4450ecb507163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.177973 25395 tablet_server.cc:196] TabletServer@127.24.204.194:0 shutdown complete.
I20260709 13:13:46.209223 25395 tablet_server.cc:179] TabletServer@127.24.204.195:0 shutting down...
I20260709 13:13:46.242707 25395 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:13:46.243072  3379 consensus_peers.cc:597] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa -> Peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Couldn't send request to peer 4d5d81a6b8734b759a4450ecb507163a. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:45899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:46.243599 25395 tablet_replica.cc:333] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
W20260709 13:13:46.243701  3379 consensus_peers.cc:597] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa -> Peer 4d5d81a6b8734b759a4450ecb507163a (127.24.204.194:45899): Couldn't send request to peer 4d5d81a6b8734b759a4450ecb507163a. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.194:45899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:46.244510  3379 consensus_peers.cc:597] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa -> Peer d893b01f407546b7a63ec8903aa53760 (127.24.204.193:46033): Couldn't send request to peer d893b01f407546b7a63ec8903aa53760. Status: Network error: Client connection negotiation failed: client connection to 127.24.204.193:46033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:46.244935 25395 raft_consensus.cc:2243] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.245532 25395 raft_consensus.cc:2272] T ccc5dbcd31ec4cd79a8c43bfbd25217e P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.247459 25395 tablet_replica.cc:333] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.247953 25395 raft_consensus.cc:2243] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.248337 25395 raft_consensus.cc:2272] T 4fd638cd50a9482191f44d56695e9630 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.250149 25395 tablet_replica.cc:333] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.250658 25395 raft_consensus.cc:2243] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.251371 25395 raft_consensus.cc:2272] T ee9736b0800747b989cbdef8a02ac25a P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.253155 25395 tablet_replica.cc:333] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.253736 25395 raft_consensus.cc:2243] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.254112 25395 raft_consensus.cc:2272] T 5f93892cb51040f2885d4ae618a2f995 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.255764 25395 tablet_replica.cc:333] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.256237 25395 raft_consensus.cc:2243] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.256613 25395 raft_consensus.cc:2272] T 506d161e43234d97b22230cecfaf22c2 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.258354 25395 tablet_replica.cc:333] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.258823 25395 raft_consensus.cc:2243] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.259572 25395 raft_consensus.cc:2272] T 313faa5edb7a49aabbca4f28b29d5155 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.261636 25395 tablet_replica.cc:333] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.262156 25395 raft_consensus.cc:2243] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.262511 25395 raft_consensus.cc:2272] T 4f326f07112440e4bb7d30dae0a46bd4 P 2b9ef9fe180849ed8d71508135af43fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.264480 25395 tablet_replica.cc:333] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.264971 25395 raft_consensus.cc:2243] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.265332 25395 raft_consensus.cc:2272] T a8023a4ddf414535a7356be4e18f5828 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.267198 25395 tablet_replica.cc:333] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.267689 25395 raft_consensus.cc:2243] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.268064 25395 raft_consensus.cc:2272] T dfcad048e01a4c24b6092842d09c8c2f P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.270092 25395 tablet_replica.cc:333] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.270663 25395 raft_consensus.cc:2243] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.271100 25395 raft_consensus.cc:2272] T 2d4282a060864a6fa758440a82abf506 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.272914 25395 tablet_replica.cc:333] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.273686 25395 raft_consensus.cc:2243] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.274165 25395 raft_consensus.cc:2272] T 1511623245434b6a8652d7409d0b36b6 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.276196 25395 tablet_replica.cc:333] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.276736 25395 raft_consensus.cc:2243] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.277525 25395 raft_consensus.cc:2272] T 37c0daf5154f4bb299b8302704829e6c P 2b9ef9fe180849ed8d71508135af43fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.280048 25395 tablet_replica.cc:333] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.280640 25395 raft_consensus.cc:2243] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.281118 25395 raft_consensus.cc:2272] T 616b48eafd31410b858fe2084bfa8924 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.283092 25395 tablet_replica.cc:333] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.283612 25395 raft_consensus.cc:2243] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.284067 25395 raft_consensus.cc:2272] T e1d75a11886c4d14b92e8917c62447fd P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.286046 25395 tablet_replica.cc:333] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.286796 25395 raft_consensus.cc:2243] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.287307 25395 raft_consensus.cc:2272] T 643c45d63e6f414b85118745f851c6f4 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.289276 25395 tablet_replica.cc:333] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.289849 25395 raft_consensus.cc:2243] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.290284 25395 raft_consensus.cc:2272] T 45ae922587c34526829cbd2f693e4257 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.292004 25395 tablet_replica.cc:333] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.292519 25395 raft_consensus.cc:2243] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.293380 25395 raft_consensus.cc:2272] T fbbcf82a63da4313b6ff24cd81c1ecd2 P 2b9ef9fe180849ed8d71508135af43fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.295804 25395 tablet_replica.cc:333] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa: stopping tablet replica
I20260709 13:13:46.296275 25395 raft_consensus.cc:2243] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:46.296711 25395 raft_consensus.cc:2272] T 19cdf59bd2984a86bc3a86f8bbe8bb59 P 2b9ef9fe180849ed8d71508135af43fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.326570 25395 tablet_server.cc:196] TabletServer@127.24.204.195:0 shutdown complete.
I20260709 13:13:46.356231 25395 master.cc:562] Master@127.24.204.254:45225 shutting down...
I20260709 13:13:46.379026 25395 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:46.379524 25395 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:46.379802 25395 tablet_replica.cc:333] T 00000000000000000000000000000000 P 873ae9ef01fe4d6091c805fb9a293932: stopping tablet replica
I20260709 13:13:46.401116 25395 master.cc:584] Master@127.24.204.254:45225 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (13176 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26148 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (318003 ms total)
[  PASSED  ] 8 tests.
I20260709 13:13:46.461146 25395 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 414 messages since previous log ~16 seconds ago
I20260709 13:13:46.461383 25395 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 414 messages since previous log ~16 seconds ago
I20260709 13:13:46.461540 25395 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 410 messages since previous log ~16 seconds ago
I20260709 13:13:46.461894 25395 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:13:46.462065 25395 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:13:46.462226 25395 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~77 seconds ago
I20260709 13:13:46.462392 25395 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 8 messages since previous log ~177 seconds ago
I20260709 13:13:46.462604 25395 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~0 seconds ago
I20260709 13:13:46.462875 25395 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~7 seconds ago
